Sep 10 02:33:40.215498 ip-10-0-137-96 systemd[1]: Starting Kubernetes Kubelet... Sep 10 02:33:40.593163 ip-10-0-137-96 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:33:40.593163 ip-10-0-137-96 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 02:33:40.593163 ip-10-0-137-96 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:33:40.593163 ip-10-0-137-96 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 02:33:40.593163 ip-10-0-137-96 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:33:40.595621 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.595534 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 02:33:40.598689 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598673 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598690 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598695 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598699 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598702 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598705 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598708 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598711 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598714 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598717 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598720 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598723 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598725 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598728 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:40.598725 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598731 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598734 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598737 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598739 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598742 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598745 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598747 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598750 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598753 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598755 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598758 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598761 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598763 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598766 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598770 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598773 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598776 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598779 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598782 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598785 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:40.599068 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598788 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598790 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598792 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598795 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598798 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598800 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598803 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598806 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598809 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598811 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598814 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598816 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598822 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598825 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598828 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598831 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598834 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598836 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598839 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:40.599594 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598841 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598844 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598847 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598850 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598852 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598855 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598858 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598860 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598863 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598865 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598868 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598870 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598873 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598875 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598878 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598880 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598883 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598886 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598888 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598891 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:40.600077 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598893 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598896 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598898 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598901 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598904 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598906 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598909 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598912 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598916 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598919 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598922 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598924 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598928 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598932 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598936 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598938 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598941 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598944 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598946 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:40.600570 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598949 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598951 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598954 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598956 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598960 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.598963 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599656 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599662 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599665 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599668 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599671 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599675 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599678 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599681 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599684 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599687 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599690 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599694 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599696 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:40.601046 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599701 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599705 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599709 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599712 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599716 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599719 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599722 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599725 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599728 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599731 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599733 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599736 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599738 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599741 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599743 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599746 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599748 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599751 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599753 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:40.601528 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599756 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599758 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599761 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599763 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599766 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599768 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599771 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599774 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599777 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599780 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599782 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599785 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599788 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599791 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599793 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599798 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599802 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599804 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599807 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599810 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:40.602028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599812 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599815 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599817 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599819 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599822 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599824 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599827 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599829 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599832 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599834 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599837 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599839 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599842 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599845 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599847 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599850 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599852 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599855 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599857 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599860 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:40.602523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599863 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599865 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599868 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599871 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599874 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599876 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599879 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599881 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599884 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599886 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599889 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599892 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599894 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599897 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599899 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599902 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599904 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599907 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599909 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599912 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:40.603013 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599914 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599917 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599919 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599921 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599924 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599926 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.599928 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600295 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600302 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600305 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600308 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600312 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600314 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600317 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600320 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600323 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600326 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600328 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600331 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600334 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:40.603519 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600336 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600339 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600342 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600344 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600347 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600349 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600352 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600354 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600357 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600359 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600362 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600366 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600370 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600374 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600377 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600380 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600383 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600386 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600388 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:40.604005 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600391 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600395 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600397 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600400 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600402 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600405 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600409 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600414 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600417 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600419 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600422 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600424 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600427 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600429 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600432 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600434 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600437 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600439 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600442 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600445 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:40.604496 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600447 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600450 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600453 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600455 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600458 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600460 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600463 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600465 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600468 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600470 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600473 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600475 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600478 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600482 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600484 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600487 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600489 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600492 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600495 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600499 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:40.604981 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600502 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600504 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600507 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600509 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600512 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600514 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600517 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600519 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600522 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600524 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600527 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600529 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600532 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600534 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600537 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600539 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600542 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600544 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600547 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:40.605486 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600549 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600552 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600554 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600557 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600560 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600562 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600566 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.600568 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600654 2576 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600688 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600695 2576 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600699 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600705 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600708 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600712 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600715 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600719 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600721 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600725 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600728 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600731 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600734 2576 flags.go:64] FLAG: --cgroup-root="" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600737 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 02:33:40.605939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600740 2576 flags.go:64] FLAG: --client-ca-file="" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600742 2576 flags.go:64] FLAG: --cloud-provider="external" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600746 2576 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600750 2576 flags.go:64] FLAG: --cluster-domain="" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600752 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600755 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600758 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600762 2576 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600765 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600768 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600771 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600774 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600777 2576 flags.go:64] FLAG: --contention-profiling="false" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600780 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600782 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600787 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600790 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600794 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600797 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600800 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600803 2576 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600807 2576 flags.go:64] FLAG: --enable-server="true" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600810 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600814 2576 flags.go:64] FLAG: --event-burst="100" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600817 2576 flags.go:64] FLAG: --event-qps="50" Sep 10 02:33:40.606497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600820 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600823 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600826 2576 flags.go:64] FLAG: --eviction-hard="" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600829 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600832 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600835 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600838 2576 flags.go:64] FLAG: --eviction-soft="" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600840 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600843 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600846 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600849 2576 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600851 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600854 2576 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600857 2576 flags.go:64] FLAG: --feature-gates="" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600860 2576 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600863 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600867 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600870 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600873 2576 flags.go:64] FLAG: --healthz-port="10248" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600875 2576 flags.go:64] FLAG: --help="false" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600878 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600881 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600885 2576 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 02:33:40.607115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600888 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600891 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600895 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600897 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600900 2576 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600904 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600907 2576 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600910 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600913 2576 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600916 2576 flags.go:64] FLAG: --kube-reserved="" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600919 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600922 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600925 2576 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600928 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600931 2576 flags.go:64] FLAG: --lock-file="" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600934 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600936 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600939 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600945 2576 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600947 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600951 2576 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600953 2576 flags.go:64] FLAG: --logging-format="text" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600956 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600959 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 02:33:40.607766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600962 2576 flags.go:64] FLAG: --manifest-url="" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600965 2576 flags.go:64] FLAG: --manifest-url-header="" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600969 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600972 2576 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600976 2576 flags.go:64] FLAG: --max-pods="110" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600978 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600981 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600987 2576 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600990 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600992 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600995 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.600998 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601009 2576 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601013 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601016 2576 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601019 2576 flags.go:64] FLAG: --pod-cidr="" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601022 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601027 2576 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601030 2576 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601033 2576 flags.go:64] FLAG: --pods-per-core="0" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601036 2576 flags.go:64] FLAG: --port="10250" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601039 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601042 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02bd0ad6ffd8687cd" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601045 2576 flags.go:64] FLAG: --qos-reserved="" Sep 10 02:33:40.608392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601047 2576 flags.go:64] FLAG: --read-only-port="10255" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601050 2576 flags.go:64] FLAG: --register-node="true" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601053 2576 flags.go:64] FLAG: --register-with-taints="" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601057 2576 flags.go:64] FLAG: --registry-burst="10" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601059 2576 flags.go:64] FLAG: --registry-qps="5" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601062 2576 flags.go:64] FLAG: --reserved-cpus="" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601065 2576 flags.go:64] FLAG: --reserved-memory="" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601069 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601072 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601075 2576 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601077 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601080 2576 flags.go:64] FLAG: --runonce="false" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601083 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601086 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601089 2576 flags.go:64] FLAG: --seccomp-default="false" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601092 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601095 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601098 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601101 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601104 2576 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601106 2576 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601109 2576 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601113 2576 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601116 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601119 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 02:33:40.608963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601122 2576 flags.go:64] FLAG: --system-cgroups="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601125 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601130 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601132 2576 flags.go:64] FLAG: --tls-cert-file="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601135 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601138 2576 flags.go:64] FLAG: --tls-min-version="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601141 2576 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601143 2576 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601146 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601149 2576 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601152 2576 flags.go:64] FLAG: --v="2" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601155 2576 flags.go:64] FLAG: --version="false" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601159 2576 flags.go:64] FLAG: --vmodule="" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601162 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601165 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601288 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601293 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601297 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601300 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601304 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601307 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601310 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:40.609569 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601314 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601317 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601320 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601322 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601325 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601327 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601330 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601334 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601336 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601339 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601341 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601344 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601347 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601350 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601352 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601355 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601357 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601360 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601363 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601365 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:40.610097 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601368 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601371 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601373 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601376 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601378 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601382 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601385 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601388 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601391 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601395 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601398 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601401 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601405 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601408 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601410 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601413 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601416 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601418 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601421 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601425 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:40.610596 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601428 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601430 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601433 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601436 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601438 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601441 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601444 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601446 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601449 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601452 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601454 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601457 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601459 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601462 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601464 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601467 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601469 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601472 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601474 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:40.611115 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601477 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601479 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601482 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601484 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601487 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601490 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601493 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601495 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601498 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601500 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601503 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601505 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601509 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601511 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601514 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601517 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601520 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601522 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601525 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601528 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:40.611584 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601531 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601534 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601536 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601539 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601542 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601544 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601547 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601549 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601552 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601554 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601556 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601559 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.601561 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.601567 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.608605 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 02:33:40.612061 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.608619 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.608636 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.608645 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608697 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608702 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608705 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608708 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608712 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608714 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608718 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608721 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608724 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608727 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608742 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608745 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608747 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608750 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608753 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:40.612501 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608755 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608758 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608760 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608763 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608766 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608768 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608771 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608773 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608776 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608778 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608781 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608784 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608786 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608790 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608793 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608796 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608799 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608801 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608805 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608809 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:40.612953 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608812 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608815 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608818 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608821 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608824 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608827 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608829 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608832 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608834 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608837 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608839 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608842 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608845 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608847 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608850 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608852 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608855 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608858 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608861 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608863 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:40.613458 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608866 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608868 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608870 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608873 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608875 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608878 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608885 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608888 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608890 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608893 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608896 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608898 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608901 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608903 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608906 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608909 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608911 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608914 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608916 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608919 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:40.614028 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608921 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608924 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608928 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608932 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608934 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608937 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608939 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608942 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608944 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608947 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608950 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608952 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608955 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608958 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608960 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608963 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608966 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608971 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608974 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:40.614564 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608978 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608981 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608984 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.608987 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.608992 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609105 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609109 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609112 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609115 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609118 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609121 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609124 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609127 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609129 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609132 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:40.615024 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609134 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609136 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609139 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609141 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609144 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609146 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609149 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609152 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609154 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609157 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609159 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609162 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609164 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609167 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609170 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609174 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609178 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609181 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609201 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:40.615433 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609205 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609209 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609211 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609214 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609217 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609219 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609222 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609225 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609227 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609230 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609232 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609234 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609237 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609240 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609242 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609244 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609247 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609250 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609254 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609257 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:40.615894 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609260 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609262 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609265 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609268 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609270 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609273 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609275 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609278 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609280 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609283 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609286 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609288 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609292 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609294 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609297 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609299 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609302 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609304 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609307 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609309 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:40.616426 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609312 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609314 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609316 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609319 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609322 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609324 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609326 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609329 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609331 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609334 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609336 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609339 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609341 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609344 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609346 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609349 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609351 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609354 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609356 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609378 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:40.617157 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609381 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609384 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609387 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609390 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609392 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609397 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609400 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609403 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609406 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:40.609409 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.609413 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.609509 2576 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.611512 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.612357 2576 server.go:1019] "Starting client certificate rotation" Sep 10 02:33:40.617659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.612451 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 02:33:40.618034 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.612517 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 02:33:40.618034 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.614515 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 02:33:40.618642 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.618625 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 02:33:40.626979 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.626963 2576 log.go:25] "Validated CRI v1 runtime API" Sep 10 02:33:40.632000 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.631981 2576 log.go:25] "Validated CRI v1 image API" Sep 10 02:33:40.632880 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.632862 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 02:33:40.635302 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.635285 2576 fs.go:135] Filesystem UUIDs: map[240f5d46-3478-4d31-9776-37f831359f69:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ed120e12-4cd3-4262-9c4b-b565bab5db9f:/dev/nvme0n1p4] Sep 10 02:33:40.635356 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.635303 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 02:33:40.640565 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.640547 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 02:33:40.640683 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.640558 2576 manager.go:216] Machine: {Timestamp:2026-09-10 02:33:40.639330539 +0000 UTC m=+0.310971575 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096131 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad1890c14bcc1230aa7dafe1eb986 SystemUUID:ec2ad189-0c14-bcc1-230a-a7dafe1eb986 BootID:b0a80c81-bd5a-46f5-a297-60fefa8ef9fb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:f9:78:35:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:f9:78:35:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:2b:61:d9:05:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 02:33:40.640683 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.640670 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 02:33:40.640805 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.640750 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 02:33:40.642859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.642838 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 02:33:40.643017 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.642864 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 02:33:40.643711 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.643699 2576 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 02:33:40.643773 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.643717 2576 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 02:33:40.643773 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.643734 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 02:33:40.645131 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.645119 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 02:33:40.647059 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.647041 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 02:33:40.650626 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650614 2576 state_mem.go:36] "Initialized new in-memory state store" Sep 10 02:33:40.650751 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650740 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 02:33:40.650807 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650777 2576 kubelet.go:486] "Attempting to sync node with API server" Sep 10 02:33:40.650807 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650791 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 02:33:40.650807 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650806 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 02:33:40.650923 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650823 2576 kubelet.go:398] "Adding apiserver pod source" Sep 10 02:33:40.650923 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.650835 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 02:33:40.651168 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.651154 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 02:33:40.651256 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.651178 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 02:33:40.653146 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.653131 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 02:33:40.656006 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.655990 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 02:33:40.656092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656028 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 02:33:40.656225 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656213 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 02:33:40.656289 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656232 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 02:33:40.656289 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656241 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 02:33:40.656289 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656249 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 02:33:40.656289 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656261 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 02:33:40.656289 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656268 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 02:33:40.656766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656752 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 02:33:40.656766 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656765 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 02:33:40.656877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656787 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 02:33:40.656877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656796 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 02:33:40.656877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656820 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 02:33:40.656877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656833 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 02:33:40.656877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656861 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 02:33:40.656877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.656870 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 02:33:40.660551 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.660527 2576 server.go:1268] "Started kubelet" Sep 10 02:33:40.660685 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.660591 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 02:33:40.664294 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.660646 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 02:33:40.664457 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.664434 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 02:33:40.664558 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.664541 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 02:33:40.664633 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.664614 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 02:33:40.664737 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.664721 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 02:33:40.664840 ip-10-0-137-96 systemd[1]: Started Kubernetes Kubelet. Sep 10 02:33:40.666250 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.666230 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ctqs" Sep 10 02:33:40.667065 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.667031 2576 server.go:310] "Adding debug handlers to kubelet server" Sep 10 02:33:40.668562 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.668546 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 02:33:40.670036 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.670014 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 02:33:40.670286 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.669397 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-96.ec2.internal.18d3d4f3d1ef8694 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-96.ec2.internal,UID:ip-10-0-137-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-96.ec2.internal,},FirstTimestamp:2026-09-10 02:33:40.66049602 +0000 UTC m=+0.332137055,LastTimestamp:2026-09-10 02:33:40.66049602 +0000 UTC m=+0.332137055,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-96.ec2.internal,}" Sep 10 02:33:40.673154 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.673141 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ctqs" Sep 10 02:33:40.673372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.673359 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 02:33:40.674017 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674001 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 02:33:40.674116 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.674107 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:40.674617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674477 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 02:33:40.674715 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674621 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 02:33:40.674715 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674485 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 02:33:40.674818 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674719 2576 reconstruct.go:97] "Volume reconstruction finished" Sep 10 02:33:40.674818 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674726 2576 reconciler.go:29] "Reconciler: start to sync state" Sep 10 02:33:40.674818 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674782 2576 factory.go:55] Registering systemd factory Sep 10 02:33:40.674818 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674796 2576 factory.go:223] Registration of the systemd container factory successfully Sep 10 02:33:40.675003 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674964 2576 factory.go:153] Registering CRI-O factory Sep 10 02:33:40.675003 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.674972 2576 factory.go:223] Registration of the crio container factory successfully Sep 10 02:33:40.675069 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.675022 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 02:33:40.675069 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.675041 2576 factory.go:103] Registering Raw factory Sep 10 02:33:40.675069 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.675066 2576 manager.go:1196] Started watching for new ooms in manager Sep 10 02:33:40.675457 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.675445 2576 manager.go:349] Starting recovery of all containers Sep 10 02:33:40.680248 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.678769 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:40.682887 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.682864 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.685460 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.685445 2576 manager.go:354] Recovery completed Sep 10 02:33:40.689842 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.689831 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.691471 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.691453 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.691542 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.691490 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.691542 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.691506 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.692033 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692019 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.692104 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692023 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 02:33:40.692104 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692054 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 02:33:40.692104 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692073 2576 state_mem.go:36] "Initialized new in-memory state store" Sep 10 02:33:40.692689 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692673 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.692753 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692703 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.692753 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.692714 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.693232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.693172 2576 policy_none.go:49] "None policy: Start" Sep 10 02:33:40.693274 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.693242 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 02:33:40.693274 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.693254 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 02:33:40.694365 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.694355 2576 policy_none.go:47] "Start" Sep 10 02:33:40.723757 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.723739 2576 manager.go:337] "Starting Device Plugin manager" Sep 10 02:33:40.723882 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.723776 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 02:33:40.723882 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.723786 2576 server.go:87] "Starting device plugin registration server" Sep 10 02:33:40.724099 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.724084 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 02:33:40.724175 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.724104 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 02:33:40.724244 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.724210 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 02:33:40.724359 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.724303 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 02:33:40.724359 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.724317 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 02:33:40.725838 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.725814 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 02:33:40.725913 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.725869 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:40.809828 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.809804 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 02:33:40.811152 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.811137 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 02:33:40.811242 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.811205 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 02:33:40.811242 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.811233 2576 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 02:33:40.811336 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.811281 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 02:33:40.813933 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.813912 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:40.825165 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.825151 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.827929 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.827912 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.827999 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.827944 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.827999 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.827955 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.827999 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.827975 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.836405 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.836393 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.836457 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.836411 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-96.ec2.internal\": node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:40.853266 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.853212 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:40.911739 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.911717 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"] Sep 10 02:33:40.911812 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.911782 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.913339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.913322 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.913407 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.913352 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.913407 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.913364 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.915059 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915040 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.915160 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.915218 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915176 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.915721 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915707 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.915783 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915727 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.915783 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915740 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.915783 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915775 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.915918 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915800 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.915918 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.915821 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.917252 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.917236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.917335 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.917265 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:40.917919 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.917904 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:40.918003 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.917934 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:40.918003 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.917949 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:40.943758 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.943735 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.948197 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.948167 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.954041 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:40.954027 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:40.976511 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.976490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/277c30dbbf575dc44122b1220e5c2c65-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"277c30dbbf575dc44122b1220e5c2c65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.976584 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.976512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65b68b5fb7a6a498e11068b301da6d7d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"65b68b5fb7a6a498e11068b301da6d7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:40.976584 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:40.976532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65b68b5fb7a6a498e11068b301da6d7d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"65b68b5fb7a6a498e11068b301da6d7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.054756 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.054726 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:41.077052 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.077028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65b68b5fb7a6a498e11068b301da6d7d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"65b68b5fb7a6a498e11068b301da6d7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.077130 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.077061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65b68b5fb7a6a498e11068b301da6d7d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"65b68b5fb7a6a498e11068b301da6d7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.077130 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.077085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/277c30dbbf575dc44122b1220e5c2c65-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"277c30dbbf575dc44122b1220e5c2c65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.077253 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.077139 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65b68b5fb7a6a498e11068b301da6d7d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"65b68b5fb7a6a498e11068b301da6d7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.077253 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.077136 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/277c30dbbf575dc44122b1220e5c2c65-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"277c30dbbf575dc44122b1220e5c2c65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.077253 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.077146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65b68b5fb7a6a498e11068b301da6d7d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"65b68b5fb7a6a498e11068b301da6d7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.155491 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.155439 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:41.246956 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.246937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.252081 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.252065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.256227 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.256211 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:41.356804 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.356764 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:41.457286 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.457226 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:41.557865 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.557841 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Sep 10 02:33:41.594622 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.594600 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:41.611883 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.611865 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 02:33:41.611975 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.611960 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 02:33:41.612018 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.612001 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 02:33:41.612055 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.612004 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 02:33:41.651163 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.651141 2576 apiserver.go:52] "Watching apiserver" Sep 10 02:33:41.668276 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.668252 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 02:33:41.669789 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.669770 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-8k7l8","kube-system/konnectivity-agent-s57p9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql","openshift-cluster-node-tuning-operator/tuned-x56qj","openshift-image-registry/node-ca-mxhzh","openshift-multus/multus-additional-cni-plugins-6fbjg","openshift-multus/network-metrics-daemon-6ftmw","openshift-network-diagnostics/network-check-target-5bxb6","openshift-network-operator/iptables-alerter-9vhtr","kube-system/global-pull-secret-syncer-qdg75","openshift-dns/node-resolver-qtkvt","openshift-multus/multus-dwkjm"] Sep 10 02:33:41.671525 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.671510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.672762 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.672743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.673501 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.673475 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 02:33:41.674846 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.674346 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 02:33:41.674846 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.674375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.674846 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.674392 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.674846 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.674665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 02:33:41.675075 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.674920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.675075 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.675066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 02:33:41.675678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.675439 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c4sh9\"" Sep 10 02:33:41.675678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.675544 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 02:33:41.675817 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.675683 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 02:28:41 +0000 UTC" deadline="2028-03-14 03:52:53.823973122 +0000 UTC" Sep 10 02:33:41.675817 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.675749 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13225h19m12.148227946s" Sep 10 02:33:41.675906 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.675839 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 02:33:41.676017 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.676000 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4f9cf\"" Sep 10 02:33:41.676439 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.676416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.677415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.676736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 02:33:41.677415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.676754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 02:33:41.677415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.677027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.677415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.677108 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.677415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.677161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6zcsq\"" Sep 10 02:33:41.677415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.677175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.678646 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.678627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.679250 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.679235 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.679337 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.679271 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-skq9b\"" Sep 10 02:33:41.679393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.679382 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.679957 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.679944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.680231 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-sys\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.680290 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-kubelet\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680290 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-node-log\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680359 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-cni-bin\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680359 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680359 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btv8d\" (UniqueName: \"kubernetes.io/projected/faf34934-2893-429c-a49e-46b2b67fd61f-kube-api-access-btv8d\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680472 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.680472 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-slash\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680472 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-systemd\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680472 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680472 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-ovn\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-env-overrides\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680475 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680481 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680506 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hb847\"" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff97aea9-d48d-49a2-8baa-68b423b94cb9-agent-certs\") pod \"konnectivity-agent-s57p9\" (UID: \"ff97aea9-d48d-49a2-8baa-68b423b94cb9\") " pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff97aea9-d48d-49a2-8baa-68b423b94cb9-konnectivity-ca\") pod \"konnectivity-agent-s57p9\" (UID: \"ff97aea9-d48d-49a2-8baa-68b423b94cb9\") " pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-kubernetes\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9472070e-5549-43ba-8589-1867ce57f589-etc-tuned\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysconfig\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-run\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-host\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.680678 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9472070e-5549-43ba-8589-1867ce57f589-tmp\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-systemd-units\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-run-ovn-kubernetes\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-socket-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-device-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysctl-d\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysctl-conf\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-var-lib-kubelet\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-run-netns\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-var-lib-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-ovnkube-config\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faf34934-2893-429c-a49e-46b2b67fd61f-ovn-node-metrics-cert\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-registration-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-modprobe-d\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-systemd\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-etc-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-log-socket\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.680985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-cni-netd\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-lib-modules\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79ddp\" (UniqueName: \"kubernetes.io/projected/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-kube-api-access-79ddp\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjcbv\" (UniqueName: \"kubernetes.io/projected/9472070e-5549-43ba-8589-1867ce57f589-kube-api-access-qjcbv\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-ovnkube-script-lib\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-sys-fs\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.681321 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:41.681709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.682078 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681963 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 02:33:41.682078 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.681972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 02:33:41.682078 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.682033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 02:33:41.682231 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.682199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.682397 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.682383 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tdgc2\"" Sep 10 02:33:41.682696 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.682680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:41.682770 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.682742 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:41.684165 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.684149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.685440 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.685418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.685542 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.685477 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:41.685968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.685947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 02:33:41.685968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.685951 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.686346 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.685951 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mq2tf\"" Sep 10 02:33:41.686346 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.685950 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 02:33:41.686346 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.686101 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.686971 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.686738 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.688302 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.688284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7lnzb\"" Sep 10 02:33:41.688373 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.688303 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 02:33:41.688373 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.688327 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 02:33:41.688501 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.688425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.689796 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.689782 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 02:33:41.689867 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.689860 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Sep 10 02:33:41.689951 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.689929 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"] Sep 10 02:33:41.690147 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.690112 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 02:33:41.690262 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.690250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z7php\"" Sep 10 02:33:41.700213 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.700164 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"] Sep 10 02:33:41.700315 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.700219 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 02:33:41.711372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.711323 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdlt8" Sep 10 02:33:41.720729 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.719061 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdlt8" Sep 10 02:33:41.775624 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.775603 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 02:33:41.781365 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.781365 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff97aea9-d48d-49a2-8baa-68b423b94cb9-agent-certs\") pod \"konnectivity-agent-s57p9\" (UID: \"ff97aea9-d48d-49a2-8baa-68b423b94cb9\") " pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-tmp-dir\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-netns\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzbjj\" (UniqueName: \"kubernetes.io/projected/980357a5-0ec8-4679-b29e-1edd5f55d693-kube-api-access-jzbjj\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-kubernetes\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781457 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-host\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.781519 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-serviceca\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-run\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-kubernetes\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-host\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781634 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-run\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-run-ovn-kubernetes\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/caade84e-fbd3-4062-a14b-57dbe3741d9b-iptables-alerter-script\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-run-ovn-kubernetes\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-host\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-var-lib-kubelet\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-run-netns\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-ovnkube-config\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781776 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-var-lib-kubelet\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-registration-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.781850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781831 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-run-netns\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-registration-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhpsx\" (UniqueName: \"kubernetes.io/projected/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-kube-api-access-dhpsx\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-etc-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-log-socket\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-cni-netd\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-etc-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.781984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-cnibin\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-log-socket\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-socket-dir-parent\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782018 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-cni-netd\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-cni-bin\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjvp\" (UniqueName: \"kubernetes.io/projected/caade84e-fbd3-4062-a14b-57dbe3741d9b-kube-api-access-4cjvp\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-lib-modules\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjcbv\" (UniqueName: \"kubernetes.io/projected/9472070e-5549-43ba-8589-1867ce57f589-kube-api-access-qjcbv\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-ovnkube-script-lib\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.782605 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-hosts-file\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-lib-modules\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52ce502c-4e66-4b68-b86c-ccc945149575-dbus\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-kubelet\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782395 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-ovnkube-config\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-node-log\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782467 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-kubelet\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btv8d\" (UniqueName: \"kubernetes.io/projected/faf34934-2893-429c-a49e-46b2b67fd61f-kube-api-access-btv8d\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782510 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-node-log\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-hostroot\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-conf-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-etc-kubernetes\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-cnibin\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52ce502c-4e66-4b68-b86c-ccc945149575-kubelet-config\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-slash\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-systemd\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-ovn\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.783428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-ovnkube-script-lib\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-env-overrides\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782714 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-slash\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff97aea9-d48d-49a2-8baa-68b423b94cb9-konnectivity-ca\") pod \"konnectivity-agent-s57p9\" (UID: \"ff97aea9-d48d-49a2-8baa-68b423b94cb9\") " pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9472070e-5549-43ba-8589-1867ce57f589-etc-tuned\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782808 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-systemd\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-run-ovn\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysconfig\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9472070e-5549-43ba-8589-1867ce57f589-tmp\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysconfig\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.782980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-systemd-units\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-socket-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-device-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79ddp\" (UniqueName: \"kubernetes.io/projected/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-kube-api-access-79ddp\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.784261 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783078 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-systemd-units\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-system-cni-dir\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysctl-d\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-device-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysctl-conf\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-var-lib-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faf34934-2893-429c-a49e-46b2b67fd61f-ovn-node-metrics-cert\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-daemon-config\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-modprobe-d\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783521 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-modprobe-d\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-systemd\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-system-cni-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysctl-conf\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-cni-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-multus-certs\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-var-lib-openvswitch\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785067 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-sysctl-d\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-sys-fs\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd69l\" (UniqueName: \"kubernetes.io/projected/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-kube-api-access-wd69l\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-kubelet\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783789 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-etc-systemd\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-etc-selinux\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glgjg\" (UniqueName: \"kubernetes.io/projected/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-kube-api-access-glgjg\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/caade84e-fbd3-4062-a14b-57dbe3741d9b-host-slash\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783868 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-sys-fs\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-sys\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9472070e-5549-43ba-8589-1867ce57f589-sys\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-cni-bin\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.783981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-cni-bin\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.785943 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-cni-binary-copy\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-k8s-cni-cncf-io\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-cni-multus\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nx2j\" (UniqueName: \"kubernetes.io/projected/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-kube-api-access-2nx2j\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784322 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf34934-2893-429c-a49e-46b2b67fd61f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faf34934-2893-429c-a49e-46b2b67fd61f-env-overrides\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-socket-dir\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.784668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff97aea9-d48d-49a2-8baa-68b423b94cb9-konnectivity-ca\") pod \"konnectivity-agent-s57p9\" (UID: \"ff97aea9-d48d-49a2-8baa-68b423b94cb9\") " pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.785696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9472070e-5549-43ba-8589-1867ce57f589-etc-tuned\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.785791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff97aea9-d48d-49a2-8baa-68b423b94cb9-agent-certs\") pod \"konnectivity-agent-s57p9\" (UID: \"ff97aea9-d48d-49a2-8baa-68b423b94cb9\") " pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:41.786859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.786758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9472070e-5549-43ba-8589-1867ce57f589-tmp\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.787334 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.786959 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faf34934-2893-429c-a49e-46b2b67fd61f-ovn-node-metrics-cert\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.791675 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.791649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79ddp\" (UniqueName: \"kubernetes.io/projected/37cdcf71-95f7-4d9b-bbf2-45a5fbeef843-kube-api-access-79ddp\") pod \"aws-ebs-csi-driver-node-bh6ql\" (UID: \"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:41.791914 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.791895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjcbv\" (UniqueName: \"kubernetes.io/projected/9472070e-5549-43ba-8589-1867ce57f589-kube-api-access-qjcbv\") pod \"tuned-x56qj\" (UID: \"9472070e-5549-43ba-8589-1867ce57f589\") " pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:41.792124 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.792105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btv8d\" (UniqueName: \"kubernetes.io/projected/faf34934-2893-429c-a49e-46b2b67fd61f-kube-api-access-btv8d\") pod \"ovnkube-node-8k7l8\" (UID: \"faf34934-2893-429c-a49e-46b2b67fd61f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.885355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd69l\" (UniqueName: \"kubernetes.io/projected/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-kube-api-access-wd69l\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.885355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-kubelet\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glgjg\" (UniqueName: \"kubernetes.io/projected/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-kube-api-access-glgjg\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/caade84e-fbd3-4062-a14b-57dbe3741d9b-host-slash\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-cni-binary-copy\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-k8s-cni-cncf-io\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-kubelet\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-cni-multus\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nx2j\" (UniqueName: \"kubernetes.io/projected/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-kube-api-access-2nx2j\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/caade84e-fbd3-4062-a14b-57dbe3741d9b-host-slash\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.885539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-tmp-dir\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-cni-multus\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-k8s-cni-cncf-io\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-netns\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzbjj\" (UniqueName: \"kubernetes.io/projected/980357a5-0ec8-4679-b29e-1edd5f55d693-kube-api-access-jzbjj\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-host\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-serviceca\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-netns\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-tmp-dir\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-host\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/caade84e-fbd3-4062-a14b-57dbe3741d9b-iptables-alerter-script\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpsx\" (UniqueName: \"kubernetes.io/projected/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-kube-api-access-dhpsx\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-cnibin\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-socket-dir-parent\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.885968 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-cni-bin\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.885988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjvp\" (UniqueName: \"kubernetes.io/projected/caade84e-fbd3-4062-a14b-57dbe3741d9b-kube-api-access-4cjvp\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886011 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-cni-binary-copy\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886080 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-cnibin\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886083 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-var-lib-cni-bin\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-hosts-file\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886149 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-socket-dir-parent\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52ce502c-4e66-4b68-b86c-ccc945149575-dbus\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886220 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-hosts-file\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-hostroot\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-conf-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52ce502c-4e66-4b68-b86c-ccc945149575-dbus\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-hostroot\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-etc-kubernetes\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-conf-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886343 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-etc-kubernetes\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.886679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-cnibin\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886388 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/caade84e-fbd3-4062-a14b-57dbe3741d9b-iptables-alerter-script\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52ce502c-4e66-4b68-b86c-ccc945149575-kubelet-config\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-cnibin\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52ce502c-4e66-4b68-b86c-ccc945149575-kubelet-config\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-system-cni-dir\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-daemon-config\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-system-cni-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-cni-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-system-cni-dir\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886619 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/980357a5-0ec8-4679-b29e-1edd5f55d693-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.886635 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-system-cni-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-multus-certs\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-host-run-multus-certs\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886726 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-cni-dir\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.886736 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:42.386695685 +0000 UTC m=+2.058336708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.886882 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.886929 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:42.386915994 +0000 UTC m=+2.058557031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.886994 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-serviceca\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.887085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-multus-daemon-config\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.887872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.887301 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/980357a5-0ec8-4679-b29e-1edd5f55d693-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.893507 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.893484 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glgjg\" (UniqueName: \"kubernetes.io/projected/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-kube-api-access-glgjg\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:41.893594 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.893566 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd69l\" (UniqueName: \"kubernetes.io/projected/7dc4e86c-c220-464e-b3ea-8ef77e6cafb0-kube-api-access-wd69l\") pod \"node-resolver-qtkvt\" (UID: \"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0\") " pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:41.895022 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.895004 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:41.895022 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.895021 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:41.895201 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.895032 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:41.895201 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:41.895096 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:42.395085075 +0000 UTC m=+2.066726109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:41.896242 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.896223 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhpsx\" (UniqueName: \"kubernetes.io/projected/2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d-kube-api-access-dhpsx\") pod \"multus-dwkjm\" (UID: \"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d\") " pod="openshift-multus/multus-dwkjm" Sep 10 02:33:41.896453 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.896430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nx2j\" (UniqueName: \"kubernetes.io/projected/15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc-kube-api-access-2nx2j\") pod \"node-ca-mxhzh\" (UID: \"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc\") " pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:41.896726 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.896706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjvp\" (UniqueName: \"kubernetes.io/projected/caade84e-fbd3-4062-a14b-57dbe3741d9b-kube-api-access-4cjvp\") pod \"iptables-alerter-9vhtr\" (UID: \"caade84e-fbd3-4062-a14b-57dbe3741d9b\") " pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:41.897259 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.897241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzbjj\" (UniqueName: \"kubernetes.io/projected/980357a5-0ec8-4679-b29e-1edd5f55d693-kube-api-access-jzbjj\") pod \"multus-additional-cni-plugins-6fbjg\" (UID: \"980357a5-0ec8-4679-b29e-1edd5f55d693\") " pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:41.900004 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:41.899978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b68b5fb7a6a498e11068b301da6d7d.slice/crio-2ea7f795475fd6160a09ad407e8a11b4aff0ca5f2e0889184f8cc99fb0e774f8 WatchSource:0}: Error finding container 2ea7f795475fd6160a09ad407e8a11b4aff0ca5f2e0889184f8cc99fb0e774f8: Status 404 returned error can't find the container with id 2ea7f795475fd6160a09ad407e8a11b4aff0ca5f2e0889184f8cc99fb0e774f8 Sep 10 02:33:41.900234 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:41.900217 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277c30dbbf575dc44122b1220e5c2c65.slice/crio-b961f899f760a6a241299b4dcb88b1b9dd5b35af5ea5174a0725e98237472c7a WatchSource:0}: Error finding container b961f899f760a6a241299b4dcb88b1b9dd5b35af5ea5174a0725e98237472c7a: Status 404 returned error can't find the container with id b961f899f760a6a241299b4dcb88b1b9dd5b35af5ea5174a0725e98237472c7a Sep 10 02:33:41.906072 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.906058 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:33:41.989430 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:41.989381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:33:41.996965 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:41.996946 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf34934_2893_429c_a49e_46b2b67fd61f.slice/crio-30be67907c0a320780f45b9e401d59a475d4b64cdc9c41b20fc5c2ff37ba34b6 WatchSource:0}: Error finding container 30be67907c0a320780f45b9e401d59a475d4b64cdc9c41b20fc5c2ff37ba34b6: Status 404 returned error can't find the container with id 30be67907c0a320780f45b9e401d59a475d4b64cdc9c41b20fc5c2ff37ba34b6 Sep 10 02:33:42.009613 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.009598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:33:42.016244 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.016094 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff97aea9_d48d_49a2_8baa_68b423b94cb9.slice/crio-b2d2dc788842232be76809c08ad9c18b421bf2a5ce18ca7ec8504a49fcc60ed4 WatchSource:0}: Error finding container b2d2dc788842232be76809c08ad9c18b421bf2a5ce18ca7ec8504a49fcc60ed4: Status 404 returned error can't find the container with id b2d2dc788842232be76809c08ad9c18b421bf2a5ce18ca7ec8504a49fcc60ed4 Sep 10 02:33:42.020025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.020008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" Sep 10 02:33:42.027429 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.027409 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cdcf71_95f7_4d9b_bbf2_45a5fbeef843.slice/crio-2bdf33106cc846d8fbd768726404e1c1fa660b96883e084a22312fe164ad307e WatchSource:0}: Error finding container 2bdf33106cc846d8fbd768726404e1c1fa660b96883e084a22312fe164ad307e: Status 404 returned error can't find the container with id 2bdf33106cc846d8fbd768726404e1c1fa660b96883e084a22312fe164ad307e Sep 10 02:33:42.050650 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.050628 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x56qj" Sep 10 02:33:42.057650 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.057632 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9472070e_5549_43ba_8589_1867ce57f589.slice/crio-409d4ea6acc801fbf9dca594ef09f0c43a102edd8a5d57326b7e3e8cab864bff WatchSource:0}: Error finding container 409d4ea6acc801fbf9dca594ef09f0c43a102edd8a5d57326b7e3e8cab864bff: Status 404 returned error can't find the container with id 409d4ea6acc801fbf9dca594ef09f0c43a102edd8a5d57326b7e3e8cab864bff Sep 10 02:33:42.067925 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.067905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mxhzh" Sep 10 02:33:42.074937 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.074919 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15511c0e_419d_46b9_a7b2_ef8e2eb5a9bc.slice/crio-a2755efb88e4e60d18e5974df1a284a84942486b8443785ffba31dc453719d2e WatchSource:0}: Error finding container a2755efb88e4e60d18e5974df1a284a84942486b8443785ffba31dc453719d2e: Status 404 returned error can't find the container with id a2755efb88e4e60d18e5974df1a284a84942486b8443785ffba31dc453719d2e Sep 10 02:33:42.081341 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.081318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" Sep 10 02:33:42.089460 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.089436 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980357a5_0ec8_4679_b29e_1edd5f55d693.slice/crio-3168caf5ae9213366648825a1df77b687bb401438d45c3f1cf26dd8234c0cc34 WatchSource:0}: Error finding container 3168caf5ae9213366648825a1df77b687bb401438d45c3f1cf26dd8234c0cc34: Status 404 returned error can't find the container with id 3168caf5ae9213366648825a1df77b687bb401438d45c3f1cf26dd8234c0cc34 Sep 10 02:33:42.109449 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.109429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vhtr" Sep 10 02:33:42.116195 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.116165 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaade84e_fbd3_4062_a14b_57dbe3741d9b.slice/crio-05621b8d46de9bb251c69de14037164a1da7db8985eb82dc36eb1fa4d3a056d8 WatchSource:0}: Error finding container 05621b8d46de9bb251c69de14037164a1da7db8985eb82dc36eb1fa4d3a056d8: Status 404 returned error can't find the container with id 05621b8d46de9bb251c69de14037164a1da7db8985eb82dc36eb1fa4d3a056d8 Sep 10 02:33:42.128865 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.128846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qtkvt" Sep 10 02:33:42.132933 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.132912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dwkjm" Sep 10 02:33:42.137228 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.136115 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc4e86c_c220_464e_b3ea_8ef77e6cafb0.slice/crio-6e0c9bb49c67483e14516fdc95467472877e8d353fde800d99ca23af55e1706a WatchSource:0}: Error finding container 6e0c9bb49c67483e14516fdc95467472877e8d353fde800d99ca23af55e1706a: Status 404 returned error can't find the container with id 6e0c9bb49c67483e14516fdc95467472877e8d353fde800d99ca23af55e1706a Sep 10 02:33:42.142723 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:33:42.142706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdf42c9_b5bd_42d3_aa5d_50dbdf54a85d.slice/crio-cdf30fb12c446c388f3b41e1415720559291d5ba1477ab3e0ab0932ae3cef961 WatchSource:0}: Error finding container cdf30fb12c446c388f3b41e1415720559291d5ba1477ab3e0ab0932ae3cef961: Status 404 returned error can't find the container with id cdf30fb12c446c388f3b41e1415720559291d5ba1477ab3e0ab0932ae3cef961 Sep 10 02:33:42.252249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.252198 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:42.390439 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.390418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:42.390570 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.390462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:42.390640 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.390570 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:42.390640 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.390597 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:42.390640 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.390624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:43.390609065 +0000 UTC m=+3.062250091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:42.390757 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.390647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:43.390630376 +0000 UTC m=+3.062271415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:42.491262 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.491228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:42.491396 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.491382 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:42.491442 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.491410 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:42.491442 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.491422 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:42.491510 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:42.491471 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:43.491456276 +0000 UTC m=+3.163097315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:42.507672 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.507617 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:42.635735 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.635527 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:42.721336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.721176 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:28:42 +0000 UTC" deadline="2028-06-19 07:49:53.345561316 +0000 UTC" Sep 10 02:33:42.721336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.721277 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15557h16m10.624290261s" Sep 10 02:33:42.849192 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.849087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"30be67907c0a320780f45b9e401d59a475d4b64cdc9c41b20fc5c2ff37ba34b6"} Sep 10 02:33:42.860354 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.860040 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerStarted","Data":"3168caf5ae9213366648825a1df77b687bb401438d45c3f1cf26dd8234c0cc34"} Sep 10 02:33:42.873514 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.873484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x56qj" event={"ID":"9472070e-5549-43ba-8589-1867ce57f589","Type":"ContainerStarted","Data":"409d4ea6acc801fbf9dca594ef09f0c43a102edd8a5d57326b7e3e8cab864bff"} Sep 10 02:33:42.897771 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.897742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"65b68b5fb7a6a498e11068b301da6d7d","Type":"ContainerStarted","Data":"2ea7f795475fd6160a09ad407e8a11b4aff0ca5f2e0889184f8cc99fb0e774f8"} Sep 10 02:33:42.922090 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.922001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" event={"ID":"277c30dbbf575dc44122b1220e5c2c65","Type":"ContainerStarted","Data":"b961f899f760a6a241299b4dcb88b1b9dd5b35af5ea5174a0725e98237472c7a"} Sep 10 02:33:42.951059 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.951030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dwkjm" event={"ID":"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d","Type":"ContainerStarted","Data":"cdf30fb12c446c388f3b41e1415720559291d5ba1477ab3e0ab0932ae3cef961"} Sep 10 02:33:42.959446 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.959392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qtkvt" event={"ID":"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0","Type":"ContainerStarted","Data":"6e0c9bb49c67483e14516fdc95467472877e8d353fde800d99ca23af55e1706a"} Sep 10 02:33:42.968470 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.968441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vhtr" event={"ID":"caade84e-fbd3-4062-a14b-57dbe3741d9b","Type":"ContainerStarted","Data":"05621b8d46de9bb251c69de14037164a1da7db8985eb82dc36eb1fa4d3a056d8"} Sep 10 02:33:42.981898 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.981821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mxhzh" event={"ID":"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc","Type":"ContainerStarted","Data":"a2755efb88e4e60d18e5974df1a284a84942486b8443785ffba31dc453719d2e"} Sep 10 02:33:42.999186 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:42.999095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" event={"ID":"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843","Type":"ContainerStarted","Data":"2bdf33106cc846d8fbd768726404e1c1fa660b96883e084a22312fe164ad307e"} Sep 10 02:33:43.009032 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.008961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s57p9" event={"ID":"ff97aea9-d48d-49a2-8baa-68b423b94cb9","Type":"ContainerStarted","Data":"b2d2dc788842232be76809c08ad9c18b421bf2a5ce18ca7ec8504a49fcc60ed4"} Sep 10 02:33:43.398456 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.398406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:43.398644 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.398461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:43.398644 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.398591 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:43.398767 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.398650 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:45.398631183 +0000 UTC m=+5.070272222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:43.399089 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.399068 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:43.399196 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.399124 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:45.399108208 +0000 UTC m=+5.070749247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:43.499582 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.499545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:43.499750 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.499706 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:43.499750 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.499727 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:43.499750 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.499740 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:43.499917 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.499793 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:45.499776389 +0000 UTC m=+5.171417415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:43.721876 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.721750 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:28:42 +0000 UTC" deadline="2028-04-05 01:59:24.069102975 +0000 UTC" Sep 10 02:33:43.721876 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.721790 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13751h25m40.347318402s" Sep 10 02:33:43.812131 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.812098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:43.812386 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.812256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:43.812740 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.812718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:43.812872 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.812848 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:43.812952 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.812930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:43.813057 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:43.813007 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:43.929441 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:43.928992 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:45.414342 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:45.414294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:45.414947 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:45.414358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:45.414947 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.414459 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:45.414947 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.414521 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:45.414947 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.414539 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:49.414517476 +0000 UTC m=+9.086158525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:45.414947 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.414575 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:49.414558393 +0000 UTC m=+9.086199423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:45.515081 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:45.515042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:45.515327 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.515283 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:45.515327 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.515313 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:45.515327 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.515326 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:45.515543 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.515385 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:49.515364882 +0000 UTC m=+9.187005908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:45.812335 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:45.811667 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:45.812335 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.811817 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:45.812335 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:45.812209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:45.812629 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.812350 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:45.812629 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:45.812395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:45.812629 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:45.812467 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:47.812325 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:47.812290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:47.812837 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:47.812432 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:47.812837 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:47.812602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:47.812837 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:47.812718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:47.812837 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:47.812785 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:47.813070 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:47.812858 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:49.457350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:49.457309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:49.457728 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:49.457367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:49.457728 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.457501 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:49.457728 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.457549 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:57.457535218 +0000 UTC m=+17.129176240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:49.457853 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.457816 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:49.457853 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.457845 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:57.457835616 +0000 UTC m=+17.129476637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:49.557985 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:49.557896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:49.558136 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.558074 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:49.558136 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.558094 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:49.558136 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.558107 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:49.558317 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.558161 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:57.558143079 +0000 UTC m=+17.229784116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:49.812705 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:49.812213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:49.812705 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:49.812259 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:49.812705 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.812339 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:49.812705 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.812393 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:49.812705 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:49.812435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:49.812705 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:49.812488 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:51.811701 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:51.811662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:51.812264 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:51.811784 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:51.812264 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:51.812227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:51.812352 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:51.812314 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:51.812384 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:51.812369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:51.812443 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:51.812429 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:53.811704 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:53.811668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:53.812170 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:53.811712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:53.812170 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:53.811713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:53.812170 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:53.811786 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:53.812170 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:53.811886 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:53.812170 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:53.811971 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:55.812199 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:55.812162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:55.812626 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:55.812288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:55.812626 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:55.812300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:55.812626 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:55.812294 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:55.812626 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:55.812416 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:55.812626 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:55.812499 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:57.518905 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:57.518870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:57.519442 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:57.518919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:57.519442 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.519026 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:57.519442 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.519026 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:57.519442 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.519084 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:13.519068165 +0000 UTC m=+33.190709203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:57.519442 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.519101 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:13.519092688 +0000 UTC m=+33.190733709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:57.619962 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:57.619919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:57.620131 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.620112 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:57.620178 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.620139 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:57.620178 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.620153 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:57.620328 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.620228 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:34:13.620209443 +0000 UTC m=+33.291850471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:57.811886 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:57.811809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:57.811886 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:57.811841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:57.812069 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.811936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:57.812069 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:57.811977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:57.812166 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.812074 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:33:57.812166 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:57.812147 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:59.812223 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:59.812172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:33:59.812665 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:59.812230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:33:59.812665 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:33:59.812297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:33:59.812665 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:59.812317 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:33:59.812665 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:59.812386 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:33:59.812665 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:33:59.812468 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:01.812381 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:01.812352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:01.812381 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:01.812382 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:01.812824 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:01.812466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:01.812824 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:01.812469 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:01.812824 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:01.812589 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:01.812824 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:01.812673 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:03.083685 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.083360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x56qj" event={"ID":"9472070e-5549-43ba-8589-1867ce57f589","Type":"ContainerStarted","Data":"5e414ed6bdcd6a1cd54b80c292a143ba33fd840e8e53cdec91fba7ad8e2424f3"} Sep 10 02:34:03.085010 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.084987 2576 generic.go:356] "Generic (PLEG): container finished" podID="65b68b5fb7a6a498e11068b301da6d7d" containerID="fdd5a045df8bdb4bf9533d31261af345beea1b6b9ae752a4ea6fa3b3c5da4329" exitCode=0 Sep 10 02:34:03.085110 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.085066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"65b68b5fb7a6a498e11068b301da6d7d","Type":"ContainerDied","Data":"fdd5a045df8bdb4bf9533d31261af345beea1b6b9ae752a4ea6fa3b3c5da4329"} Sep 10 02:34:03.086674 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.086652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" event={"ID":"277c30dbbf575dc44122b1220e5c2c65","Type":"ContainerStarted","Data":"901125dec875247f142e2d6f6e62effd06039d7cf9cedac9ac1bad35275bad0c"} Sep 10 02:34:03.088252 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.088233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dwkjm" event={"ID":"2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d","Type":"ContainerStarted","Data":"de10500c1db0e570bda5ec8de3fc1b2519ea98eb1eb481f700fc8fe0618bc73b"} Sep 10 02:34:03.089600 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.089579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qtkvt" event={"ID":"7dc4e86c-c220-464e-b3ea-8ef77e6cafb0","Type":"ContainerStarted","Data":"e584b6d3cfa4e2c4f1d3f110dc8ceadad36d247cfcce527dfa8c7eac65dd1ae9"} Sep 10 02:34:03.090996 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.090966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mxhzh" event={"ID":"15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc","Type":"ContainerStarted","Data":"f9d01925cc89a5b5d193321d57924ad8136bf9e79e1be5ceeaea35fe8b7f4110"} Sep 10 02:34:03.092482 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.092465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" event={"ID":"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843","Type":"ContainerStarted","Data":"0287c26503d4ad9bbcb1860563cc8c23fc03290573c9121e3cbdea000732fe3e"} Sep 10 02:34:03.093744 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.093725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s57p9" event={"ID":"ff97aea9-d48d-49a2-8baa-68b423b94cb9","Type":"ContainerStarted","Data":"9e5ef79e8e6df8cf51af6024ab14c052607de953378ec721bd422329027ddb0e"} Sep 10 02:34:03.096355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096339 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:34:03.096688 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096671 2576 generic.go:356] "Generic (PLEG): container finished" podID="faf34934-2893-429c-a49e-46b2b67fd61f" containerID="f00d0325df932bfcf915001d76b412abdf1657ee74bfc4002ded47c70079a5a2" exitCode=1 Sep 10 02:34:03.096748 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"79488d17bc4e9bc8245130cc67ae5a45deaade2447ddde865de55882ef60a069"} Sep 10 02:34:03.096810 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"6ddfa03143843260c4091a296ec5c7b6589ad60ab3e067923ad7437fb65a3de1"} Sep 10 02:34:03.096868 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"87a93c832ab166caa077a15a12ee5fdef4eda039c7a200e3acf207c4494023fc"} Sep 10 02:34:03.096922 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"16f94a69e788162a888faaaff0a63862a81517c070a26c5788485da232bf87f5"} Sep 10 02:34:03.096973 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.096961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerDied","Data":"f00d0325df932bfcf915001d76b412abdf1657ee74bfc4002ded47c70079a5a2"} Sep 10 02:34:03.097017 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.097006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"c664af90555d9bc850b4650e3895d7449aa32d52b2ed5f40c0f6524f530298cd"} Sep 10 02:34:03.098177 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.098159 2576 generic.go:356] "Generic (PLEG): container finished" podID="980357a5-0ec8-4679-b29e-1edd5f55d693" containerID="bfb25b6d201c9abe078abac815ba12e030100a26b0b7d10eadbb700495f349ab" exitCode=0 Sep 10 02:34:03.098266 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.098203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerDied","Data":"bfb25b6d201c9abe078abac815ba12e030100a26b0b7d10eadbb700495f349ab"} Sep 10 02:34:03.098838 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.098746 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x56qj" podStartSLOduration=2.20145654 podStartE2EDuration="22.098735927s" totalImagesPullingTime="19.897279387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:03.098626457 +0000 UTC m=+22.770267504" watchObservedRunningTime="2026-09-10 02:34:03.098735927 +0000 UTC m=+22.770377008" Sep 10 02:34:03.111746 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.111709 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qtkvt" podStartSLOduration=2.343707888 podStartE2EDuration="22.111697405s" totalImagesPullingTime="19.767989517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:03.111518858 +0000 UTC m=+22.783159892" watchObservedRunningTime="2026-09-10 02:34:03.111697405 +0000 UTC m=+22.783338448" Sep 10 02:34:03.126986 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.126935 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dwkjm" podStartSLOduration=1.846487447 podStartE2EDuration="22.126923487s" totalImagesPullingTime="20.28043604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:03.126611676 +0000 UTC m=+22.798252719" watchObservedRunningTime="2026-09-10 02:34:03.126923487 +0000 UTC m=+22.798564530" Sep 10 02:34:03.168210 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.168153 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" podStartSLOduration=21.168140936 podStartE2EDuration="21.168140936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:03.154267707 +0000 UTC m=+22.825908762" watchObservedRunningTime="2026-09-10 02:34:03.168140936 +0000 UTC m=+22.839781980" Sep 10 02:34:03.168332 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.168236 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s57p9" podStartSLOduration=2.277746666 podStartE2EDuration="22.168229324s" totalImagesPullingTime="19.890482658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:03.167884082 +0000 UTC m=+22.839525128" watchObservedRunningTime="2026-09-10 02:34:03.168229324 +0000 UTC m=+22.839870369" Sep 10 02:34:03.180873 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.180843 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mxhzh" podStartSLOduration=2.349774206 podStartE2EDuration="22.180831503s" totalImagesPullingTime="19.831057297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:03.180528611 +0000 UTC m=+22.852169646" watchObservedRunningTime="2026-09-10 02:34:03.180831503 +0000 UTC m=+22.852472578" Sep 10 02:34:03.812243 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.812213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:03.812447 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.812304 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:03.812447 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:03.812311 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:03.812447 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.812336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:03.812447 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:03.812419 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:03.812658 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:03.812475 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:03.915333 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.915307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:34:03.915965 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:03.915945 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:34:04.101455 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.101428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vhtr" event={"ID":"caade84e-fbd3-4062-a14b-57dbe3741d9b","Type":"ContainerStarted","Data":"db079f4f5086313f34a98f978e5681988b7bbf17e1b7d8d2aacfc797c99590f4"} Sep 10 02:34:04.103345 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.103313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"65b68b5fb7a6a498e11068b301da6d7d","Type":"ContainerStarted","Data":"a0bd959e4da8c7d3805b5c13608c8b6d13f03cb6c13cb7c1be44aa48ed26b344"} Sep 10 02:34:04.103756 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.103730 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:34:04.104245 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.104229 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s57p9" Sep 10 02:34:04.115826 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.115777 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9vhtr" podStartSLOduration=3.269640308 podStartE2EDuration="23.115762101s" totalImagesPullingTime="19.846121793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:04.115466443 +0000 UTC m=+23.787107486" watchObservedRunningTime="2026-09-10 02:34:04.115762101 +0000 UTC m=+23.787403146" Sep 10 02:34:04.129948 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.129909 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" podStartSLOduration=22.129893141 podStartE2EDuration="22.129893141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:04.129479788 +0000 UTC m=+23.801120834" watchObservedRunningTime="2026-09-10 02:34:04.129893141 +0000 UTC m=+23.801534186" Sep 10 02:34:04.166209 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.166168 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 02:34:04.738324 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.738051 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T02:34:04.166206105Z","UUID":"8161458f-ce75-4469-bc6f-cf95957c082c","Handler":null,"Name":"","Endpoint":""} Sep 10 02:34:04.739619 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.739602 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 02:34:04.739724 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:04.739630 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 02:34:05.108097 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:05.108001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" event={"ID":"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843","Type":"ContainerStarted","Data":"8c19e61b3ad700d8dc43f38889090bc952fee557493c7705b96856171906c05e"} Sep 10 02:34:05.111594 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:05.111562 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:34:05.112055 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:05.112026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"1b44a8cd2ce91f4e40a0e985b04a110da95c673e116bde8d66170166a9fa5960"} Sep 10 02:34:05.812239 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:05.812145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:05.812239 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:05.812169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:05.812239 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:05.812202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:05.812521 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:05.812297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:05.812521 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:05.812419 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:05.812521 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:05.812483 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:06.116725 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:06.116647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" event={"ID":"37cdcf71-95f7-4d9b-bbf2-45a5fbeef843","Type":"ContainerStarted","Data":"cd9a47006d67351fe40b36549a2fe6f593551e2d0c8d133f79eb48bd87873e62"} Sep 10 02:34:06.132917 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:06.132876 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bh6ql" podStartSLOduration=2.511666666 podStartE2EDuration="25.13286239s" totalImagesPullingTime="22.621195724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:06.131566983 +0000 UTC m=+25.803208037" watchObservedRunningTime="2026-09-10 02:34:06.13286239 +0000 UTC m=+25.804503433" Sep 10 02:34:07.811839 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:07.811814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:07.812116 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:07.811819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:07.812116 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:07.811944 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:07.812116 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:07.811983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:07.812116 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:07.811819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:07.812295 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:07.812168 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:08.124389 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:08.124260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:34:08.124797 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:08.124769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"308170ff1b1b024465e071cd58a3de7b696eaa34ca7de4c86d9f368e3ae0295f"} Sep 10 02:34:08.125055 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:08.125018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:34:08.125219 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:08.125177 2576 scope.go:117] "RemoveContainer" containerID="f00d0325df932bfcf915001d76b412abdf1657ee74bfc4002ded47c70079a5a2" Sep 10 02:34:08.126980 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:08.126956 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerStarted","Data":"b1a330379c99622809ed0919e807a4212f50a26c125140d887c1daf87d91a091"} Sep 10 02:34:08.140686 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:08.140603 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:34:09.133500 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.133431 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:34:09.133998 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.133816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" event={"ID":"faf34934-2893-429c-a49e-46b2b67fd61f","Type":"ContainerStarted","Data":"56f90bad3770558304acb230d1631d62eee1b18c7a23b3269a5847fb3af3a955"} Sep 10 02:34:09.134058 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.134041 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:34:09.134242 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.134220 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:34:09.138810 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.138781 2576 generic.go:356] "Generic (PLEG): container finished" podID="980357a5-0ec8-4679-b29e-1edd5f55d693" containerID="b1a330379c99622809ed0919e807a4212f50a26c125140d887c1daf87d91a091" exitCode=0 Sep 10 02:34:09.138932 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.138828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerDied","Data":"b1a330379c99622809ed0919e807a4212f50a26c125140d887c1daf87d91a091"} Sep 10 02:34:09.150470 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.150452 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:34:09.159294 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.159254 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" podStartSLOduration=8.189777119 podStartE2EDuration="28.159240264s" totalImagesPullingTime="19.969463145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:09.158074936 +0000 UTC m=+28.829715980" watchObservedRunningTime="2026-09-10 02:34:09.159240264 +0000 UTC m=+28.830881308" Sep 10 02:34:09.672033 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.671999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdg75"] Sep 10 02:34:09.672210 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.672176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:09.672324 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:09.672305 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:09.675346 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.675315 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5bxb6"] Sep 10 02:34:09.675458 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.675427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:09.675558 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:09.675531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:09.676058 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.676035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ftmw"] Sep 10 02:34:09.676281 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:09.676154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:09.676281 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:09.676271 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:10.812670 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:10.812589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:10.813209 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:10.812701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:10.813209 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:10.812795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:10.813209 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:10.812878 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:11.145488 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:11.145275 2576 generic.go:356] "Generic (PLEG): container finished" podID="980357a5-0ec8-4679-b29e-1edd5f55d693" containerID="3edb0cd597cd51fe2f4de271d960cc098caca1e7eab96db1fceafb861bfb1425" exitCode=0 Sep 10 02:34:11.145488 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:11.145358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerDied","Data":"3edb0cd597cd51fe2f4de271d960cc098caca1e7eab96db1fceafb861bfb1425"} Sep 10 02:34:11.696343 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:11.696274 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qtkvt_7dc4e86c-c220-464e-b3ea-8ef77e6cafb0/dns-node-resolver/0.log" Sep 10 02:34:11.811813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:11.811417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:11.811813 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:11.811530 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:12.150018 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:12.149948 2576 generic.go:356] "Generic (PLEG): container finished" podID="980357a5-0ec8-4679-b29e-1edd5f55d693" containerID="5e8eee8c9988da6988e74f0800625aad4b607cb25df7d54ac5c0898a1a8be52b" exitCode=0 Sep 10 02:34:12.150018 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:12.149990 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerDied","Data":"5e8eee8c9988da6988e74f0800625aad4b607cb25df7d54ac5c0898a1a8be52b"} Sep 10 02:34:12.484423 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:12.484344 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mxhzh_15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc/node-ca/0.log" Sep 10 02:34:12.811842 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:12.811818 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:12.812012 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:12.811945 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:12.812372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:12.811823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:12.812372 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:12.812334 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:13.541698 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:13.541661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:13.542071 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:13.541714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:13.542071 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.541752 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:13.542071 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.541803 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:13.542071 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.541818 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs podName:8c806bf8-3f7e-44f9-bfb0-e8df626d9c68 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:45.541798779 +0000 UTC m=+65.213439826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs") pod "network-metrics-daemon-6ftmw" (UID: "8c806bf8-3f7e-44f9-bfb0-e8df626d9c68") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:13.542071 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.541835 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret podName:52ce502c-4e66-4b68-b86c-ccc945149575 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:45.541825057 +0000 UTC m=+65.213466093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret") pod "global-pull-secret-syncer-qdg75" (UID: "52ce502c-4e66-4b68-b86c-ccc945149575") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:13.642847 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:13.642801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:13.643005 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.642951 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:34:13.643005 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.642971 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:34:13.643005 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.642984 2576 projected.go:196] Error preparing data for projected volume kube-api-access-k55wv for pod openshift-network-diagnostics/network-check-target-5bxb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:13.643142 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.643044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv podName:4902ac1d-34c6-40eb-a1e1-7a580c44cd5e nodeName:}" failed. No retries permitted until 2026-09-10 02:34:45.643025468 +0000 UTC m=+65.314666496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k55wv" (UniqueName: "kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv") pod "network-check-target-5bxb6" (UID: "4902ac1d-34c6-40eb-a1e1-7a580c44cd5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:13.811870 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:13.811842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:13.812123 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:13.811965 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:14.816485 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:14.816456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:14.816485 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:14.816474 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:14.816982 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:14.816563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:14.816982 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:14.816684 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:15.812468 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:15.812437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:15.812675 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:15.812564 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:16.812025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:16.811990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:16.812025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:16.812028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:16.812447 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:16.812106 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:16.812447 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:16.812166 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:17.811627 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:17.811590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:17.811776 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:17.811687 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:18.167157 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:18.167069 2576 generic.go:356] "Generic (PLEG): container finished" podID="980357a5-0ec8-4679-b29e-1edd5f55d693" containerID="d57d9cbde0276391430a20ffa7a8056d3496e6093b36637fcffef6e0e3d8db68" exitCode=0 Sep 10 02:34:18.167157 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:18.167110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerDied","Data":"d57d9cbde0276391430a20ffa7a8056d3496e6093b36637fcffef6e0e3d8db68"} Sep 10 02:34:18.814611 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:18.814466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:18.814746 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:18.814519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:18.814746 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:18.814685 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:18.814819 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:18.814740 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:19.172442 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:19.172365 2576 generic.go:356] "Generic (PLEG): container finished" podID="980357a5-0ec8-4679-b29e-1edd5f55d693" containerID="0498210225ce037e027f72051d0f38602ebffa6b650655a0a7cc38b01ed0a865" exitCode=0 Sep 10 02:34:19.172442 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:19.172413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerDied","Data":"0498210225ce037e027f72051d0f38602ebffa6b650655a0a7cc38b01ed0a865"} Sep 10 02:34:19.811619 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:19.811590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:19.811763 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:19.811701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:20.178197 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:20.178108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" event={"ID":"980357a5-0ec8-4679-b29e-1edd5f55d693","Type":"ContainerStarted","Data":"04a68dd9c2ee7a2848776438b2234f0eed6d52facdc2d934b2ff34ffcba5e297"} Sep 10 02:34:20.199014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:20.198966 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6fbjg" podStartSLOduration=7.645282031 podStartE2EDuration="39.198947197s" totalImagesPullingTime="31.553665166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:20.19866559 +0000 UTC m=+39.870306633" watchObservedRunningTime="2026-09-10 02:34:20.198947197 +0000 UTC m=+39.870588241" Sep 10 02:34:20.812415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:20.812385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:20.812595 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:20.812466 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:20.812595 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:20.812564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:20.812719 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:20.812680 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:21.812373 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:21.812349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:21.812718 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:21.812437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:22.812272 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:22.812245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:22.812438 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:22.812245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:22.812438 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:22.812342 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:22.812438 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:22.812414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:23.811601 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:23.811574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:23.811767 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:23.811678 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:24.812098 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:24.812054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:24.812098 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:24.812054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:24.812630 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:24.812213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:24.812630 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:24.812274 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:25.811637 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:25.811598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:25.811817 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:25.811714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:26.814482 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:26.814455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:26.814842 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:26.814558 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:26.814842 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:26.814592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:26.814842 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:26.814677 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:27.811555 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:27.811528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:27.811712 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:27.811615 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:28.814902 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:28.814877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:28.815318 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:28.814880 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:28.815318 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:28.814966 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:28.815318 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:28.815049 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:29.812366 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:29.812338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:29.812581 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:29.812431 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5bxb6" podUID="4902ac1d-34c6-40eb-a1e1-7a580c44cd5e" Sep 10 02:34:30.812551 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:30.812516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:30.813011 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:30.812639 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ftmw" podUID="8c806bf8-3f7e-44f9-bfb0-e8df626d9c68" Sep 10 02:34:30.813011 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:30.812674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:30.813011 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:30.812765 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdg75" podUID="52ce502c-4e66-4b68-b86c-ccc945149575" Sep 10 02:34:31.119406 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.119351 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeReady" Sep 10 02:34:31.119514 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.119456 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 02:34:31.157022 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.156997 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c69fb8f77-tzfz2"] Sep 10 02:34:31.169861 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.169843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.172051 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.172033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 02:34:31.172125 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.172073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 02:34:31.172125 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.172073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pb55z\"" Sep 10 02:34:31.172255 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.172073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 02:34:31.177133 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.177110 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rknjs"] Sep 10 02:34:31.179952 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.179934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 02:34:31.194241 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.194223 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gbsq8"] Sep 10 02:34:31.194365 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.194351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.197007 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.196988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 02:34:31.197112 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.197030 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 02:34:31.197112 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.197052 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g9mpm\"" Sep 10 02:34:31.197112 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.196992 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 02:34:31.197288 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.197251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 02:34:31.207931 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.207914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c69fb8f77-tzfz2"] Sep 10 02:34:31.208006 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.207940 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rknjs"] Sep 10 02:34:31.208006 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.207962 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbsq8"] Sep 10 02:34:31.208071 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.208014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.210021 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.210002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 02:34:31.210119 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.210007 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 02:34:31.210119 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.210006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fcfm\"" Sep 10 02:34:31.271542 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.271514 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lw8lx"] Sep 10 02:34:31.277991 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.277971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c59f0540-3599-4dd4-8ffa-0c870cf2f817-crio-socket\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.278080 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.277996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c59f0540-3599-4dd4-8ffa-0c870cf2f817-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.278080 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9825542e-b5b6-455c-9c19-4b6d10197d0a-trusted-ca\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278080 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9825542e-b5b6-455c-9c19-4b6d10197d0a-installation-pull-secrets\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278237 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9825542e-b5b6-455c-9c19-4b6d10197d0a-ca-trust-extracted\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278237 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9825542e-b5b6-455c-9c19-4b6d10197d0a-registry-certificates\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278237 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f0540-3599-4dd4-8ffa-0c870cf2f817-data-volume\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.278237 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvc9\" (UniqueName: \"kubernetes.io/projected/c59f0540-3599-4dd4-8ffa-0c870cf2f817-kube-api-access-6pvc9\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a565a40c-36d0-465a-b1cd-fdd398fd953f-metrics-tls\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msktr\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-kube-api-access-msktr\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c59f0540-3599-4dd4-8ffa-0c870cf2f817-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9825542e-b5b6-455c-9c19-4b6d10197d0a-image-registry-private-configuration\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-bound-sa-token\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a565a40c-36d0-465a-b1cd-fdd398fd953f-tmp-dir\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.278393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-registry-tls\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.278618 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a565a40c-36d0-465a-b1cd-fdd398fd953f-config-volume\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.278618 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.278424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxzqz\" (UniqueName: \"kubernetes.io/projected/a565a40c-36d0-465a-b1cd-fdd398fd953f-kube-api-access-pxzqz\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.293909 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.293885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lw8lx"] Sep 10 02:34:31.294004 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.293971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.296205 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.296164 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v9q4l\"" Sep 10 02:34:31.296376 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.296362 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 02:34:31.296602 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.296582 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 02:34:31.296694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.296679 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 02:34:31.378708 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxzqz\" (UniqueName: \"kubernetes.io/projected/a565a40c-36d0-465a-b1cd-fdd398fd953f-kube-api-access-pxzqz\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.378708 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c59f0540-3599-4dd4-8ffa-0c870cf2f817-crio-socket\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.378708 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c59f0540-3599-4dd4-8ffa-0c870cf2f817-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.378908 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9825542e-b5b6-455c-9c19-4b6d10197d0a-trusted-ca\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.378908 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx9r5\" (UniqueName: \"kubernetes.io/projected/b376c4a3-ea5e-4c59-a4dd-0f966a47813a-kube-api-access-vx9r5\") pod \"ingress-canary-lw8lx\" (UID: \"b376c4a3-ea5e-4c59-a4dd-0f966a47813a\") " pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.378908 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9825542e-b5b6-455c-9c19-4b6d10197d0a-installation-pull-secrets\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.378908 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378876 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c59f0540-3599-4dd4-8ffa-0c870cf2f817-crio-socket\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.379079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9825542e-b5b6-455c-9c19-4b6d10197d0a-ca-trust-extracted\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.379079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9825542e-b5b6-455c-9c19-4b6d10197d0a-registry-certificates\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.379079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.378994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f0540-3599-4dd4-8ffa-0c870cf2f817-data-volume\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.379079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvc9\" (UniqueName: \"kubernetes.io/projected/c59f0540-3599-4dd4-8ffa-0c870cf2f817-kube-api-access-6pvc9\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.379079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a565a40c-36d0-465a-b1cd-fdd398fd953f-metrics-tls\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.379079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msktr\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-kube-api-access-msktr\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c59f0540-3599-4dd4-8ffa-0c870cf2f817-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9825542e-b5b6-455c-9c19-4b6d10197d0a-image-registry-private-configuration\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-bound-sa-token\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b376c4a3-ea5e-4c59-a4dd-0f966a47813a-cert\") pod \"ingress-canary-lw8lx\" (UID: \"b376c4a3-ea5e-4c59-a4dd-0f966a47813a\") " pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a565a40c-36d0-465a-b1cd-fdd398fd953f-tmp-dir\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-registry-tls\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a565a40c-36d0-465a-b1cd-fdd398fd953f-config-volume\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.379393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c59f0540-3599-4dd4-8ffa-0c870cf2f817-data-volume\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.379780 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379399 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9825542e-b5b6-455c-9c19-4b6d10197d0a-ca-trust-extracted\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.380010 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a565a40c-36d0-465a-b1cd-fdd398fd953f-config-volume\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.380010 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9825542e-b5b6-455c-9c19-4b6d10197d0a-registry-certificates\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.380010 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.379943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9825542e-b5b6-455c-9c19-4b6d10197d0a-trusted-ca\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.380240 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.380095 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a565a40c-36d0-465a-b1cd-fdd398fd953f-tmp-dir\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.380240 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.380208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c59f0540-3599-4dd4-8ffa-0c870cf2f817-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.383311 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.383286 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9825542e-b5b6-455c-9c19-4b6d10197d0a-image-registry-private-configuration\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.383381 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.383289 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c59f0540-3599-4dd4-8ffa-0c870cf2f817-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.383381 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.383359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a565a40c-36d0-465a-b1cd-fdd398fd953f-metrics-tls\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.383473 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.383460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-registry-tls\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.383511 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.383469 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9825542e-b5b6-455c-9c19-4b6d10197d0a-installation-pull-secrets\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.386720 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.386700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvc9\" (UniqueName: \"kubernetes.io/projected/c59f0540-3599-4dd4-8ffa-0c870cf2f817-kube-api-access-6pvc9\") pod \"insights-runtime-extractor-rknjs\" (UID: \"c59f0540-3599-4dd4-8ffa-0c870cf2f817\") " pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.386921 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.386902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msktr\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-kube-api-access-msktr\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.386972 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.386928 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9825542e-b5b6-455c-9c19-4b6d10197d0a-bound-sa-token\") pod \"image-registry-5c69fb8f77-tzfz2\" (UID: \"9825542e-b5b6-455c-9c19-4b6d10197d0a\") " pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.387395 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.387377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxzqz\" (UniqueName: \"kubernetes.io/projected/a565a40c-36d0-465a-b1cd-fdd398fd953f-kube-api-access-pxzqz\") pod \"dns-default-gbsq8\" (UID: \"a565a40c-36d0-465a-b1cd-fdd398fd953f\") " pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.480450 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.480424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:31.480577 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.480515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b376c4a3-ea5e-4c59-a4dd-0f966a47813a-cert\") pod \"ingress-canary-lw8lx\" (UID: \"b376c4a3-ea5e-4c59-a4dd-0f966a47813a\") " pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.480640 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.480597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx9r5\" (UniqueName: \"kubernetes.io/projected/b376c4a3-ea5e-4c59-a4dd-0f966a47813a-kube-api-access-vx9r5\") pod \"ingress-canary-lw8lx\" (UID: \"b376c4a3-ea5e-4c59-a4dd-0f966a47813a\") " pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.482909 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.482886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b376c4a3-ea5e-4c59-a4dd-0f966a47813a-cert\") pod \"ingress-canary-lw8lx\" (UID: \"b376c4a3-ea5e-4c59-a4dd-0f966a47813a\") " pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.493906 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.493882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx9r5\" (UniqueName: \"kubernetes.io/projected/b376c4a3-ea5e-4c59-a4dd-0f966a47813a-kube-api-access-vx9r5\") pod \"ingress-canary-lw8lx\" (UID: \"b376c4a3-ea5e-4c59-a4dd-0f966a47813a\") " pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.508653 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.508623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rknjs" Sep 10 02:34:31.515355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.515323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:31.607208 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.605883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lw8lx" Sep 10 02:34:31.809896 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.809862 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rknjs"] Sep 10 02:34:31.811792 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.811774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:31.814043 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.814015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 02:34:31.814473 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.814044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcpg8\"" Sep 10 02:34:31.814473 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.814377 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 02:34:31.816491 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.816466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c69fb8f77-tzfz2"] Sep 10 02:34:31.820080 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:31.820062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9825542e_b5b6_455c_9c19_4b6d10197d0a.slice/crio-40fad0d393219a6dfae8d196833c1cae620c846836af88155d8dff621d18bdad WatchSource:0}: Error finding container 40fad0d393219a6dfae8d196833c1cae620c846836af88155d8dff621d18bdad: Status 404 returned error can't find the container with id 40fad0d393219a6dfae8d196833c1cae620c846836af88155d8dff621d18bdad Sep 10 02:34:31.858850 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.858782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbsq8"] Sep 10 02:34:31.867133 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:31.867102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda565a40c_36d0_465a_b1cd_fdd398fd953f.slice/crio-3967afc028645860688de9df95d31b6dfefcb73f5bd822eb8d20ca2cb4fc4fde WatchSource:0}: Error finding container 3967afc028645860688de9df95d31b6dfefcb73f5bd822eb8d20ca2cb4fc4fde: Status 404 returned error can't find the container with id 3967afc028645860688de9df95d31b6dfefcb73f5bd822eb8d20ca2cb4fc4fde Sep 10 02:34:31.894867 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:31.894843 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lw8lx"] Sep 10 02:34:31.907145 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:31.907118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb376c4a3_ea5e_4c59_a4dd_0f966a47813a.slice/crio-e08ac1122d0ae40f618cc4d0dda73befb0054b084fe660acd532f8542a678282 WatchSource:0}: Error finding container e08ac1122d0ae40f618cc4d0dda73befb0054b084fe660acd532f8542a678282: Status 404 returned error can't find the container with id e08ac1122d0ae40f618cc4d0dda73befb0054b084fe660acd532f8542a678282 Sep 10 02:34:32.209313 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.209233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rknjs" event={"ID":"c59f0540-3599-4dd4-8ffa-0c870cf2f817","Type":"ContainerStarted","Data":"abe1d61c1375ddc9f844432f8de31db026644e5a1e2b80d5fb29284d6093d17f"} Sep 10 02:34:32.209313 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.209294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rknjs" event={"ID":"c59f0540-3599-4dd4-8ffa-0c870cf2f817","Type":"ContainerStarted","Data":"dd08f0339e294d70b9578d231a0db0666edffa192a7483d68dd929fe530bf4dd"} Sep 10 02:34:32.210933 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.210896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" event={"ID":"9825542e-b5b6-455c-9c19-4b6d10197d0a","Type":"ContainerStarted","Data":"83d780ee053dc4cf69b1498289a50854c386b2a86e7054f2aec62ff8d8fe927b"} Sep 10 02:34:32.211080 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.210955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" event={"ID":"9825542e-b5b6-455c-9c19-4b6d10197d0a","Type":"ContainerStarted","Data":"40fad0d393219a6dfae8d196833c1cae620c846836af88155d8dff621d18bdad"} Sep 10 02:34:32.211080 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.210993 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:32.212206 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.212165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lw8lx" event={"ID":"b376c4a3-ea5e-4c59-a4dd-0f966a47813a","Type":"ContainerStarted","Data":"e08ac1122d0ae40f618cc4d0dda73befb0054b084fe660acd532f8542a678282"} Sep 10 02:34:32.213400 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.213379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbsq8" event={"ID":"a565a40c-36d0-465a-b1cd-fdd398fd953f","Type":"ContainerStarted","Data":"3967afc028645860688de9df95d31b6dfefcb73f5bd822eb8d20ca2cb4fc4fde"} Sep 10 02:34:32.229395 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.229351 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" podStartSLOduration=2.229338468 podStartE2EDuration="2.229338468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:32.2292929 +0000 UTC m=+51.900933943" watchObservedRunningTime="2026-09-10 02:34:32.229338468 +0000 UTC m=+51.900979490" Sep 10 02:34:32.812010 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.811975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:32.812198 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.811982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:32.814529 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.814328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 02:34:32.815079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.815057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 02:34:32.815218 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:32.815176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwtct\"" Sep 10 02:34:33.219928 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:33.219840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rknjs" event={"ID":"c59f0540-3599-4dd4-8ffa-0c870cf2f817","Type":"ContainerStarted","Data":"88319b181729b13326bed2d36475b1aab42b2b6dbf53d43c157559ba27fdd062"} Sep 10 02:34:35.231226 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.231110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rknjs" event={"ID":"c59f0540-3599-4dd4-8ffa-0c870cf2f817","Type":"ContainerStarted","Data":"95b880a6c7231df35f8f5b75947bab943e78e61263c3d70caae66e2f960cf45a"} Sep 10 02:34:35.232768 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.232732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lw8lx" event={"ID":"b376c4a3-ea5e-4c59-a4dd-0f966a47813a","Type":"ContainerStarted","Data":"13088d227d7070b68b2ba000510b82e0339903309b9e237e7bae711ebc93d04a"} Sep 10 02:34:35.237050 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.237024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbsq8" event={"ID":"a565a40c-36d0-465a-b1cd-fdd398fd953f","Type":"ContainerStarted","Data":"1b2e81a01b5c432a3b2a9d68cf21c92dce4ea2598da2e48b3ce043c5304c4e57"} Sep 10 02:34:35.237167 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.237073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbsq8" event={"ID":"a565a40c-36d0-465a-b1cd-fdd398fd953f","Type":"ContainerStarted","Data":"c1edd740bc9bd2f6a96cbe44f27e8fd05abb3849e0d6f1aedf0722928468ae92"} Sep 10 02:34:35.237167 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.237117 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:35.247893 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.247858 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rknjs" podStartSLOduration=1.343585652 podStartE2EDuration="4.24784697s" totalImagesPullingTime="2.904261318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:34:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:35.247375138 +0000 UTC m=+54.919016185" watchObservedRunningTime="2026-09-10 02:34:35.24784697 +0000 UTC m=+54.919487995" Sep 10 02:34:35.262246 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.262208 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gbsq8" podStartSLOduration=1.199854937 podStartE2EDuration="4.262196728s" totalImagesPullingTime="3.062341791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:35.261724722 +0000 UTC m=+54.933365778" watchObservedRunningTime="2026-09-10 02:34:35.262196728 +0000 UTC m=+54.933837763" Sep 10 02:34:35.275362 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:35.275327 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lw8lx" podStartSLOduration=1.247566608 podStartE2EDuration="4.27531546s" totalImagesPullingTime="3.027748852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:35.275133893 +0000 UTC m=+54.946774938" watchObservedRunningTime="2026-09-10 02:34:35.27531546 +0000 UTC m=+54.946956504" Sep 10 02:34:41.157222 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:41.157167 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8k7l8" Sep 10 02:34:45.242548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.242515 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gbsq8" Sep 10 02:34:45.588463 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.588439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:45.588746 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.588496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:45.591424 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.591392 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 02:34:45.591539 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.591488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 02:34:45.601773 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.601749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52ce502c-4e66-4b68-b86c-ccc945149575-original-pull-secret\") pod \"global-pull-secret-syncer-qdg75\" (UID: \"52ce502c-4e66-4b68-b86c-ccc945149575\") " pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:45.601893 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.601876 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c806bf8-3f7e-44f9-bfb0-e8df626d9c68-metrics-certs\") pod \"network-metrics-daemon-6ftmw\" (UID: \"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68\") " pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:45.689131 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.689094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:45.691592 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.691572 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 02:34:45.702166 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.702150 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 02:34:45.713267 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.713243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k55wv\" (UniqueName: \"kubernetes.io/projected/4902ac1d-34c6-40eb-a1e1-7a580c44cd5e-kube-api-access-k55wv\") pod \"network-check-target-5bxb6\" (UID: \"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e\") " pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:45.725023 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.725002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdg75" Sep 10 02:34:45.733877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.733860 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwtct\"" Sep 10 02:34:45.742553 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.742536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ftmw" Sep 10 02:34:45.925244 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.925153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcpg8\"" Sep 10 02:34:45.933719 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.933700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:45.999683 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:45.999651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdg75"] Sep 10 02:34:46.002970 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:46.002948 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ce502c_4e66_4b68_b86c_ccc945149575.slice/crio-8f626fdaeda9f791d5fb890686fcff75b6264bc6c2865254ba25cabf8bacc010 WatchSource:0}: Error finding container 8f626fdaeda9f791d5fb890686fcff75b6264bc6c2865254ba25cabf8bacc010: Status 404 returned error can't find the container with id 8f626fdaeda9f791d5fb890686fcff75b6264bc6c2865254ba25cabf8bacc010 Sep 10 02:34:46.021598 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:46.021574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ftmw"] Sep 10 02:34:46.024656 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:46.024627 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c806bf8_3f7e_44f9_bfb0_e8df626d9c68.slice/crio-9dc683504430f7e818df206253c53dce322514cfb2333d52054315fae266af65 WatchSource:0}: Error finding container 9dc683504430f7e818df206253c53dce322514cfb2333d52054315fae266af65: Status 404 returned error can't find the container with id 9dc683504430f7e818df206253c53dce322514cfb2333d52054315fae266af65 Sep 10 02:34:46.199314 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:46.199252 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5bxb6"] Sep 10 02:34:46.201934 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:46.201906 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4902ac1d_34c6_40eb_a1e1_7a580c44cd5e.slice/crio-529b7d8464bf927dc656477b3dcad9a0a94be6494c39360cff6b0457d97af50c WatchSource:0}: Error finding container 529b7d8464bf927dc656477b3dcad9a0a94be6494c39360cff6b0457d97af50c: Status 404 returned error can't find the container with id 529b7d8464bf927dc656477b3dcad9a0a94be6494c39360cff6b0457d97af50c Sep 10 02:34:46.273010 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:46.272972 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ftmw" event={"ID":"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68","Type":"ContainerStarted","Data":"9dc683504430f7e818df206253c53dce322514cfb2333d52054315fae266af65"} Sep 10 02:34:46.274222 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:46.274173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdg75" event={"ID":"52ce502c-4e66-4b68-b86c-ccc945149575","Type":"ContainerStarted","Data":"8f626fdaeda9f791d5fb890686fcff75b6264bc6c2865254ba25cabf8bacc010"} Sep 10 02:34:46.275799 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:46.275777 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5bxb6" event={"ID":"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e","Type":"ContainerStarted","Data":"529b7d8464bf927dc656477b3dcad9a0a94be6494c39360cff6b0457d97af50c"} Sep 10 02:34:47.282945 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:47.282884 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ftmw" event={"ID":"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68","Type":"ContainerStarted","Data":"360567208b6c47f475c1736a321ddb085a955f4ab1879af263578c1d96b8fb0d"} Sep 10 02:34:48.288721 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:48.288686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ftmw" event={"ID":"8c806bf8-3f7e-44f9-bfb0-e8df626d9c68","Type":"ContainerStarted","Data":"678d13dae9bb74c415ffc27281ded2142d680ce07f2577ce1e9ffb69131dd4c3"} Sep 10 02:34:48.304645 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:48.304589 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6ftmw" podStartSLOduration=66.2138097 podStartE2EDuration="1m7.304573509s" totalImagesPullingTime="1.090763809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:48.303277584 +0000 UTC m=+67.974918619" watchObservedRunningTime="2026-09-10 02:34:48.304573509 +0000 UTC m=+67.976214552" Sep 10 02:34:51.020912 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.020875 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p648w"] Sep 10 02:34:51.042960 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.042929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.045419 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.045394 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qwtm5\"" Sep 10 02:34:51.045549 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.045478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 02:34:51.045672 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.045652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 02:34:51.045743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.045688 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 02:34:51.046011 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.045994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 02:34:51.046115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.046095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 02:34:51.046248 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.046162 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 02:34:51.130986 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.130946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-sys\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131174 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.130995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131174 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-tls\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131174 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbvqb\" (UniqueName: \"kubernetes.io/projected/7358d723-4fde-4241-9afe-16fed2c6e8e6-kube-api-access-dbvqb\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131174 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-wtmp\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131433 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-root\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131433 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-textfile\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131433 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7358d723-4fde-4241-9afe-16fed2c6e8e6-metrics-client-ca\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.131433 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.131299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.231963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.231927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-sys\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232110 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.231969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232110 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-sys\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232110 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-tls\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232281 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbvqb\" (UniqueName: \"kubernetes.io/projected/7358d723-4fde-4241-9afe-16fed2c6e8e6-kube-api-access-dbvqb\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232333 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:51.232277 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 02:34:51.232381 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-wtmp\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232381 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:34:51.232345 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-tls podName:7358d723-4fde-4241-9afe-16fed2c6e8e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:51.732323348 +0000 UTC m=+71.403964372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-tls") pod "node-exporter-p648w" (UID: "7358d723-4fde-4241-9afe-16fed2c6e8e6") : secret "node-exporter-tls" not found Sep 10 02:34:51.232481 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232387 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-wtmp\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232481 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-root\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232481 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-textfile\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232481 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7358d723-4fde-4241-9afe-16fed2c6e8e6-metrics-client-ca\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232481 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232431 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7358d723-4fde-4241-9afe-16fed2c6e8e6-root\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232683 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232683 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.232683 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-textfile\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.233015 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.232990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7358d723-4fde-4241-9afe-16fed2c6e8e6-metrics-client-ca\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.234892 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.234872 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.242066 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.242043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbvqb\" (UniqueName: \"kubernetes.io/projected/7358d723-4fde-4241-9afe-16fed2c6e8e6-kube-api-access-dbvqb\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.486319 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.486276 2576 patch_prober.go:28] interesting pod/image-registry-5c69fb8f77-tzfz2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 02:34:51.486456 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.486360 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" podUID="9825542e-b5b6-455c-9c19-4b6d10197d0a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 02:34:51.735791 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.735710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-tls\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.738218 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.738156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7358d723-4fde-4241-9afe-16fed2c6e8e6-node-exporter-tls\") pod \"node-exporter-p648w\" (UID: \"7358d723-4fde-4241-9afe-16fed2c6e8e6\") " pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.953819 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:51.953790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p648w" Sep 10 02:34:51.962536 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:51.962516 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7358d723_4fde_4241_9afe_16fed2c6e8e6.slice/crio-62f3127d0b0b8d0d9a48334d672195f39c135cf8f342ead405cd9b2f777a8695 WatchSource:0}: Error finding container 62f3127d0b0b8d0d9a48334d672195f39c135cf8f342ead405cd9b2f777a8695: Status 404 returned error can't find the container with id 62f3127d0b0b8d0d9a48334d672195f39c135cf8f342ead405cd9b2f777a8695 Sep 10 02:34:52.052252 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.052176 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:34:52.055176 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.055159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.057207 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 02:34:52.057476 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057462 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 02:34:52.057524 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057476 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 02:34:52.057524 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057506 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 02:34:52.057946 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 02:34:52.058023 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 02:34:52.058023 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.057987 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8klcx\"" Sep 10 02:34:52.058129 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.058048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 02:34:52.058129 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.058068 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 02:34:52.058316 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.058302 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 02:34:52.071487 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.071459 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:34:52.140098 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140231 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-config-out\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140231 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140231 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140367 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p62q\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-kube-api-access-5p62q\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140367 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140367 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140367 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-web-config\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140367 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.140596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.140539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241290 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-web-config\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241391 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241391 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241391 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-config-out\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p62q\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-kube-api-access-5p62q\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.241782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.241673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.242717 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.242646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.243197 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.243157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.243295 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.243155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.244878 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.244707 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.244966 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.244885 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.245207 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.245160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.245619 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.245529 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.245619 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.245558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-web-config\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.245964 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.245933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.246049 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.245976 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.246312 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.246294 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.246980 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.246958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-config-out\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.249552 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.249530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p62q\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-kube-api-access-5p62q\") pod \"alertmanager-main-0\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.303972 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.303914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdg75" event={"ID":"52ce502c-4e66-4b68-b86c-ccc945149575","Type":"ContainerStarted","Data":"72dfde097b1b475fefbb724b208c16523b35c3d0485fa2c55ee8fdb3639e307d"} Sep 10 02:34:52.305523 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.305501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5bxb6" event={"ID":"4902ac1d-34c6-40eb-a1e1-7a580c44cd5e","Type":"ContainerStarted","Data":"e33bdc3a687c2414073256a56108aea9f5c3031ff7041fe370e67bedae7c457c"} Sep 10 02:34:52.305661 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.305642 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:34:52.306668 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.306648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p648w" event={"ID":"7358d723-4fde-4241-9afe-16fed2c6e8e6","Type":"ContainerStarted","Data":"62f3127d0b0b8d0d9a48334d672195f39c135cf8f342ead405cd9b2f777a8695"} Sep 10 02:34:52.319637 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.319596 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qdg75" podStartSLOduration=65.894208777 podStartE2EDuration="1m11.319583009s" totalImagesPullingTime="5.425374232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:52.318710998 +0000 UTC m=+71.990352043" watchObservedRunningTime="2026-09-10 02:34:52.319583009 +0000 UTC m=+71.991224054" Sep 10 02:34:52.332446 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.332407 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5bxb6" podStartSLOduration=66.106576092 podStartE2EDuration="1m11.332392008s" totalImagesPullingTime="5.225815916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:52.331967298 +0000 UTC m=+72.003608341" watchObservedRunningTime="2026-09-10 02:34:52.332392008 +0000 UTC m=+72.004033053" Sep 10 02:34:52.364273 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.364255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:34:52.642535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:52.642509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:34:52.644633 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:52.644603 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aba1910_b939_4942_9140_d8fa032853a7.slice/crio-ff2fe696830acc5ab9ce3700fb965e22e4c9fc393fdb3abe81b1d859054db76b WatchSource:0}: Error finding container ff2fe696830acc5ab9ce3700fb965e22e4c9fc393fdb3abe81b1d859054db76b: Status 404 returned error can't find the container with id ff2fe696830acc5ab9ce3700fb965e22e4c9fc393fdb3abe81b1d859054db76b Sep 10 02:34:53.225652 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:53.225579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c69fb8f77-tzfz2" Sep 10 02:34:53.312264 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:53.312225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"ff2fe696830acc5ab9ce3700fb965e22e4c9fc393fdb3abe81b1d859054db76b"} Sep 10 02:34:53.314711 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:53.314682 2576 generic.go:356] "Generic (PLEG): container finished" podID="7358d723-4fde-4241-9afe-16fed2c6e8e6" containerID="3223cb2a238f73c96c69e55395464b8da90e7eac0ed5ba8ffc1b0387a3235434" exitCode=0 Sep 10 02:34:53.314851 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:53.314774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p648w" event={"ID":"7358d723-4fde-4241-9afe-16fed2c6e8e6","Type":"ContainerDied","Data":"3223cb2a238f73c96c69e55395464b8da90e7eac0ed5ba8ffc1b0387a3235434"} Sep 10 02:34:54.319284 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:54.319246 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b" exitCode=0 Sep 10 02:34:54.319692 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:54.319338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b"} Sep 10 02:34:54.321722 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:54.321699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p648w" event={"ID":"7358d723-4fde-4241-9afe-16fed2c6e8e6","Type":"ContainerStarted","Data":"2f6b814a44edc40bbf130df42851351dc09de431fdfc26c5c7ace0b7d9b77d36"} Sep 10 02:34:54.321837 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:54.321742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p648w" event={"ID":"7358d723-4fde-4241-9afe-16fed2c6e8e6","Type":"ContainerStarted","Data":"a4c47dc3306fa92d8fed3faaf2ce31fca1f47fdd88f1a029988a7b62936ec887"} Sep 10 02:34:54.368969 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:54.368913 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p648w" podStartSLOduration=3.368867749 podStartE2EDuration="4.368894328s" totalImagesPullingTime="929.918ms" totalInitContainerRuntime="70.108579ms" isStatefulPod=true podCreationTimestamp="2026-09-10 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:54.368027861 +0000 UTC m=+74.039668926" watchObservedRunningTime="2026-09-10 02:34:54.368894328 +0000 UTC m=+74.040535372" Sep 10 02:34:55.277499 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.277465 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6bcc645f85-rrwpj"] Sep 10 02:34:55.279892 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.279874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.282380 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.282355 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 02:34:55.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.282378 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 02:34:55.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.282382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 02:34:55.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.282448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ldbwx\"" Sep 10 02:34:55.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.282355 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d9ulkqi7sqoua\"" Sep 10 02:34:55.282706 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.282655 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 02:34:55.289738 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.289717 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bcc645f85-rrwpj"] Sep 10 02:34:55.365817 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.365779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b78f9f1-5339-4f7a-a9b2-59618963c008-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.366238 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.365825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-client-ca-bundle\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.366238 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.365874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b78f9f1-5339-4f7a-a9b2-59618963c008-metrics-server-audit-profiles\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.366238 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.365953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b78f9f1-5339-4f7a-a9b2-59618963c008-audit-log\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.366238 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.366032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-secret-metrics-server-tls\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.366238 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.366050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6n4\" (UniqueName: \"kubernetes.io/projected/9b78f9f1-5339-4f7a-a9b2-59618963c008-kube-api-access-fj6n4\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.366238 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.366092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-secret-metrics-server-client-certs\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467172 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-secret-metrics-server-tls\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6n4\" (UniqueName: \"kubernetes.io/projected/9b78f9f1-5339-4f7a-a9b2-59618963c008-kube-api-access-fj6n4\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-secret-metrics-server-client-certs\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b78f9f1-5339-4f7a-a9b2-59618963c008-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-client-ca-bundle\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467562 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b78f9f1-5339-4f7a-a9b2-59618963c008-metrics-server-audit-profiles\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467562 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b78f9f1-5339-4f7a-a9b2-59618963c008-audit-log\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.467950 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.467907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9b78f9f1-5339-4f7a-a9b2-59618963c008-audit-log\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.468310 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.468255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b78f9f1-5339-4f7a-a9b2-59618963c008-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.468888 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.468840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9b78f9f1-5339-4f7a-a9b2-59618963c008-metrics-server-audit-profiles\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.470099 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.470078 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-secret-metrics-server-client-certs\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.470392 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.470371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-secret-metrics-server-tls\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.470685 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.470662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b78f9f1-5339-4f7a-a9b2-59618963c008-client-ca-bundle\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.474618 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.474599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6n4\" (UniqueName: \"kubernetes.io/projected/9b78f9f1-5339-4f7a-a9b2-59618963c008-kube-api-access-fj6n4\") pod \"metrics-server-6bcc645f85-rrwpj\" (UID: \"9b78f9f1-5339-4f7a-a9b2-59618963c008\") " pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.590748 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.590700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:34:55.754967 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.754934 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6"] Sep 10 02:34:55.756777 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.756761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:55.760517 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.759451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 02:34:55.760517 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.759807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4fld4\"" Sep 10 02:34:55.768624 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.768588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6"] Sep 10 02:34:55.870920 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.870895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7dd9168-51b1-46e9-83b5-1d2899045e94-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-s7bh6\" (UID: \"f7dd9168-51b1-46e9-83b5-1d2899045e94\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:55.871012 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.870927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xr76\" (UniqueName: \"kubernetes.io/projected/f7dd9168-51b1-46e9-83b5-1d2899045e94-kube-api-access-2xr76\") pod \"monitoring-plugin-85bbbbbf4-s7bh6\" (UID: \"f7dd9168-51b1-46e9-83b5-1d2899045e94\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:55.971908 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.971878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7dd9168-51b1-46e9-83b5-1d2899045e94-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-s7bh6\" (UID: \"f7dd9168-51b1-46e9-83b5-1d2899045e94\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:55.971970 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.971926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr76\" (UniqueName: \"kubernetes.io/projected/f7dd9168-51b1-46e9-83b5-1d2899045e94-kube-api-access-2xr76\") pod \"monitoring-plugin-85bbbbbf4-s7bh6\" (UID: \"f7dd9168-51b1-46e9-83b5-1d2899045e94\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:55.974315 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.974295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7dd9168-51b1-46e9-83b5-1d2899045e94-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-s7bh6\" (UID: \"f7dd9168-51b1-46e9-83b5-1d2899045e94\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:55.979695 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:55.979671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xr76\" (UniqueName: \"kubernetes.io/projected/f7dd9168-51b1-46e9-83b5-1d2899045e94-kube-api-access-2xr76\") pod \"monitoring-plugin-85bbbbbf4-s7bh6\" (UID: \"f7dd9168-51b1-46e9-83b5-1d2899045e94\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:56.029987 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.029963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bcc645f85-rrwpj"] Sep 10 02:34:56.032525 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:56.032501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b78f9f1_5339_4f7a_a9b2_59618963c008.slice/crio-9769f079ff6ef8a4100ff3424194c6f62338b92a7c243a7934d175fe0b3c4a5b WatchSource:0}: Error finding container 9769f079ff6ef8a4100ff3424194c6f62338b92a7c243a7934d175fe0b3c4a5b: Status 404 returned error can't find the container with id 9769f079ff6ef8a4100ff3424194c6f62338b92a7c243a7934d175fe0b3c4a5b Sep 10 02:34:56.077902 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.077882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:56.199508 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.199475 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s"] Sep 10 02:34:56.202379 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.202360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.204442 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.204415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 02:34:56.204535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.204415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 02:34:56.204535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.204451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ggtl7\"" Sep 10 02:34:56.204535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.204469 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 02:34:56.204535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.204441 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 02:34:56.204714 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.204632 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 02:34:56.209249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.209228 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 02:34:56.215872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.215851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s"] Sep 10 02:34:56.275709 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-metrics-client-ca\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.275816 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-secret-telemeter-client\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.275816 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52jk\" (UniqueName: \"kubernetes.io/projected/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-kube-api-access-f52jk\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.275816 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-telemeter-client-tls\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.275937 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-federate-client-tls\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.275937 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-serving-certs-ca-bundle\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.276013 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.276013 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.275975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.330335 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.330302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" event={"ID":"9b78f9f1-5339-4f7a-a9b2-59618963c008","Type":"ContainerStarted","Data":"9769f079ff6ef8a4100ff3424194c6f62338b92a7c243a7934d175fe0b3c4a5b"} Sep 10 02:34:56.333671 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.333648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf"} Sep 10 02:34:56.333767 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.333713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5"} Sep 10 02:34:56.333767 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.333752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782"} Sep 10 02:34:56.333881 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.333790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac"} Sep 10 02:34:56.333881 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.333830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd"} Sep 10 02:34:56.345796 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.345773 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6"] Sep 10 02:34:56.348756 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:56.348734 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7dd9168_51b1_46e9_83b5_1d2899045e94.slice/crio-50ac4ce5f9872d23788a3ee06a5b3356207df4278455c55e55d2e2fbfea4da9a WatchSource:0}: Error finding container 50ac4ce5f9872d23788a3ee06a5b3356207df4278455c55e55d2e2fbfea4da9a: Status 404 returned error can't find the container with id 50ac4ce5f9872d23788a3ee06a5b3356207df4278455c55e55d2e2fbfea4da9a Sep 10 02:34:56.376896 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.376851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-serving-certs-ca-bundle\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.376896 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.376877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.376896 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.376896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377364 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.376919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-metrics-client-ca\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377364 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.376965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-secret-telemeter-client\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377364 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.376999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52jk\" (UniqueName: \"kubernetes.io/projected/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-kube-api-access-f52jk\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377364 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.377052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-telemeter-client-tls\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377364 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.377082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-federate-client-tls\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377764 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.377740 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-serving-certs-ca-bundle\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377906 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.377857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.377906 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.377858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-metrics-client-ca\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.379476 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.379448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.379687 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.379668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-secret-telemeter-client\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.380050 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.380035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-federate-client-tls\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.380090 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.380070 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-telemeter-client-tls\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.384566 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.384548 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52jk\" (UniqueName: \"kubernetes.io/projected/c92ffe5b-b286-46e4-a8b6-c8e402e48ad1-kube-api-access-f52jk\") pod \"telemeter-client-688c4dc5b9-qkn4s\" (UID: \"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1\") " pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.511748 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.511729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" Sep 10 02:34:56.785624 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:56.785547 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s"] Sep 10 02:34:56.913445 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:56.913412 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92ffe5b_b286_46e4_a8b6_c8e402e48ad1.slice/crio-da552997c386c9e4655ec6da5d52c2133ec4ff30afd513ccdbbeaf38530bab9f WatchSource:0}: Error finding container da552997c386c9e4655ec6da5d52c2133ec4ff30afd513ccdbbeaf38530bab9f: Status 404 returned error can't find the container with id da552997c386c9e4655ec6da5d52c2133ec4ff30afd513ccdbbeaf38530bab9f Sep 10 02:34:57.346022 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.345979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerStarted","Data":"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19"} Sep 10 02:34:57.347644 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.347608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" event={"ID":"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1","Type":"ContainerStarted","Data":"da552997c386c9e4655ec6da5d52c2133ec4ff30afd513ccdbbeaf38530bab9f"} Sep 10 02:34:57.349106 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.349078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" event={"ID":"f7dd9168-51b1-46e9-83b5-1d2899045e94","Type":"ContainerStarted","Data":"50ac4ce5f9872d23788a3ee06a5b3356207df4278455c55e55d2e2fbfea4da9a"} Sep 10 02:34:57.373597 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.373558 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.983261756 podStartE2EDuration="5.373545227s" totalImagesPullingTime="3.369729701s" totalInitContainerRuntime="20.55377ms" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:57.372158171 +0000 UTC m=+77.043799239" watchObservedRunningTime="2026-09-10 02:34:57.373545227 +0000 UTC m=+77.045186270" Sep 10 02:34:57.613119 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.611910 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cdb9f6b-dmztm"] Sep 10 02:34:57.614500 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.614478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.617025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.616770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 02:34:57.617025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.616843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 02:34:57.617025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.616854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 02:34:57.617025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.616779 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zdxjg\"" Sep 10 02:34:57.617025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.616862 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 02:34:57.617324 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.617138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 02:34:57.617324 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.617154 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 02:34:57.617469 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.617456 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 02:34:57.624032 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.624009 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdb9f6b-dmztm"] Sep 10 02:34:57.688483 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.688451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-service-ca\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.688634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.688488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-oauth-config\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.688634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.688511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-serving-cert\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.688634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.688568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc5c\" (UniqueName: \"kubernetes.io/projected/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-kube-api-access-wnc5c\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.688634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.688618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-oauth-serving-cert\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.688800 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.688683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-config\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.789460 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.789425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-config\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.789620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.789484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-service-ca\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.789620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.789515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-oauth-config\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.789620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.789539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-serving-cert\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.789620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.789570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc5c\" (UniqueName: \"kubernetes.io/projected/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-kube-api-access-wnc5c\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.789620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.789607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-oauth-serving-cert\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.790271 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.790240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-config\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.790398 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.790289 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-oauth-serving-cert\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.790452 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.790429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-service-ca\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.792177 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.792157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-oauth-config\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.792679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.792663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-serving-cert\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.799617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.799597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc5c\" (UniqueName: \"kubernetes.io/projected/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-kube-api-access-wnc5c\") pod \"console-5cdb9f6b-dmztm\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:57.926281 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:57.926251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:34:58.203155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.203038 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdb9f6b-dmztm"] Sep 10 02:34:58.206233 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:34:58.206203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a18e7f_5bdf_470d_afe4_a1c79c7837d9.slice/crio-0181a0350e12255e5afa81a99ff32fb94d1b96c509b48bb3e3aabbee12e324ac WatchSource:0}: Error finding container 0181a0350e12255e5afa81a99ff32fb94d1b96c509b48bb3e3aabbee12e324ac: Status 404 returned error can't find the container with id 0181a0350e12255e5afa81a99ff32fb94d1b96c509b48bb3e3aabbee12e324ac Sep 10 02:34:58.353934 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.353904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdb9f6b-dmztm" event={"ID":"42a18e7f-5bdf-470d-afe4-a1c79c7837d9","Type":"ContainerStarted","Data":"0181a0350e12255e5afa81a99ff32fb94d1b96c509b48bb3e3aabbee12e324ac"} Sep 10 02:34:58.355482 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.355457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" event={"ID":"f7dd9168-51b1-46e9-83b5-1d2899045e94","Type":"ContainerStarted","Data":"4d82fd8d2b9daf783dc407ad043d7e9dce5fbb7f2097b4bf0aad2548d63a4273"} Sep 10 02:34:58.355610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.355594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:58.357569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.357146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" event={"ID":"9b78f9f1-5339-4f7a-a9b2-59618963c008","Type":"ContainerStarted","Data":"7b46dad75ca94046f977a082c1882311857dc48e37a995a24c8c4f62cff9bffa"} Sep 10 02:34:58.360877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.360859 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" Sep 10 02:34:58.387662 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.387618 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s7bh6" podStartSLOduration=1.845376017 podStartE2EDuration="3.387598968s" totalImagesPullingTime="1.542222951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:58.371852274 +0000 UTC m=+78.043493318" watchObservedRunningTime="2026-09-10 02:34:58.387598968 +0000 UTC m=+78.059240013" Sep 10 02:34:58.405167 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:34:58.405121 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" podStartSLOduration=1.548819575 podStartE2EDuration="3.405104984s" totalImagesPullingTime="1.856285409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:58.404099883 +0000 UTC m=+78.075740927" watchObservedRunningTime="2026-09-10 02:34:58.405104984 +0000 UTC m=+78.076746028" Sep 10 02:35:00.369568 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:00.369521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" event={"ID":"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1","Type":"ContainerStarted","Data":"838e9d11b5e707268c9de73d0a3a2e60195c23cd6750403e2fd6a8136907c9c9"} Sep 10 02:35:00.370028 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:00.369627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" event={"ID":"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1","Type":"ContainerStarted","Data":"9e0d1827a9c2313de0f48e6b702d048d7142370a3a5530487e0f877f34f5ec88"} Sep 10 02:35:00.370028 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:00.369663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" event={"ID":"c92ffe5b-b286-46e4-a8b6-c8e402e48ad1","Type":"ContainerStarted","Data":"c10a3b1088f893294f5770e1437633bd56e0918ecc2f6d0b7660660d72eb10cc"} Sep 10 02:35:00.389750 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:00.389684 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-688c4dc5b9-qkn4s" podStartSLOduration=1.835843632 podStartE2EDuration="4.389665941s" totalImagesPullingTime="2.553822309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:00.38901654 +0000 UTC m=+80.060657584" watchObservedRunningTime="2026-09-10 02:35:00.389665941 +0000 UTC m=+80.061306977" Sep 10 02:35:02.378380 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:02.378340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdb9f6b-dmztm" event={"ID":"42a18e7f-5bdf-470d-afe4-a1c79c7837d9","Type":"ContainerStarted","Data":"155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914"} Sep 10 02:35:02.407541 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:02.407492 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cdb9f6b-dmztm" podStartSLOduration=2.2465405880000002 podStartE2EDuration="5.40747759s" totalImagesPullingTime="3.160937002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:02.405379165 +0000 UTC m=+82.077020212" watchObservedRunningTime="2026-09-10 02:35:02.40747759 +0000 UTC m=+82.079118634" Sep 10 02:35:07.927386 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:07.927345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:35:07.927760 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:07.927403 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:35:07.932299 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:07.932273 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:35:08.402572 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.402546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:35:08.743593 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.743526 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664f5bb48-xmwmr"] Sep 10 02:35:08.776126 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.776100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664f5bb48-xmwmr"] Sep 10 02:35:08.776297 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.776221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.783479 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.783455 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 02:35:08.885241 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-trusted-ca-bundle\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.885389 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55dgm\" (UniqueName: \"kubernetes.io/projected/f03013a7-5470-4f80-a7b9-3ffc1eaca979-kube-api-access-55dgm\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.885389 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-config\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.885389 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-oauth-config\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.885389 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-serving-cert\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.885522 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-oauth-serving-cert\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.885522 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.885490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-service-ca\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986143 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-oauth-config\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986143 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-serving-cert\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-oauth-serving-cert\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-service-ca\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-trusted-ca-bundle\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55dgm\" (UniqueName: \"kubernetes.io/projected/f03013a7-5470-4f80-a7b9-3ffc1eaca979-kube-api-access-55dgm\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.986617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.986436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-config\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.987172 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.987136 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-config\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.987310 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.987201 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-oauth-serving-cert\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.987310 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.987247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-trusted-ca-bundle\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.987531 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.987511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-service-ca\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.988823 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.988804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-oauth-config\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.988888 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.988809 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-serving-cert\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:08.994641 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:08.994600 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55dgm\" (UniqueName: \"kubernetes.io/projected/f03013a7-5470-4f80-a7b9-3ffc1eaca979-kube-api-access-55dgm\") pod \"console-664f5bb48-xmwmr\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:09.085532 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:09.085506 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:09.355671 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:09.355635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664f5bb48-xmwmr"] Sep 10 02:35:09.358354 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:35:09.358313 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03013a7_5470_4f80_a7b9_3ffc1eaca979.slice/crio-b773178d85443237aafd03188b7dc6842419212f6c42855c71b0d068d4fb25d4 WatchSource:0}: Error finding container b773178d85443237aafd03188b7dc6842419212f6c42855c71b0d068d4fb25d4: Status 404 returned error can't find the container with id b773178d85443237aafd03188b7dc6842419212f6c42855c71b0d068d4fb25d4 Sep 10 02:35:09.404778 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:09.404752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f5bb48-xmwmr" event={"ID":"f03013a7-5470-4f80-a7b9-3ffc1eaca979","Type":"ContainerStarted","Data":"b773178d85443237aafd03188b7dc6842419212f6c42855c71b0d068d4fb25d4"} Sep 10 02:35:10.409889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:10.409850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f5bb48-xmwmr" event={"ID":"f03013a7-5470-4f80-a7b9-3ffc1eaca979","Type":"ContainerStarted","Data":"d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669"} Sep 10 02:35:10.428137 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:10.428081 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664f5bb48-xmwmr" podStartSLOduration=2.428042901 podStartE2EDuration="2.428042901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:10.427113407 +0000 UTC m=+90.098754448" watchObservedRunningTime="2026-09-10 02:35:10.428042901 +0000 UTC m=+90.099683946" Sep 10 02:35:15.591031 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:15.590991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:35:15.591505 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:15.591055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:35:19.086694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.086660 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:19.087074 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.086808 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:19.091612 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.091591 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:19.447125 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.447049 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:35:19.490982 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.490950 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdb9f6b-dmztm"] Sep 10 02:35:19.918317 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.918287 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/init-config-reloader/0.log" Sep 10 02:35:19.934666 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:19.934642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/alertmanager/0.log" Sep 10 02:35:20.082045 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:20.081994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/config-reloader/0.log" Sep 10 02:35:20.281998 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:20.281923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/kube-rbac-proxy-web/0.log" Sep 10 02:35:20.480013 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:20.479981 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/kube-rbac-proxy/0.log" Sep 10 02:35:20.681093 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:20.681064 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/kube-rbac-proxy-metric/0.log" Sep 10 02:35:20.880666 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:20.880642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1aba1910-b939-4942-9140-d8fa032853a7/prom-label-proxy/0.log" Sep 10 02:35:21.880828 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:21.880796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6bcc645f85-rrwpj_9b78f9f1-5339-4f7a-a9b2-59618963c008/metrics-server/0.log" Sep 10 02:35:22.080544 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:22.080515 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-s7bh6_f7dd9168-51b1-46e9-83b5-1d2899045e94/monitoring-plugin/0.log" Sep 10 02:35:23.317654 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:23.317625 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5bxb6" Sep 10 02:35:23.480580 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:23.480547 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p648w_7358d723-4fde-4241-9afe-16fed2c6e8e6/init-textfile/0.log" Sep 10 02:35:23.681739 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:23.681667 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p648w_7358d723-4fde-4241-9afe-16fed2c6e8e6/node-exporter/0.log" Sep 10 02:35:23.881003 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:23.880974 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p648w_7358d723-4fde-4241-9afe-16fed2c6e8e6/kube-rbac-proxy/0.log" Sep 10 02:35:26.680446 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:26.680421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-688c4dc5b9-qkn4s_c92ffe5b-b286-46e4-a8b6-c8e402e48ad1/telemeter-client/0.log" Sep 10 02:35:26.880567 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:26.880542 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-688c4dc5b9-qkn4s_c92ffe5b-b286-46e4-a8b6-c8e402e48ad1/reload/0.log" Sep 10 02:35:27.081263 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:27.081230 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-688c4dc5b9-qkn4s_c92ffe5b-b286-46e4-a8b6-c8e402e48ad1/kube-rbac-proxy/0.log" Sep 10 02:35:29.082590 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:29.082564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cdb9f6b-dmztm_42a18e7f-5bdf-470d-afe4-a1c79c7837d9/console/0.log" Sep 10 02:35:29.282883 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:29.282846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-664f5bb48-xmwmr_f03013a7-5470-4f80-a7b9-3ffc1eaca979/console/0.log" Sep 10 02:35:35.596149 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:35.596118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:35:35.599924 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:35.599903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6bcc645f85-rrwpj" Sep 10 02:35:44.510680 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.510608 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cdb9f6b-dmztm" podUID="42a18e7f-5bdf-470d-afe4-a1c79c7837d9" containerName="console" containerID="cri-o://155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914" gracePeriod=15 Sep 10 02:35:44.743508 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.743484 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:35:44.844442 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844416 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-oauth-serving-cert\") pod \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " Sep 10 02:35:44.844610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844448 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-service-ca\") pod \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " Sep 10 02:35:44.844610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844466 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-serving-cert\") pod \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " Sep 10 02:35:44.844610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844481 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-oauth-config\") pod \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " Sep 10 02:35:44.844610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844496 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnc5c\" (UniqueName: \"kubernetes.io/projected/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-kube-api-access-wnc5c\") pod \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " Sep 10 02:35:44.844610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844544 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-config\") pod \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\" (UID: \"42a18e7f-5bdf-470d-afe4-a1c79c7837d9\") " Sep 10 02:35:44.844939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844911 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42a18e7f-5bdf-470d-afe4-a1c79c7837d9" (UID: "42a18e7f-5bdf-470d-afe4-a1c79c7837d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:35:44.845039 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844918 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "42a18e7f-5bdf-470d-afe4-a1c79c7837d9" (UID: "42a18e7f-5bdf-470d-afe4-a1c79c7837d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:35:44.845039 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.844989 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-config" (OuterVolumeSpecName: "console-config") pod "42a18e7f-5bdf-470d-afe4-a1c79c7837d9" (UID: "42a18e7f-5bdf-470d-afe4-a1c79c7837d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:35:44.847066 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.847029 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-kube-api-access-wnc5c" (OuterVolumeSpecName: "kube-api-access-wnc5c") pod "42a18e7f-5bdf-470d-afe4-a1c79c7837d9" (UID: "42a18e7f-5bdf-470d-afe4-a1c79c7837d9"). InnerVolumeSpecName "kube-api-access-wnc5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:35:44.847281 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.847250 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42a18e7f-5bdf-470d-afe4-a1c79c7837d9" (UID: "42a18e7f-5bdf-470d-afe4-a1c79c7837d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:35:44.847335 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.847290 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42a18e7f-5bdf-470d-afe4-a1c79c7837d9" (UID: "42a18e7f-5bdf-470d-afe4-a1c79c7837d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:35:44.945900 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.945878 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-oauth-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:35:44.945900 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.945897 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:35:44.946014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.945906 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:35:44.946014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.945915 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-oauth-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:35:44.946014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.945924 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnc5c\" (UniqueName: \"kubernetes.io/projected/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-kube-api-access-wnc5c\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:35:44.946014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:44.945932 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a18e7f-5bdf-470d-afe4-a1c79c7837d9-console-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:35:45.538174 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.538143 2576 generic.go:356] "Generic (PLEG): container finished" podID="42a18e7f-5bdf-470d-afe4-a1c79c7837d9" containerID="155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914" exitCode=0 Sep 10 02:35:45.538586 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.538198 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdb9f6b-dmztm" Sep 10 02:35:45.538586 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.538211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdb9f6b-dmztm" event={"ID":"42a18e7f-5bdf-470d-afe4-a1c79c7837d9","Type":"ContainerDied","Data":"155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914"} Sep 10 02:35:45.538586 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.538258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdb9f6b-dmztm" event={"ID":"42a18e7f-5bdf-470d-afe4-a1c79c7837d9","Type":"ContainerDied","Data":"0181a0350e12255e5afa81a99ff32fb94d1b96c509b48bb3e3aabbee12e324ac"} Sep 10 02:35:45.538586 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.538288 2576 scope.go:117] "RemoveContainer" containerID="155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914" Sep 10 02:35:45.547337 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.547322 2576 scope.go:117] "RemoveContainer" containerID="155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914" Sep 10 02:35:45.547604 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:35:45.547585 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914\": container with ID starting with 155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914 not found: ID does not exist" containerID="155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914" Sep 10 02:35:45.547651 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.547614 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914"} err="failed to get container status \"155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914\": rpc error: code = NotFound desc = could not find container \"155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914\": container with ID starting with 155c1db74a8f169560de8391202730874a2a2c24c246f78122d2d54a6460f914 not found: ID does not exist" Sep 10 02:35:45.558056 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.558036 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdb9f6b-dmztm"] Sep 10 02:35:45.562761 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:45.562740 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cdb9f6b-dmztm"] Sep 10 02:35:46.815927 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:35:46.815893 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a18e7f-5bdf-470d-afe4-a1c79c7837d9" path="/var/lib/kubelet/pods/42a18e7f-5bdf-470d-afe4-a1c79c7837d9/volumes" Sep 10 02:36:11.301569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301533 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:36:11.301964 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301782 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="alertmanager" containerID="cri-o://00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd" gracePeriod=120 Sep 10 02:36:11.301964 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301875 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-web" containerID="cri-o://897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782" gracePeriod=120 Sep 10 02:36:11.301964 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301868 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-metric" containerID="cri-o://2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf" gracePeriod=120 Sep 10 02:36:11.301964 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301907 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="config-reloader" containerID="cri-o://9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac" gracePeriod=120 Sep 10 02:36:11.301964 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301875 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy" containerID="cri-o://0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5" gracePeriod=120 Sep 10 02:36:11.302273 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.301970 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="prom-label-proxy" containerID="cri-o://744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19" gracePeriod=120 Sep 10 02:36:11.641752 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641724 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19" exitCode=0 Sep 10 02:36:11.641752 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641749 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5" exitCode=0 Sep 10 02:36:11.641752 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641756 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac" exitCode=0 Sep 10 02:36:11.641949 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641761 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd" exitCode=0 Sep 10 02:36:11.641949 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19"} Sep 10 02:36:11.641949 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5"} Sep 10 02:36:11.641949 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac"} Sep 10 02:36:11.641949 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:11.641934 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd"} Sep 10 02:36:12.547580 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.547560 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:12.637118 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-cluster-tls-config\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637118 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-trusted-ca-bundle\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637129 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637195 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-main-tls\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637240 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-config-volume\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637274 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-config-out\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637552 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637428 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-web-config\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637552 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637480 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p62q\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-kube-api-access-5p62q\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637552 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637430 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:12.637552 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-metrics-client-ca\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637552 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637534 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637565 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637598 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-main-db\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.637813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637622 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-tls-assets\") pod \"1aba1910-b939-4942-9140-d8fa032853a7\" (UID: \"1aba1910-b939-4942-9140-d8fa032853a7\") " Sep 10 02:36:12.638134 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.637856 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.639805 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.639773 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:36:12.640271 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.640232 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-config-volume" (OuterVolumeSpecName: "config-volume") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.640417 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.640391 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:12.641248 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.641210 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-kube-api-access-5p62q" (OuterVolumeSpecName: "kube-api-access-5p62q") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "kube-api-access-5p62q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:36:12.641248 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.641226 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.641394 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.641251 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-config-out" (OuterVolumeSpecName: "config-out") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:36:12.641394 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.641253 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.641497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.641470 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:36:12.642012 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.641991 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.642171 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.642153 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.645359 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.645208 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.650146 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650122 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf" exitCode=0 Sep 10 02:36:12.650146 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650143 2576 generic.go:356] "Generic (PLEG): container finished" podID="1aba1910-b939-4942-9140-d8fa032853a7" containerID="897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782" exitCode=0 Sep 10 02:36:12.650291 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf"} Sep 10 02:36:12.650291 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650233 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:12.650291 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782"} Sep 10 02:36:12.650291 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1aba1910-b939-4942-9140-d8fa032853a7","Type":"ContainerDied","Data":"ff2fe696830acc5ab9ce3700fb965e22e4c9fc393fdb3abe81b1d859054db76b"} Sep 10 02:36:12.650424 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.650317 2576 scope.go:117] "RemoveContainer" containerID="744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19" Sep 10 02:36:12.652229 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.652205 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-web-config" (OuterVolumeSpecName: "web-config") pod "1aba1910-b939-4942-9140-d8fa032853a7" (UID: "1aba1910-b939-4942-9140-d8fa032853a7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:12.657650 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.657634 2576 scope.go:117] "RemoveContainer" containerID="2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf" Sep 10 02:36:12.664012 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.663998 2576 scope.go:117] "RemoveContainer" containerID="0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5" Sep 10 02:36:12.670035 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.670019 2576 scope.go:117] "RemoveContainer" containerID="897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782" Sep 10 02:36:12.676167 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.676152 2576 scope.go:117] "RemoveContainer" containerID="9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac" Sep 10 02:36:12.682671 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.682657 2576 scope.go:117] "RemoveContainer" containerID="00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd" Sep 10 02:36:12.688858 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.688840 2576 scope.go:117] "RemoveContainer" containerID="be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b" Sep 10 02:36:12.695016 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695001 2576 scope.go:117] "RemoveContainer" containerID="744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19" Sep 10 02:36:12.695282 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.695264 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19\": container with ID starting with 744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19 not found: ID does not exist" containerID="744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19" Sep 10 02:36:12.695355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695292 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19"} err="failed to get container status \"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19\": rpc error: code = NotFound desc = could not find container \"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19\": container with ID starting with 744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19 not found: ID does not exist" Sep 10 02:36:12.695355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695314 2576 scope.go:117] "RemoveContainer" containerID="2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf" Sep 10 02:36:12.695580 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.695565 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf\": container with ID starting with 2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf not found: ID does not exist" containerID="2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf" Sep 10 02:36:12.695642 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695587 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf"} err="failed to get container status \"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf\": rpc error: code = NotFound desc = could not find container \"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf\": container with ID starting with 2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf not found: ID does not exist" Sep 10 02:36:12.695642 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695606 2576 scope.go:117] "RemoveContainer" containerID="0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5" Sep 10 02:36:12.695863 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.695846 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5\": container with ID starting with 0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5 not found: ID does not exist" containerID="0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5" Sep 10 02:36:12.695900 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695868 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5"} err="failed to get container status \"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5\": rpc error: code = NotFound desc = could not find container \"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5\": container with ID starting with 0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5 not found: ID does not exist" Sep 10 02:36:12.695900 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.695883 2576 scope.go:117] "RemoveContainer" containerID="897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782" Sep 10 02:36:12.696144 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.696127 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782\": container with ID starting with 897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782 not found: ID does not exist" containerID="897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782" Sep 10 02:36:12.696222 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696151 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782"} err="failed to get container status \"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782\": rpc error: code = NotFound desc = could not find container \"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782\": container with ID starting with 897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782 not found: ID does not exist" Sep 10 02:36:12.696222 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696174 2576 scope.go:117] "RemoveContainer" containerID="9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac" Sep 10 02:36:12.696439 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.696422 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac\": container with ID starting with 9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac not found: ID does not exist" containerID="9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac" Sep 10 02:36:12.696478 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696443 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac"} err="failed to get container status \"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac\": rpc error: code = NotFound desc = could not find container \"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac\": container with ID starting with 9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac not found: ID does not exist" Sep 10 02:36:12.696478 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696457 2576 scope.go:117] "RemoveContainer" containerID="00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd" Sep 10 02:36:12.696719 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.696701 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd\": container with ID starting with 00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd not found: ID does not exist" containerID="00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd" Sep 10 02:36:12.696769 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696722 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd"} err="failed to get container status \"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd\": rpc error: code = NotFound desc = could not find container \"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd\": container with ID starting with 00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd not found: ID does not exist" Sep 10 02:36:12.696769 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696736 2576 scope.go:117] "RemoveContainer" containerID="be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b" Sep 10 02:36:12.696984 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:12.696968 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b\": container with ID starting with be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b not found: ID does not exist" containerID="be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b" Sep 10 02:36:12.697027 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.696997 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b"} err="failed to get container status \"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b\": rpc error: code = NotFound desc = could not find container \"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b\": container with ID starting with be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b not found: ID does not exist" Sep 10 02:36:12.697027 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697013 2576 scope.go:117] "RemoveContainer" containerID="744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19" Sep 10 02:36:12.697270 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697255 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19"} err="failed to get container status \"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19\": rpc error: code = NotFound desc = could not find container \"744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19\": container with ID starting with 744e6e9efe721ed928a3996597a668617c7778c1563b36b521daa029e9c9da19 not found: ID does not exist" Sep 10 02:36:12.697317 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697271 2576 scope.go:117] "RemoveContainer" containerID="2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf" Sep 10 02:36:12.697507 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697486 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf"} err="failed to get container status \"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf\": rpc error: code = NotFound desc = could not find container \"2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf\": container with ID starting with 2e52d4a619b155123f7f00dfc62599ee15d469394272e4c65e4fdba883e77adf not found: ID does not exist" Sep 10 02:36:12.697543 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697509 2576 scope.go:117] "RemoveContainer" containerID="0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5" Sep 10 02:36:12.697719 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697701 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5"} err="failed to get container status \"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5\": rpc error: code = NotFound desc = could not find container \"0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5\": container with ID starting with 0d637d2a1a84ad82b3c49864fd301afade10b0429f1eecfd472af003b206a3c5 not found: ID does not exist" Sep 10 02:36:12.697762 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697720 2576 scope.go:117] "RemoveContainer" containerID="897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782" Sep 10 02:36:12.697955 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697925 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782"} err="failed to get container status \"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782\": rpc error: code = NotFound desc = could not find container \"897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782\": container with ID starting with 897b1c88bfe01fa07140820e6bd207d2b838cbd6e7db9571ebfe0be2fb834782 not found: ID does not exist" Sep 10 02:36:12.697955 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.697946 2576 scope.go:117] "RemoveContainer" containerID="9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac" Sep 10 02:36:12.698241 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.698218 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac"} err="failed to get container status \"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac\": rpc error: code = NotFound desc = could not find container \"9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac\": container with ID starting with 9cd98ae76bf4227a26fa68a77a4ca2a23bd2a38742651b6b02bb143a9dcdfbac not found: ID does not exist" Sep 10 02:36:12.698338 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.698244 2576 scope.go:117] "RemoveContainer" containerID="00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd" Sep 10 02:36:12.698481 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.698462 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd"} err="failed to get container status \"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd\": rpc error: code = NotFound desc = could not find container \"00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd\": container with ID starting with 00a52e7f5db9e55c56df037fc2eb72524cca113f1fce3a40e61665a1cf1345fd not found: ID does not exist" Sep 10 02:36:12.698534 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.698482 2576 scope.go:117] "RemoveContainer" containerID="be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b" Sep 10 02:36:12.698684 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.698666 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b"} err="failed to get container status \"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b\": rpc error: code = NotFound desc = could not find container \"be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b\": container with ID starting with be1c2901b2eb61ed58d7afc76f503ec14ae6dc4b13bc753034ea763c1b86308b not found: ID does not exist" Sep 10 02:36:12.739056 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739035 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-web-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739056 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739054 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p62q\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-kube-api-access-5p62q\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739064 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aba1910-b939-4942-9140-d8fa032853a7-metrics-client-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739074 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739082 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739092 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-alertmanager-main-db\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739099 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1aba1910-b939-4942-9140-d8fa032853a7-tls-assets\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739107 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-cluster-tls-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739115 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739125 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-secret-alertmanager-main-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739133 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1aba1910-b939-4942-9140-d8fa032853a7-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.739155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.739140 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1aba1910-b939-4942-9140-d8fa032853a7-config-out\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:12.989171 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.989064 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:36:12.994937 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:12.994918 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:36:13.024611 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024587 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:36:13.024827 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024816 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-metric" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024829 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-metric" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024837 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="prom-label-proxy" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024842 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="prom-label-proxy" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024851 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="alertmanager" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024857 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="alertmanager" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024864 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="init-config-reloader" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024870 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="init-config-reloader" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024875 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="config-reloader" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024880 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="config-reloader" Sep 10 02:36:13.024885 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024886 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024891 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024901 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-web" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024905 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-web" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024913 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a18e7f-5bdf-470d-afe4-a1c79c7837d9" containerName="console" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024918 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a18e7f-5bdf-470d-afe4-a1c79c7837d9" containerName="console" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024955 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024962 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="config-reloader" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024969 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-metric" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024974 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="kube-rbac-proxy-web" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024979 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="alertmanager" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024984 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba1910-b939-4942-9140-d8fa032853a7" containerName="prom-label-proxy" Sep 10 02:36:13.025249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.024989 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a18e7f-5bdf-470d-afe4-a1c79c7837d9" containerName="console" Sep 10 02:36:13.028179 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.028165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.030476 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030454 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 02:36:13.030572 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 02:36:13.030572 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030508 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 02:36:13.030572 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030525 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 02:36:13.030572 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030564 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 02:36:13.030813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 02:36:13.030813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030644 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 02:36:13.031048 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.030853 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 02:36:13.031048 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.031031 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8klcx\"" Sep 10 02:36:13.036041 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.036016 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 02:36:13.043510 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.043490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:36:13.141312 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141438 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-web-config\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141438 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45694257-775a-4cc8-aad5-049a35d29427-config-out\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141438 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-config-volume\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45694257-775a-4cc8-aad5-049a35d29427-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45694257-775a-4cc8-aad5-049a35d29427-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45694257-775a-4cc8-aad5-049a35d29427-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141785 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbjz\" (UniqueName: \"kubernetes.io/projected/45694257-775a-4cc8-aad5-049a35d29427-kube-api-access-qpbjz\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141785 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45694257-775a-4cc8-aad5-049a35d29427-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.141785 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.141641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45694257-775a-4cc8-aad5-049a35d29427-config-out\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-config-volume\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242496 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45694257-775a-4cc8-aad5-049a35d29427-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242533 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45694257-775a-4cc8-aad5-049a35d29427-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242582 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242680 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45694257-775a-4cc8-aad5-049a35d29427-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242680 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbjz\" (UniqueName: \"kubernetes.io/projected/45694257-775a-4cc8-aad5-049a35d29427-kube-api-access-qpbjz\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242780 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45694257-775a-4cc8-aad5-049a35d29427-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242780 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242879 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.242879 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.242811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-web-config\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.243367 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.243277 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45694257-775a-4cc8-aad5-049a35d29427-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.243716 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.243669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45694257-775a-4cc8-aad5-049a35d29427-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.244298 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.244241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45694257-775a-4cc8-aad5-049a35d29427-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.245789 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.245736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45694257-775a-4cc8-aad5-049a35d29427-config-out\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.245969 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.245853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-config-volume\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.246113 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.246034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.246485 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.246462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.246578 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.246480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-web-config\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.246626 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.246591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.246626 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.246609 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.246696 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.246684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45694257-775a-4cc8-aad5-049a35d29427-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.247505 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.247489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45694257-775a-4cc8-aad5-049a35d29427-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.250855 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.250837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbjz\" (UniqueName: \"kubernetes.io/projected/45694257-775a-4cc8-aad5-049a35d29427-kube-api-access-qpbjz\") pod \"alertmanager-main-0\" (UID: \"45694257-775a-4cc8-aad5-049a35d29427\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.337983 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.337962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:36:13.618651 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.618421 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:36:13.620887 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:36:13.620862 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45694257_775a_4cc8_aad5_049a35d29427.slice/crio-19eceefd979e67f9434238afc53a6ef909ff3014adadfa7fb25ba1757aee30c4 WatchSource:0}: Error finding container 19eceefd979e67f9434238afc53a6ef909ff3014adadfa7fb25ba1757aee30c4: Status 404 returned error can't find the container with id 19eceefd979e67f9434238afc53a6ef909ff3014adadfa7fb25ba1757aee30c4 Sep 10 02:36:13.660337 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:13.660309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"19eceefd979e67f9434238afc53a6ef909ff3014adadfa7fb25ba1757aee30c4"} Sep 10 02:36:14.060233 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.060201 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd6c7b8c7-2s776"] Sep 10 02:36:14.062579 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.062563 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.076750 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.076727 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd6c7b8c7-2s776"] Sep 10 02:36:14.150798 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-service-ca\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.150798 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-console-config\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.150993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-oauth-config\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.150993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-serving-cert\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.150993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-trusted-ca-bundle\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.150993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-oauth-serving-cert\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.150993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.150963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79h9t\" (UniqueName: \"kubernetes.io/projected/86521152-01fe-4cdd-919a-1e4b3c101a42-kube-api-access-79h9t\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252147 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-service-ca\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252147 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-console-config\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-oauth-config\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-serving-cert\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-trusted-ca-bundle\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-oauth-serving-cert\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79h9t\" (UniqueName: \"kubernetes.io/projected/86521152-01fe-4cdd-919a-1e4b3c101a42-kube-api-access-79h9t\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.252986 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-console-config\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.253095 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.252961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-service-ca\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.253095 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.253043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-oauth-serving-cert\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.253175 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.253096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-trusted-ca-bundle\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.254781 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.254764 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-serving-cert\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.254910 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.254892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-oauth-config\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.260329 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.260313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79h9t\" (UniqueName: \"kubernetes.io/projected/86521152-01fe-4cdd-919a-1e4b3c101a42-kube-api-access-79h9t\") pod \"console-6dd6c7b8c7-2s776\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.371030 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.370961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:14.640043 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.639964 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd6c7b8c7-2s776"] Sep 10 02:36:14.643523 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:36:14.643493 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86521152_01fe_4cdd_919a_1e4b3c101a42.slice/crio-01e1f0b96bbe116ab7e6f139fea1ba3f30cc51c164ccc36788c9e02ab45e3e56 WatchSource:0}: Error finding container 01e1f0b96bbe116ab7e6f139fea1ba3f30cc51c164ccc36788c9e02ab45e3e56: Status 404 returned error can't find the container with id 01e1f0b96bbe116ab7e6f139fea1ba3f30cc51c164ccc36788c9e02ab45e3e56 Sep 10 02:36:14.666727 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.666699 2576 generic.go:356] "Generic (PLEG): container finished" podID="45694257-775a-4cc8-aad5-049a35d29427" containerID="c4a229bd8f5237ba16540f586542d517e9f5399eb0873bbb1220493043b679f5" exitCode=0 Sep 10 02:36:14.666806 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.666783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerDied","Data":"c4a229bd8f5237ba16540f586542d517e9f5399eb0873bbb1220493043b679f5"} Sep 10 02:36:14.668037 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.668012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd6c7b8c7-2s776" event={"ID":"86521152-01fe-4cdd-919a-1e4b3c101a42","Type":"ContainerStarted","Data":"01e1f0b96bbe116ab7e6f139fea1ba3f30cc51c164ccc36788c9e02ab45e3e56"} Sep 10 02:36:14.820063 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:14.820037 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aba1910-b939-4942-9140-d8fa032853a7" path="/var/lib/kubelet/pods/1aba1910-b939-4942-9140-d8fa032853a7/volumes" Sep 10 02:36:15.675613 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.675571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"0eac82d4ecfaa62a7f2da300272b71ccdb08a3a1afc32979a71cc991a0a3ebf9"} Sep 10 02:36:15.676005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.675658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"c0e6f09a68c3204fd02cb21e9cb7ad15112b6bade70eef1efe89b4c85726d509"} Sep 10 02:36:15.676005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.675696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"97a1e0625584310f080b0419c1177b049e9ce1007c8290a129ddc22320acaf82"} Sep 10 02:36:15.676005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.675720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"f86bab98b63f29cf67e90be9a3fb1a229b6a307e08aa685b5717d4bbb5bc2fcb"} Sep 10 02:36:15.676005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.675752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"bf8d38de4ca5440676e45713175f6feee3ad646dc86208146d38661d37255668"} Sep 10 02:36:15.676005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.675780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45694257-775a-4cc8-aad5-049a35d29427","Type":"ContainerStarted","Data":"f220c7f74022fc3d9e06ab37f7065d74663d562decdb0245816cf6ea181a0df3"} Sep 10 02:36:15.677339 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.677314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd6c7b8c7-2s776" event={"ID":"86521152-01fe-4cdd-919a-1e4b3c101a42","Type":"ContainerStarted","Data":"94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6"} Sep 10 02:36:15.705980 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.705932 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6893173900000003 podStartE2EDuration="2.705918607s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.601217ms" isStatefulPod=false podCreationTimestamp="2026-09-10 02:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:36:15.699100498 +0000 UTC m=+155.370741542" watchObservedRunningTime="2026-09-10 02:36:15.705918607 +0000 UTC m=+155.377559650" Sep 10 02:36:15.720157 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:15.720110 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd6c7b8c7-2s776" podStartSLOduration=1.720092398 podStartE2EDuration="1.720092398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:36:15.719482694 +0000 UTC m=+155.391123739" watchObservedRunningTime="2026-09-10 02:36:15.720092398 +0000 UTC m=+155.391733443" Sep 10 02:36:24.371719 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:24.371678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:24.372236 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:24.371769 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:24.376595 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:24.376574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:24.714393 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:24.714310 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:36:24.768038 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:24.768005 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664f5bb48-xmwmr"] Sep 10 02:36:49.787951 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:49.787907 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-664f5bb48-xmwmr" podUID="f03013a7-5470-4f80-a7b9-3ffc1eaca979" containerName="console" containerID="cri-o://d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669" gracePeriod=15 Sep 10 02:36:50.016408 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.016387 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:36:50.105565 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-oauth-serving-cert\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.105693 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105579 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55dgm\" (UniqueName: \"kubernetes.io/projected/f03013a7-5470-4f80-a7b9-3ffc1eaca979-kube-api-access-55dgm\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.105693 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-service-ca\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.105693 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105656 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-trusted-ca-bundle\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.105693 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105674 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-config\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.105852 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105713 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-oauth-config\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.105852 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.105741 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-serving-cert\") pod \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\" (UID: \"f03013a7-5470-4f80-a7b9-3ffc1eaca979\") " Sep 10 02:36:50.106053 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.106013 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:50.106140 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.106086 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-config" (OuterVolumeSpecName: "console-config") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:50.106140 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.106098 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-service-ca" (OuterVolumeSpecName: "service-ca") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:50.106140 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.106109 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:50.107864 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.107844 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03013a7-5470-4f80-a7b9-3ffc1eaca979-kube-api-access-55dgm" (OuterVolumeSpecName: "kube-api-access-55dgm") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "kube-api-access-55dgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:36:50.107948 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.107923 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:50.108136 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.108117 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f03013a7-5470-4f80-a7b9-3ffc1eaca979" (UID: "f03013a7-5470-4f80-a7b9-3ffc1eaca979"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:50.206755 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206728 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-trusted-ca-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.206755 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206752 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.206889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206765 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-oauth-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.206889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206777 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f03013a7-5470-4f80-a7b9-3ffc1eaca979-console-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.206889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206790 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-oauth-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.206889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206802 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55dgm\" (UniqueName: \"kubernetes.io/projected/f03013a7-5470-4f80-a7b9-3ffc1eaca979-kube-api-access-55dgm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.206889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.206817 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f03013a7-5470-4f80-a7b9-3ffc1eaca979-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:36:50.803776 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.803738 2576 generic.go:356] "Generic (PLEG): container finished" podID="f03013a7-5470-4f80-a7b9-3ffc1eaca979" containerID="d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669" exitCode=0 Sep 10 02:36:50.804230 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.803789 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664f5bb48-xmwmr" Sep 10 02:36:50.804230 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.803803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f5bb48-xmwmr" event={"ID":"f03013a7-5470-4f80-a7b9-3ffc1eaca979","Type":"ContainerDied","Data":"d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669"} Sep 10 02:36:50.804230 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.803855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664f5bb48-xmwmr" event={"ID":"f03013a7-5470-4f80-a7b9-3ffc1eaca979","Type":"ContainerDied","Data":"b773178d85443237aafd03188b7dc6842419212f6c42855c71b0d068d4fb25d4"} Sep 10 02:36:50.804230 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.803882 2576 scope.go:117] "RemoveContainer" containerID="d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669" Sep 10 02:36:50.814569 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.814454 2576 scope.go:117] "RemoveContainer" containerID="d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669" Sep 10 02:36:50.814967 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:36:50.814934 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669\": container with ID starting with d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669 not found: ID does not exist" containerID="d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669" Sep 10 02:36:50.815065 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.814961 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669"} err="failed to get container status \"d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669\": rpc error: code = NotFound desc = could not find container \"d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669\": container with ID starting with d5a2cddf4e768d57d93b2b16620f1793ea336552b12021b7eaae8e08e8b4c669 not found: ID does not exist" Sep 10 02:36:50.826634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.826607 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664f5bb48-xmwmr"] Sep 10 02:36:50.830871 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:50.830848 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664f5bb48-xmwmr"] Sep 10 02:36:52.816473 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:36:52.816444 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03013a7-5470-4f80-a7b9-3ffc1eaca979" path="/var/lib/kubelet/pods/f03013a7-5470-4f80-a7b9-3ffc1eaca979/volumes" Sep 10 02:37:43.198375 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.198343 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6"] Sep 10 02:37:43.198743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.198595 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03013a7-5470-4f80-a7b9-3ffc1eaca979" containerName="console" Sep 10 02:37:43.198743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.198606 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03013a7-5470-4f80-a7b9-3ffc1eaca979" containerName="console" Sep 10 02:37:43.198743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.198643 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03013a7-5470-4f80-a7b9-3ffc1eaca979" containerName="console" Sep 10 02:37:43.203533 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.202648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.205075 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.205054 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prnmw\"" Sep 10 02:37:43.205219 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.205088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:37:43.205417 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.205402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:37:43.210388 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.210366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6"] Sep 10 02:37:43.276333 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.276308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.276432 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.276341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.276432 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.276405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hw7\" (UniqueName: \"kubernetes.io/projected/201ae7cf-f785-4b0c-a131-d0f25ca45308-kube-api-access-x5hw7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.376856 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.376834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.376956 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.376862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.376956 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.376905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hw7\" (UniqueName: \"kubernetes.io/projected/201ae7cf-f785-4b0c-a131-d0f25ca45308-kube-api-access-x5hw7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.377296 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.377274 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.377353 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.377277 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.385239 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.385218 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hw7\" (UniqueName: \"kubernetes.io/projected/201ae7cf-f785-4b0c-a131-d0f25ca45308-kube-api-access-x5hw7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.512372 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.512320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:37:43.796175 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.796088 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6"] Sep 10 02:37:43.800302 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:37:43.800268 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201ae7cf_f785_4b0c_a131_d0f25ca45308.slice/crio-ced1ccc67158e787fb66319b4cd4eb9fa6791f2030cdcab66367f21e69592133 WatchSource:0}: Error finding container ced1ccc67158e787fb66319b4cd4eb9fa6791f2030cdcab66367f21e69592133: Status 404 returned error can't find the container with id ced1ccc67158e787fb66319b4cd4eb9fa6791f2030cdcab66367f21e69592133 Sep 10 02:37:43.983865 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:43.983833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" event={"ID":"201ae7cf-f785-4b0c-a131-d0f25ca45308","Type":"ContainerStarted","Data":"ced1ccc67158e787fb66319b4cd4eb9fa6791f2030cdcab66367f21e69592133"} Sep 10 02:37:51.013115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:51.013030 2576 generic.go:356] "Generic (PLEG): container finished" podID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerID="50320ccad618dc5be3a9f8c3a87723e4dbc86cb89ba4665da7d900a37a01272d" exitCode=0 Sep 10 02:37:51.013115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:51.013076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" event={"ID":"201ae7cf-f785-4b0c-a131-d0f25ca45308","Type":"ContainerDied","Data":"50320ccad618dc5be3a9f8c3a87723e4dbc86cb89ba4665da7d900a37a01272d"} Sep 10 02:37:54.026400 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:54.026367 2576 generic.go:356] "Generic (PLEG): container finished" podID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerID="d2ed49d25fdaffd100fcd0747db4a1e9abc752344da78d12a36c9ae846689661" exitCode=0 Sep 10 02:37:54.026851 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:37:54.026453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" event={"ID":"201ae7cf-f785-4b0c-a131-d0f25ca45308","Type":"ContainerDied","Data":"d2ed49d25fdaffd100fcd0747db4a1e9abc752344da78d12a36c9ae846689661"} Sep 10 02:38:01.055212 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:01.055135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" event={"ID":"201ae7cf-f785-4b0c-a131-d0f25ca45308","Type":"ContainerStarted","Data":"573179af56bae833932cf7199769c27315d85cf577e3ec52ded76743fa66b036"} Sep 10 02:38:01.082584 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:01.082537 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" podStartSLOduration=2.2429381250000002 podStartE2EDuration="18.082520309s" totalImagesPullingTime="15.839582184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:37:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:01.080399158 +0000 UTC m=+260.752040213" watchObservedRunningTime="2026-09-10 02:38:01.082520309 +0000 UTC m=+260.754161353" Sep 10 02:38:02.061133 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:02.061038 2576 generic.go:356] "Generic (PLEG): container finished" podID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerID="573179af56bae833932cf7199769c27315d85cf577e3ec52ded76743fa66b036" exitCode=0 Sep 10 02:38:02.061491 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:02.061129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" event={"ID":"201ae7cf-f785-4b0c-a131-d0f25ca45308","Type":"ContainerDied","Data":"573179af56bae833932cf7199769c27315d85cf577e3ec52ded76743fa66b036"} Sep 10 02:38:03.231008 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.230980 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:38:03.247445 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.247425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-bundle\") pod \"201ae7cf-f785-4b0c-a131-d0f25ca45308\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " Sep 10 02:38:03.247564 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.247511 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-util\") pod \"201ae7cf-f785-4b0c-a131-d0f25ca45308\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " Sep 10 02:38:03.247564 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.247538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5hw7\" (UniqueName: \"kubernetes.io/projected/201ae7cf-f785-4b0c-a131-d0f25ca45308-kube-api-access-x5hw7\") pod \"201ae7cf-f785-4b0c-a131-d0f25ca45308\" (UID: \"201ae7cf-f785-4b0c-a131-d0f25ca45308\") " Sep 10 02:38:03.248025 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.248000 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-bundle" (OuterVolumeSpecName: "bundle") pod "201ae7cf-f785-4b0c-a131-d0f25ca45308" (UID: "201ae7cf-f785-4b0c-a131-d0f25ca45308"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:03.250474 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.250451 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/201ae7cf-f785-4b0c-a131-d0f25ca45308-kube-api-access-x5hw7" (OuterVolumeSpecName: "kube-api-access-x5hw7") pod "201ae7cf-f785-4b0c-a131-d0f25ca45308" (UID: "201ae7cf-f785-4b0c-a131-d0f25ca45308"). InnerVolumeSpecName "kube-api-access-x5hw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:38:03.252557 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.252536 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-util" (OuterVolumeSpecName: "util") pod "201ae7cf-f785-4b0c-a131-d0f25ca45308" (UID: "201ae7cf-f785-4b0c-a131-d0f25ca45308"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:03.348344 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.348295 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:03.348344 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.348314 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5hw7\" (UniqueName: \"kubernetes.io/projected/201ae7cf-f785-4b0c-a131-d0f25ca45308-kube-api-access-x5hw7\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:03.348344 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:03.348325 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/201ae7cf-f785-4b0c-a131-d0f25ca45308-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:04.070926 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:04.070902 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" Sep 10 02:38:04.071075 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:04.070903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540brld6" event={"ID":"201ae7cf-f785-4b0c-a131-d0f25ca45308","Type":"ContainerDied","Data":"ced1ccc67158e787fb66319b4cd4eb9fa6791f2030cdcab66367f21e69592133"} Sep 10 02:38:04.071075 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:04.071016 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ced1ccc67158e787fb66319b4cd4eb9fa6791f2030cdcab66367f21e69592133" Sep 10 02:38:11.275033 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275004 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb"] Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="pull" Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275338 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="pull" Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275349 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="util" Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275359 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="util" Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275375 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="extract" Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275381 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="extract" Sep 10 02:38:11.275431 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.275423 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="201ae7cf-f785-4b0c-a131-d0f25ca45308" containerName="extract" Sep 10 02:38:11.277387 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.277371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.279776 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.279743 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jbwd2\"" Sep 10 02:38:11.279905 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.279773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 02:38:11.279905 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.279793 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:38:11.294447 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.294425 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb"] Sep 10 02:38:11.298737 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.298716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8bc0ad1-af63-4ed8-b84b-7eea5aea1352-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-db2rb\" (UID: \"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.298854 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.298799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rlf\" (UniqueName: \"kubernetes.io/projected/b8bc0ad1-af63-4ed8-b84b-7eea5aea1352-kube-api-access-f9rlf\") pod \"cert-manager-operator-controller-manager-55c444bf86-db2rb\" (UID: \"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.399860 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.399835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rlf\" (UniqueName: \"kubernetes.io/projected/b8bc0ad1-af63-4ed8-b84b-7eea5aea1352-kube-api-access-f9rlf\") pod \"cert-manager-operator-controller-manager-55c444bf86-db2rb\" (UID: \"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.399963 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.399884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8bc0ad1-af63-4ed8-b84b-7eea5aea1352-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-db2rb\" (UID: \"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.400206 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.400171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8bc0ad1-af63-4ed8-b84b-7eea5aea1352-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-db2rb\" (UID: \"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.408503 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.408477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rlf\" (UniqueName: \"kubernetes.io/projected/b8bc0ad1-af63-4ed8-b84b-7eea5aea1352-kube-api-access-f9rlf\") pod \"cert-manager-operator-controller-manager-55c444bf86-db2rb\" (UID: \"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.585628 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.585600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" Sep 10 02:38:11.862038 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:11.861970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb"] Sep 10 02:38:11.865056 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:11.865026 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8bc0ad1_af63_4ed8_b84b_7eea5aea1352.slice/crio-54268d74d7bb045d5e602d533ed7dba6989bf5b3fa4f9d715dabf4e29dea33bb WatchSource:0}: Error finding container 54268d74d7bb045d5e602d533ed7dba6989bf5b3fa4f9d715dabf4e29dea33bb: Status 404 returned error can't find the container with id 54268d74d7bb045d5e602d533ed7dba6989bf5b3fa4f9d715dabf4e29dea33bb Sep 10 02:38:12.100463 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:12.100430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" event={"ID":"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352","Type":"ContainerStarted","Data":"54268d74d7bb045d5e602d533ed7dba6989bf5b3fa4f9d715dabf4e29dea33bb"} Sep 10 02:38:14.112724 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:14.112652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" event={"ID":"b8bc0ad1-af63-4ed8-b84b-7eea5aea1352","Type":"ContainerStarted","Data":"43f11b07c849ae5cbb02a8a1ed765bdf9af6a32d8c343a4b6e2fe44e8c493edb"} Sep 10 02:38:14.134155 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:14.134076 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-db2rb" podStartSLOduration=1.138135038 podStartE2EDuration="3.134056877s" totalImagesPullingTime="1.995921839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:14.133222452 +0000 UTC m=+273.804863500" watchObservedRunningTime="2026-09-10 02:38:14.134056877 +0000 UTC m=+273.805697921" Sep 10 02:38:15.358323 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.358292 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr"] Sep 10 02:38:15.360597 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.360580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.362688 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.362668 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:38:15.362806 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.362692 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:38:15.363158 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.363130 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prnmw\"" Sep 10 02:38:15.370343 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.370323 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr"] Sep 10 02:38:15.429313 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.429289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb9jd\" (UniqueName: \"kubernetes.io/projected/8984202e-79db-4187-8371-8a84f04f3f3c-kube-api-access-qb9jd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.429426 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.429337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.429426 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.429360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.530609 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.530570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb9jd\" (UniqueName: \"kubernetes.io/projected/8984202e-79db-4187-8371-8a84f04f3f3c-kube-api-access-qb9jd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.530736 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.530628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.530736 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.530650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.530973 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.530959 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.531032 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.531015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.538540 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.538514 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb9jd\" (UniqueName: \"kubernetes.io/projected/8984202e-79db-4187-8371-8a84f04f3f3c-kube-api-access-qb9jd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.669915 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.669834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:15.943650 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:15.943572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr"] Sep 10 02:38:15.946627 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:15.946602 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8984202e_79db_4187_8371_8a84f04f3f3c.slice/crio-b37975ec1319ed413a62279dab3699d9e70ef89de8c93fcc7ad56b1996d1dcfa WatchSource:0}: Error finding container b37975ec1319ed413a62279dab3699d9e70ef89de8c93fcc7ad56b1996d1dcfa: Status 404 returned error can't find the container with id b37975ec1319ed413a62279dab3699d9e70ef89de8c93fcc7ad56b1996d1dcfa Sep 10 02:38:16.122958 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:16.122924 2576 generic.go:356] "Generic (PLEG): container finished" podID="8984202e-79db-4187-8371-8a84f04f3f3c" containerID="ab390f15d8bda2781623016c8a45710c5baf1eec2f8671ad4219ebdb8df15850" exitCode=0 Sep 10 02:38:16.123086 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:16.122973 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" event={"ID":"8984202e-79db-4187-8371-8a84f04f3f3c","Type":"ContainerDied","Data":"ab390f15d8bda2781623016c8a45710c5baf1eec2f8671ad4219ebdb8df15850"} Sep 10 02:38:16.123086 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:16.123021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" event={"ID":"8984202e-79db-4187-8371-8a84f04f3f3c","Type":"ContainerStarted","Data":"b37975ec1319ed413a62279dab3699d9e70ef89de8c93fcc7ad56b1996d1dcfa"} Sep 10 02:38:18.139649 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:18.139614 2576 generic.go:356] "Generic (PLEG): container finished" podID="8984202e-79db-4187-8371-8a84f04f3f3c" containerID="1f17e006bdd6b9213dfd5601be85cb2731dbe81c4dea4d2fdfa261e7ffc3cb57" exitCode=0 Sep 10 02:38:18.140000 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:18.139694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" event={"ID":"8984202e-79db-4187-8371-8a84f04f3f3c","Type":"ContainerDied","Data":"1f17e006bdd6b9213dfd5601be85cb2731dbe81c4dea4d2fdfa261e7ffc3cb57"} Sep 10 02:38:19.145730 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:19.145699 2576 generic.go:356] "Generic (PLEG): container finished" podID="8984202e-79db-4187-8371-8a84f04f3f3c" containerID="32fdd327e8b18fee49bf8e4f1ec71945678e555c4109a7ceec7d3f1df77310b3" exitCode=0 Sep 10 02:38:19.146097 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:19.145787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" event={"ID":"8984202e-79db-4187-8371-8a84f04f3f3c","Type":"ContainerDied","Data":"32fdd327e8b18fee49bf8e4f1ec71945678e555c4109a7ceec7d3f1df77310b3"} Sep 10 02:38:20.265354 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.265328 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:20.366317 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.366290 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb9jd\" (UniqueName: \"kubernetes.io/projected/8984202e-79db-4187-8371-8a84f04f3f3c-kube-api-access-qb9jd\") pod \"8984202e-79db-4187-8371-8a84f04f3f3c\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " Sep 10 02:38:20.366463 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.366364 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-util\") pod \"8984202e-79db-4187-8371-8a84f04f3f3c\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " Sep 10 02:38:20.366463 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.366419 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-bundle\") pod \"8984202e-79db-4187-8371-8a84f04f3f3c\" (UID: \"8984202e-79db-4187-8371-8a84f04f3f3c\") " Sep 10 02:38:20.366828 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.366799 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-bundle" (OuterVolumeSpecName: "bundle") pod "8984202e-79db-4187-8371-8a84f04f3f3c" (UID: "8984202e-79db-4187-8371-8a84f04f3f3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:20.368404 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.368379 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8984202e-79db-4187-8371-8a84f04f3f3c-kube-api-access-qb9jd" (OuterVolumeSpecName: "kube-api-access-qb9jd") pod "8984202e-79db-4187-8371-8a84f04f3f3c" (UID: "8984202e-79db-4187-8371-8a84f04f3f3c"). InnerVolumeSpecName "kube-api-access-qb9jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:38:20.372144 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.372113 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-util" (OuterVolumeSpecName: "util") pod "8984202e-79db-4187-8371-8a84f04f3f3c" (UID: "8984202e-79db-4187-8371-8a84f04f3f3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:20.467497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.467437 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:20.467497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.467463 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb9jd\" (UniqueName: \"kubernetes.io/projected/8984202e-79db-4187-8371-8a84f04f3f3c-kube-api-access-qb9jd\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:20.467497 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:20.467473 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8984202e-79db-4187-8371-8a84f04f3f3c-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:21.155929 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.155857 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" Sep 10 02:38:21.156065 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.155857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxn5sr" event={"ID":"8984202e-79db-4187-8371-8a84f04f3f3c","Type":"ContainerDied","Data":"b37975ec1319ed413a62279dab3699d9e70ef89de8c93fcc7ad56b1996d1dcfa"} Sep 10 02:38:21.156065 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.155979 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b37975ec1319ed413a62279dab3699d9e70ef89de8c93fcc7ad56b1996d1dcfa" Sep 10 02:38:21.452004 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.451931 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt"] Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452199 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="extract" Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452215 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="extract" Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452234 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="util" Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452242 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="util" Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452256 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="pull" Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452261 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="pull" Sep 10 02:38:21.452355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.452305 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8984202e-79db-4187-8371-8a84f04f3f3c" containerName="extract" Sep 10 02:38:21.454181 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.454163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.456121 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.456102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 02:38:21.456310 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.456295 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 02:38:21.456424 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.456408 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4526f\"" Sep 10 02:38:21.461927 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.461906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt"] Sep 10 02:38:21.475833 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.475669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14769aa-c40f-4f83-a463-f780a5c4afe3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nsrkt\" (UID: \"b14769aa-c40f-4f83-a463-f780a5c4afe3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.475833 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.475757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvk5x\" (UniqueName: \"kubernetes.io/projected/b14769aa-c40f-4f83-a463-f780a5c4afe3-kube-api-access-qvk5x\") pod \"cert-manager-cainjector-559cdd8c87-nsrkt\" (UID: \"b14769aa-c40f-4f83-a463-f780a5c4afe3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.576652 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.576622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14769aa-c40f-4f83-a463-f780a5c4afe3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nsrkt\" (UID: \"b14769aa-c40f-4f83-a463-f780a5c4afe3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.576791 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.576676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvk5x\" (UniqueName: \"kubernetes.io/projected/b14769aa-c40f-4f83-a463-f780a5c4afe3-kube-api-access-qvk5x\") pod \"cert-manager-cainjector-559cdd8c87-nsrkt\" (UID: \"b14769aa-c40f-4f83-a463-f780a5c4afe3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.585164 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.585134 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14769aa-c40f-4f83-a463-f780a5c4afe3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nsrkt\" (UID: \"b14769aa-c40f-4f83-a463-f780a5c4afe3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.585663 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.585647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvk5x\" (UniqueName: \"kubernetes.io/projected/b14769aa-c40f-4f83-a463-f780a5c4afe3-kube-api-access-qvk5x\") pod \"cert-manager-cainjector-559cdd8c87-nsrkt\" (UID: \"b14769aa-c40f-4f83-a463-f780a5c4afe3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:21.778825 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:21.778764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" Sep 10 02:38:22.044640 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:22.044616 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt"] Sep 10 02:38:22.047078 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:22.047048 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb14769aa_c40f_4f83_a463_f780a5c4afe3.slice/crio-3acd0d7c591227f488d01e770f094afd52a11a3f02c0033404b6e1d6bc536b28 WatchSource:0}: Error finding container 3acd0d7c591227f488d01e770f094afd52a11a3f02c0033404b6e1d6bc536b28: Status 404 returned error can't find the container with id 3acd0d7c591227f488d01e770f094afd52a11a3f02c0033404b6e1d6bc536b28 Sep 10 02:38:22.161321 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:22.161294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" event={"ID":"b14769aa-c40f-4f83-a463-f780a5c4afe3","Type":"ContainerStarted","Data":"3acd0d7c591227f488d01e770f094afd52a11a3f02c0033404b6e1d6bc536b28"} Sep 10 02:38:23.049636 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.049603 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v7hvx"] Sep 10 02:38:23.057470 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.057446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.059498 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.059477 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qldl8\"" Sep 10 02:38:23.062168 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.062144 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v7hvx"] Sep 10 02:38:23.086659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.086634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqsf6\" (UniqueName: \"kubernetes.io/projected/16e3d983-297a-4f55-9d61-8b03c388cf2d-kube-api-access-hqsf6\") pod \"cert-manager-webhook-6486ffd997-v7hvx\" (UID: \"16e3d983-297a-4f55-9d61-8b03c388cf2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.086761 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.086676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e3d983-297a-4f55-9d61-8b03c388cf2d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v7hvx\" (UID: \"16e3d983-297a-4f55-9d61-8b03c388cf2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.187322 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.187299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqsf6\" (UniqueName: \"kubernetes.io/projected/16e3d983-297a-4f55-9d61-8b03c388cf2d-kube-api-access-hqsf6\") pod \"cert-manager-webhook-6486ffd997-v7hvx\" (UID: \"16e3d983-297a-4f55-9d61-8b03c388cf2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.187428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.187349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e3d983-297a-4f55-9d61-8b03c388cf2d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v7hvx\" (UID: \"16e3d983-297a-4f55-9d61-8b03c388cf2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.197564 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.197537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e3d983-297a-4f55-9d61-8b03c388cf2d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v7hvx\" (UID: \"16e3d983-297a-4f55-9d61-8b03c388cf2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.197710 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.197691 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqsf6\" (UniqueName: \"kubernetes.io/projected/16e3d983-297a-4f55-9d61-8b03c388cf2d-kube-api-access-hqsf6\") pod \"cert-manager-webhook-6486ffd997-v7hvx\" (UID: \"16e3d983-297a-4f55-9d61-8b03c388cf2d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.367642 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.367613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:23.665828 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:23.665756 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v7hvx"] Sep 10 02:38:23.669510 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:23.669484 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16e3d983_297a_4f55_9d61_8b03c388cf2d.slice/crio-a52673200a5be732b2e979cc5af0bf4350393b877f692e813eccde03a5846e40 WatchSource:0}: Error finding container a52673200a5be732b2e979cc5af0bf4350393b877f692e813eccde03a5846e40: Status 404 returned error can't find the container with id a52673200a5be732b2e979cc5af0bf4350393b877f692e813eccde03a5846e40 Sep 10 02:38:24.170701 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:24.170666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" event={"ID":"16e3d983-297a-4f55-9d61-8b03c388cf2d","Type":"ContainerStarted","Data":"a52673200a5be732b2e979cc5af0bf4350393b877f692e813eccde03a5846e40"} Sep 10 02:38:25.222505 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.222470 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x8l84"] Sep 10 02:38:25.225014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.224991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.227264 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.227173 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5w2h2\"" Sep 10 02:38:25.237173 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.237127 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x8l84"] Sep 10 02:38:25.303712 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.303584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3e793de-1715-40f4-8693-0f6dbfbbaef9-bound-sa-token\") pod \"cert-manager-55b4d954d5-x8l84\" (UID: \"a3e793de-1715-40f4-8693-0f6dbfbbaef9\") " pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.303712 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.303655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ftvs\" (UniqueName: \"kubernetes.io/projected/a3e793de-1715-40f4-8693-0f6dbfbbaef9-kube-api-access-4ftvs\") pod \"cert-manager-55b4d954d5-x8l84\" (UID: \"a3e793de-1715-40f4-8693-0f6dbfbbaef9\") " pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.404168 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.404134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3e793de-1715-40f4-8693-0f6dbfbbaef9-bound-sa-token\") pod \"cert-manager-55b4d954d5-x8l84\" (UID: \"a3e793de-1715-40f4-8693-0f6dbfbbaef9\") " pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.404365 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.404206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ftvs\" (UniqueName: \"kubernetes.io/projected/a3e793de-1715-40f4-8693-0f6dbfbbaef9-kube-api-access-4ftvs\") pod \"cert-manager-55b4d954d5-x8l84\" (UID: \"a3e793de-1715-40f4-8693-0f6dbfbbaef9\") " pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.413336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.413287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ftvs\" (UniqueName: \"kubernetes.io/projected/a3e793de-1715-40f4-8693-0f6dbfbbaef9-kube-api-access-4ftvs\") pod \"cert-manager-55b4d954d5-x8l84\" (UID: \"a3e793de-1715-40f4-8693-0f6dbfbbaef9\") " pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.413446 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.413425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3e793de-1715-40f4-8693-0f6dbfbbaef9-bound-sa-token\") pod \"cert-manager-55b4d954d5-x8l84\" (UID: \"a3e793de-1715-40f4-8693-0f6dbfbbaef9\") " pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:25.538984 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:25.538897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x8l84" Sep 10 02:38:26.624924 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:26.624850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x8l84"] Sep 10 02:38:26.628020 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:26.627994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3e793de_1715_40f4_8693_0f6dbfbbaef9.slice/crio-e25e80bf4e3a263e3912272d7b787df3f3ba025308952b6fa41655eb9a4864eb WatchSource:0}: Error finding container e25e80bf4e3a263e3912272d7b787df3f3ba025308952b6fa41655eb9a4864eb: Status 404 returned error can't find the container with id e25e80bf4e3a263e3912272d7b787df3f3ba025308952b6fa41655eb9a4864eb Sep 10 02:38:27.186844 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.186804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" event={"ID":"16e3d983-297a-4f55-9d61-8b03c388cf2d","Type":"ContainerStarted","Data":"e12ce664377a4251fda396ece72b29c50999bbc43b40dd6ca77dfdff07fb0b90"} Sep 10 02:38:27.187035 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.186901 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:27.188418 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.188396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x8l84" event={"ID":"a3e793de-1715-40f4-8693-0f6dbfbbaef9","Type":"ContainerStarted","Data":"66280ca3ff99f4cb0e25a22608dc2eb1cdc6a71efff9336c8bac2978fd30d405"} Sep 10 02:38:27.188516 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.188426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x8l84" event={"ID":"a3e793de-1715-40f4-8693-0f6dbfbbaef9","Type":"ContainerStarted","Data":"e25e80bf4e3a263e3912272d7b787df3f3ba025308952b6fa41655eb9a4864eb"} Sep 10 02:38:27.189987 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.189967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" event={"ID":"b14769aa-c40f-4f83-a463-f780a5c4afe3","Type":"ContainerStarted","Data":"94ccbc9e06d6666b9ac0c7007b89a8c69acbd7ed6c50fbb2985ede950537b8e4"} Sep 10 02:38:27.206695 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.206656 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" podStartSLOduration=1.472985151 podStartE2EDuration="4.206641854s" totalImagesPullingTime="2.733656703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:27.205550127 +0000 UTC m=+286.877191172" watchObservedRunningTime="2026-09-10 02:38:27.206641854 +0000 UTC m=+286.878282897" Sep 10 02:38:27.224289 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.224251 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nsrkt" podStartSLOduration=1.85656318 podStartE2EDuration="6.224237528s" totalImagesPullingTime="4.367674348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:27.223200464 +0000 UTC m=+286.894841503" watchObservedRunningTime="2026-09-10 02:38:27.224237528 +0000 UTC m=+286.895878573" Sep 10 02:38:27.249401 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:27.249358 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x8l84" podStartSLOduration=2.249342577 podStartE2EDuration="2.249342577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:27.248077689 +0000 UTC m=+286.919718734" watchObservedRunningTime="2026-09-10 02:38:27.249342577 +0000 UTC m=+286.920983621" Sep 10 02:38:31.531941 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.531904 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb"] Sep 10 02:38:31.535989 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.535968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.538056 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.538032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:38:31.538140 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.538076 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:38:31.538707 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.538685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prnmw\"" Sep 10 02:38:31.543341 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.543322 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb"] Sep 10 02:38:31.656054 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.656015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.656253 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.656098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.656253 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.656148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbgld\" (UniqueName: \"kubernetes.io/projected/18b69c9e-c245-40a8-93f2-088b9abddb3a-kube-api-access-mbgld\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.757301 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.757266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.757424 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.757310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbgld\" (UniqueName: \"kubernetes.io/projected/18b69c9e-c245-40a8-93f2-088b9abddb3a-kube-api-access-mbgld\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.757472 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.757427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.757681 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.757661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.757744 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.757727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.765748 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.765715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbgld\" (UniqueName: \"kubernetes.io/projected/18b69c9e-c245-40a8-93f2-088b9abddb3a-kube-api-access-mbgld\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:31.845954 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:31.845935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:32.133813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:32.133735 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb"] Sep 10 02:38:32.137036 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:32.137012 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b69c9e_c245_40a8_93f2_088b9abddb3a.slice/crio-ec08cc90c39921a15fdf970893af03d0f602e90899e2e3ee9a262eca7b4bb956 WatchSource:0}: Error finding container ec08cc90c39921a15fdf970893af03d0f602e90899e2e3ee9a262eca7b4bb956: Status 404 returned error can't find the container with id ec08cc90c39921a15fdf970893af03d0f602e90899e2e3ee9a262eca7b4bb956 Sep 10 02:38:32.211470 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:32.211438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" event={"ID":"18b69c9e-c245-40a8-93f2-088b9abddb3a","Type":"ContainerStarted","Data":"ec08cc90c39921a15fdf970893af03d0f602e90899e2e3ee9a262eca7b4bb956"} Sep 10 02:38:33.196544 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:33.196511 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v7hvx" Sep 10 02:38:33.217771 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:33.217742 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerID="0aed1ee728b60014fdf33aaa01c5d68b03e17c4ac8f5e1709446f7c48db977b3" exitCode=0 Sep 10 02:38:33.217899 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:33.217792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" event={"ID":"18b69c9e-c245-40a8-93f2-088b9abddb3a","Type":"ContainerDied","Data":"0aed1ee728b60014fdf33aaa01c5d68b03e17c4ac8f5e1709446f7c48db977b3"} Sep 10 02:38:35.228176 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:35.228140 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerID="7afeaa49d7876907cf78a8cc463f5f15a03a992e2b4009f0bad0f4bbb46e413d" exitCode=0 Sep 10 02:38:35.228548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:35.228235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" event={"ID":"18b69c9e-c245-40a8-93f2-088b9abddb3a","Type":"ContainerDied","Data":"7afeaa49d7876907cf78a8cc463f5f15a03a992e2b4009f0bad0f4bbb46e413d"} Sep 10 02:38:36.234432 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:36.234401 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerID="ed1b645a3964f5d0725b816739bf835e766045edd7986e3a080a623122ca4f28" exitCode=0 Sep 10 02:38:36.234801 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:36.234490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" event={"ID":"18b69c9e-c245-40a8-93f2-088b9abddb3a","Type":"ContainerDied","Data":"ed1b645a3964f5d0725b816739bf835e766045edd7986e3a080a623122ca4f28"} Sep 10 02:38:37.357489 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.357462 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:37.396428 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.396395 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbgld\" (UniqueName: \"kubernetes.io/projected/18b69c9e-c245-40a8-93f2-088b9abddb3a-kube-api-access-mbgld\") pod \"18b69c9e-c245-40a8-93f2-088b9abddb3a\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " Sep 10 02:38:37.396551 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.396435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-util\") pod \"18b69c9e-c245-40a8-93f2-088b9abddb3a\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " Sep 10 02:38:37.396551 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.396464 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-bundle\") pod \"18b69c9e-c245-40a8-93f2-088b9abddb3a\" (UID: \"18b69c9e-c245-40a8-93f2-088b9abddb3a\") " Sep 10 02:38:37.397128 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.397109 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-bundle" (OuterVolumeSpecName: "bundle") pod "18b69c9e-c245-40a8-93f2-088b9abddb3a" (UID: "18b69c9e-c245-40a8-93f2-088b9abddb3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:37.398593 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.398572 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b69c9e-c245-40a8-93f2-088b9abddb3a-kube-api-access-mbgld" (OuterVolumeSpecName: "kube-api-access-mbgld") pod "18b69c9e-c245-40a8-93f2-088b9abddb3a" (UID: "18b69c9e-c245-40a8-93f2-088b9abddb3a"). InnerVolumeSpecName "kube-api-access-mbgld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:38:37.464566 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.464537 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-util" (OuterVolumeSpecName: "util") pod "18b69c9e-c245-40a8-93f2-088b9abddb3a" (UID: "18b69c9e-c245-40a8-93f2-088b9abddb3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:37.497587 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.497534 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbgld\" (UniqueName: \"kubernetes.io/projected/18b69c9e-c245-40a8-93f2-088b9abddb3a-kube-api-access-mbgld\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:37.497587 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.497561 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:37.497587 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:37.497571 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18b69c9e-c245-40a8-93f2-088b9abddb3a-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:38.244486 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:38.244447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" event={"ID":"18b69c9e-c245-40a8-93f2-088b9abddb3a","Type":"ContainerDied","Data":"ec08cc90c39921a15fdf970893af03d0f602e90899e2e3ee9a262eca7b4bb956"} Sep 10 02:38:38.244486 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:38.244486 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4lhb" Sep 10 02:38:38.244723 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:38.244491 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec08cc90c39921a15fdf970893af03d0f602e90899e2e3ee9a262eca7b4bb956" Sep 10 02:38:40.697687 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:40.697659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:38:40.699806 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:40.699780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:38:40.701223 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:40.701179 2576 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 02:38:48.132032 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.131998 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz"] Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132290 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="util" Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132302 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="util" Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132311 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="pull" Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132317 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="pull" Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132331 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="extract" Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132337 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="extract" Sep 10 02:38:48.135603 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.132384 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b69c9e-c245-40a8-93f2-088b9abddb3a" containerName="extract" Sep 10 02:38:48.136886 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.136866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.139507 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.139486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:38:48.139847 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.139832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prnmw\"" Sep 10 02:38:48.140232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.140214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:38:48.145684 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.145660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz"] Sep 10 02:38:48.275342 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.275305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.275517 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.275427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.275517 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.275480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvmv\" (UniqueName: \"kubernetes.io/projected/8ebe515e-1c73-4169-85da-1a24db84677a-kube-api-access-tqvmv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.376345 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.376316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.376510 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.376351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvmv\" (UniqueName: \"kubernetes.io/projected/8ebe515e-1c73-4169-85da-1a24db84677a-kube-api-access-tqvmv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.376510 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.376389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.376813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.376796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.376848 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.376796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.384823 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.384762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvmv\" (UniqueName: \"kubernetes.io/projected/8ebe515e-1c73-4169-85da-1a24db84677a-kube-api-access-tqvmv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.446300 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.446267 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:48.728799 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:48.728679 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz"] Sep 10 02:38:48.731313 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:48.731280 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebe515e_1c73_4169_85da_1a24db84677a.slice/crio-c19747642f28548224d05db9afba068d6b7b6883819d5c75f24df089d6ce3285 WatchSource:0}: Error finding container c19747642f28548224d05db9afba068d6b7b6883819d5c75f24df089d6ce3285: Status 404 returned error can't find the container with id c19747642f28548224d05db9afba068d6b7b6883819d5c75f24df089d6ce3285 Sep 10 02:38:49.294137 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.294106 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ebe515e-1c73-4169-85da-1a24db84677a" containerID="cde171c737dda0e970ca84fb7ec2ebbca10f6c94c893338d83d908353e9cf0da" exitCode=0 Sep 10 02:38:49.294606 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.294172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" event={"ID":"8ebe515e-1c73-4169-85da-1a24db84677a","Type":"ContainerDied","Data":"cde171c737dda0e970ca84fb7ec2ebbca10f6c94c893338d83d908353e9cf0da"} Sep 10 02:38:49.294606 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.294224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" event={"ID":"8ebe515e-1c73-4169-85da-1a24db84677a","Type":"ContainerStarted","Data":"c19747642f28548224d05db9afba068d6b7b6883819d5c75f24df089d6ce3285"} Sep 10 02:38:49.294711 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.294641 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:38:49.306887 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.306860 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm"] Sep 10 02:38:49.311014 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.310993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.317094 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.317069 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 02:38:49.317232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.317091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 02:38:49.317232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.317157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rwkzf\"" Sep 10 02:38:49.317851 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.317827 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 02:38:49.333005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.332978 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 02:38:49.360940 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.360912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm"] Sep 10 02:38:49.386364 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.386329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-manifests\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.386513 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.386418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.386513 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.386476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59sc\" (UniqueName: \"kubernetes.io/projected/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-kube-api-access-z59sc\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.386614 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.386534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-tmp\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.386614 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.386558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.487871 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.487841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.487871 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.487874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z59sc\" (UniqueName: \"kubernetes.io/projected/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-kube-api-access-z59sc\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.488087 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.487911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-tmp\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.488087 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.487930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.488087 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.487957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-manifests\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.488384 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.488353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-manifests\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.490288 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.490255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-tmp\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.490673 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.490652 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.490721 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.490652 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.506443 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.506420 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59sc\" (UniqueName: \"kubernetes.io/projected/1df3b7d5-8a75-441a-92ff-dbfda1dffbc2-kube-api-access-z59sc\") pod \"opendatahub-operator-controller-manager-647784d6dd-7x7mm\" (UID: \"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.622877 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.622852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:49.623638 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.623614 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g"] Sep 10 02:38:49.627071 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.627054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.631647 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.631600 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 02:38:49.631647 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.631613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2dwg7\"" Sep 10 02:38:49.631647 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.631625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 02:38:49.631857 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.631625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:38:49.631857 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.631629 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 02:38:49.631857 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.631659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 02:38:49.646437 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.646417 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g"] Sep 10 02:38:49.690427 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.690396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-metrics-cert\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.690609 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.690456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-cert\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.690609 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.690544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89vk\" (UniqueName: \"kubernetes.io/projected/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-kube-api-access-n89vk\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.690739 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.690609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-manager-config\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.791384 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.791352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-metrics-cert\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.791504 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.791402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-cert\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.791504 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.791439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89vk\" (UniqueName: \"kubernetes.io/projected/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-kube-api-access-n89vk\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.791504 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.791482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-manager-config\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.792257 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.792223 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-manager-config\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.794001 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.793975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-metrics-cert\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.794100 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.794077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-cert\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.801879 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.801860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89vk\" (UniqueName: \"kubernetes.io/projected/38e3d787-71a9-4a6e-a0b7-fe4aa533a70e-kube-api-access-n89vk\") pod \"lws-controller-manager-748c765c7f-8p25g\" (UID: \"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:49.910037 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.910012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm"] Sep 10 02:38:49.913109 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:49.913083 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df3b7d5_8a75_441a_92ff_dbfda1dffbc2.slice/crio-3152a56407da252c1e87e01dfc69b2e12b1294a38b4e80a7842308267787a416 WatchSource:0}: Error finding container 3152a56407da252c1e87e01dfc69b2e12b1294a38b4e80a7842308267787a416: Status 404 returned error can't find the container with id 3152a56407da252c1e87e01dfc69b2e12b1294a38b4e80a7842308267787a416 Sep 10 02:38:49.944486 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:49.944469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:50.216697 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:50.216673 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g"] Sep 10 02:38:50.218967 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:38:50.218927 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e3d787_71a9_4a6e_a0b7_fe4aa533a70e.slice/crio-1919dc68b275ae636584ec6d4e001cfdda823f5ca7dae6917d86551b9a368c3e WatchSource:0}: Error finding container 1919dc68b275ae636584ec6d4e001cfdda823f5ca7dae6917d86551b9a368c3e: Status 404 returned error can't find the container with id 1919dc68b275ae636584ec6d4e001cfdda823f5ca7dae6917d86551b9a368c3e Sep 10 02:38:50.300054 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:50.300018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" event={"ID":"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2","Type":"ContainerStarted","Data":"3152a56407da252c1e87e01dfc69b2e12b1294a38b4e80a7842308267787a416"} Sep 10 02:38:50.301266 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:50.301243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" event={"ID":"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e","Type":"ContainerStarted","Data":"1919dc68b275ae636584ec6d4e001cfdda823f5ca7dae6917d86551b9a368c3e"} Sep 10 02:38:50.303172 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:50.303150 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ebe515e-1c73-4169-85da-1a24db84677a" containerID="157aec373976d5e52bab39363c8d8477282e38ef2e64c04bc01de1167cef9e7c" exitCode=0 Sep 10 02:38:50.303270 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:50.303199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" event={"ID":"8ebe515e-1c73-4169-85da-1a24db84677a","Type":"ContainerDied","Data":"157aec373976d5e52bab39363c8d8477282e38ef2e64c04bc01de1167cef9e7c"} Sep 10 02:38:51.311620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:51.311582 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ebe515e-1c73-4169-85da-1a24db84677a" containerID="bff79925b398a9fae576331a500a762c897e9d305b34f8bc496ae9818709bc1d" exitCode=0 Sep 10 02:38:51.312048 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:51.311740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" event={"ID":"8ebe515e-1c73-4169-85da-1a24db84677a","Type":"ContainerDied","Data":"bff79925b398a9fae576331a500a762c897e9d305b34f8bc496ae9818709bc1d"} Sep 10 02:38:53.210216 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.210179 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:53.323643 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.323612 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-util\") pod \"8ebe515e-1c73-4169-85da-1a24db84677a\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " Sep 10 02:38:53.323791 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.323665 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-bundle\") pod \"8ebe515e-1c73-4169-85da-1a24db84677a\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " Sep 10 02:38:53.323791 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.323720 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqvmv\" (UniqueName: \"kubernetes.io/projected/8ebe515e-1c73-4169-85da-1a24db84677a-kube-api-access-tqvmv\") pod \"8ebe515e-1c73-4169-85da-1a24db84677a\" (UID: \"8ebe515e-1c73-4169-85da-1a24db84677a\") " Sep 10 02:38:53.324435 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.324391 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-bundle" (OuterVolumeSpecName: "bundle") pod "8ebe515e-1c73-4169-85da-1a24db84677a" (UID: "8ebe515e-1c73-4169-85da-1a24db84677a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:53.324554 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.324442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" event={"ID":"8ebe515e-1c73-4169-85da-1a24db84677a","Type":"ContainerDied","Data":"c19747642f28548224d05db9afba068d6b7b6883819d5c75f24df089d6ce3285"} Sep 10 02:38:53.324554 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.324495 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c19747642f28548224d05db9afba068d6b7b6883819d5c75f24df089d6ce3285" Sep 10 02:38:53.324554 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.324547 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fkkbz" Sep 10 02:38:53.326064 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.326039 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ebe515e-1c73-4169-85da-1a24db84677a-kube-api-access-tqvmv" (OuterVolumeSpecName: "kube-api-access-tqvmv") pod "8ebe515e-1c73-4169-85da-1a24db84677a" (UID: "8ebe515e-1c73-4169-85da-1a24db84677a"). InnerVolumeSpecName "kube-api-access-tqvmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:38:53.326530 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.326507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" event={"ID":"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2","Type":"ContainerStarted","Data":"f7b4b0eef79173747bcb91d4258f712756fb7d7c2fe755fb8ebc40870ad094d7"} Sep 10 02:38:53.328344 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.328320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" event={"ID":"38e3d787-71a9-4a6e-a0b7-fe4aa533a70e","Type":"ContainerStarted","Data":"820f37bf059457e13fec8f2abd6477dcbbd203473ed7664b2c86bac4e5f4023d"} Sep 10 02:38:53.328459 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.328371 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:38:53.330102 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.330072 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-util" (OuterVolumeSpecName: "util") pod "8ebe515e-1c73-4169-85da-1a24db84677a" (UID: "8ebe515e-1c73-4169-85da-1a24db84677a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:38:53.380250 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.380199 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" podStartSLOduration=1.366714384 podStartE2EDuration="4.380162994s" totalImagesPullingTime="3.01344861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:53.377854242 +0000 UTC m=+313.049495285" watchObservedRunningTime="2026-09-10 02:38:53.380162994 +0000 UTC m=+313.051804037" Sep 10 02:38:53.424477 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.424453 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:53.424477 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.424479 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqvmv\" (UniqueName: \"kubernetes.io/projected/8ebe515e-1c73-4169-85da-1a24db84677a-kube-api-access-tqvmv\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:53.424674 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:53.424492 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebe515e-1c73-4169-85da-1a24db84677a-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:38:54.334309 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:54.334276 2576 generic.go:356] "Generic (PLEG): container finished" podID="1df3b7d5-8a75-441a-92ff-dbfda1dffbc2" containerID="f7b4b0eef79173747bcb91d4258f712756fb7d7c2fe755fb8ebc40870ad094d7" exitCode=0 Sep 10 02:38:54.334630 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:54.334352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" event={"ID":"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2","Type":"ContainerDied","Data":"f7b4b0eef79173747bcb91d4258f712756fb7d7c2fe755fb8ebc40870ad094d7"} Sep 10 02:38:55.343196 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:55.343143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" event={"ID":"1df3b7d5-8a75-441a-92ff-dbfda1dffbc2","Type":"ContainerStarted","Data":"bf737c91040c4638f669332e3088823627b67b918f8a897158e4050411d1088b"} Sep 10 02:38:55.343601 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:55.343330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:38:55.365527 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:38:55.365475 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" podStartSLOduration=1.6730022839999998 podStartE2EDuration="6.365458122s" totalImagesPullingTime="3.677246081s" totalInitContainerRuntime="1.015209757s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:55.362772719 +0000 UTC m=+315.034413763" watchObservedRunningTime="2026-09-10 02:38:55.365458122 +0000 UTC m=+315.037099239" Sep 10 02:39:04.337299 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:04.337263 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-8p25g" Sep 10 02:39:06.351365 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:06.351332 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-7x7mm" Sep 10 02:39:18.389134 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389092 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk"] Sep 10 02:39:18.389625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389550 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="util" Sep 10 02:39:18.389625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389569 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="util" Sep 10 02:39:18.389625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389578 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="extract" Sep 10 02:39:18.389625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389586 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="extract" Sep 10 02:39:18.389625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389612 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="pull" Sep 10 02:39:18.389625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389619 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="pull" Sep 10 02:39:18.389954 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.389716 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ebe515e-1c73-4169-85da-1a24db84677a" containerName="extract" Sep 10 02:39:18.392934 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.392913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.395482 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.395454 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 02:39:18.395596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.395484 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sd5xl\"" Sep 10 02:39:18.395596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.395501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 02:39:18.395596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.395493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 02:39:18.403249 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.403223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk"] Sep 10 02:39:18.419362 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419449 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419449 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csddw\" (UniqueName: \"kubernetes.io/projected/8ba230bb-6e53-4a23-9743-847606cbcbe6-kube-api-access-csddw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419574 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419574 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba230bb-6e53-4a23-9743-847606cbcbe6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419674 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419674 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419674 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.419807 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.419697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520487 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520487 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520487 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520487 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csddw\" (UniqueName: \"kubernetes.io/projected/8ba230bb-6e53-4a23-9743-847606cbcbe6-kube-api-access-csddw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba230bb-6e53-4a23-9743-847606cbcbe6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.520901 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.521011 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.520986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.521088 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.521020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.521203 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.521160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.521514 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.521493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ba230bb-6e53-4a23-9743-847606cbcbe6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.523127 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.523105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.523222 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.523157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.528376 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.528355 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csddw\" (UniqueName: \"kubernetes.io/projected/8ba230bb-6e53-4a23-9743-847606cbcbe6-kube-api-access-csddw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.528516 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.528498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ba230bb-6e53-4a23-9743-847606cbcbe6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk\" (UID: \"8ba230bb-6e53-4a23-9743-847606cbcbe6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.703396 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.703323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:18.981115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:18.981086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk"] Sep 10 02:39:18.983139 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:39:18.983112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba230bb_6e53_4a23_9743_847606cbcbe6.slice/crio-9087e3612ec8c7a08f74f4f2d9a6921c1581e2eca52cca021b9951d6ce51f7b9 WatchSource:0}: Error finding container 9087e3612ec8c7a08f74f4f2d9a6921c1581e2eca52cca021b9951d6ce51f7b9: Status 404 returned error can't find the container with id 9087e3612ec8c7a08f74f4f2d9a6921c1581e2eca52cca021b9951d6ce51f7b9 Sep 10 02:39:19.460540 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.460496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" event={"ID":"8ba230bb-6e53-4a23-9743-847606cbcbe6","Type":"ContainerStarted","Data":"9087e3612ec8c7a08f74f4f2d9a6921c1581e2eca52cca021b9951d6ce51f7b9"} Sep 10 02:39:19.624027 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.623994 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lvrbl"] Sep 10 02:39:19.627703 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.627676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:19.631202 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.630640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ct7f\" (UniqueName: \"kubernetes.io/projected/dc33103d-7473-4931-a68b-9f96f0fe339f-kube-api-access-8ct7f\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:19.631202 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.630706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:19.631202 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.631089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mqw4t\"" Sep 10 02:39:19.631805 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.631690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 02:39:19.645939 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.645887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lvrbl"] Sep 10 02:39:19.731694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.731593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ct7f\" (UniqueName: \"kubernetes.io/projected/dc33103d-7473-4931-a68b-9f96f0fe339f-kube-api-access-8ct7f\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:19.731694 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.731647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:19.731939 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:39:19.731783 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 02:39:19.731939 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:39:19.731844 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert podName:dc33103d-7473-4931-a68b-9f96f0fe339f nodeName:}" failed. No retries permitted until 2026-09-10 02:39:20.231823095 +0000 UTC m=+339.903464119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert") pod "odh-model-controller-7998c67dc4-lvrbl" (UID: "dc33103d-7473-4931-a68b-9f96f0fe339f") : secret "odh-model-controller-webhook-cert" not found Sep 10 02:39:19.742659 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:19.742606 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ct7f\" (UniqueName: \"kubernetes.io/projected/dc33103d-7473-4931-a68b-9f96f0fe339f-kube-api-access-8ct7f\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:20.185284 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.185241 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wb64c"] Sep 10 02:39:20.188819 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.188796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.193411 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.193388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 10 02:39:20.203101 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.203075 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wb64c"] Sep 10 02:39:20.235585 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.235548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8prb\" (UniqueName: \"kubernetes.io/projected/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-kube-api-access-z8prb\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.235585 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.235588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.235787 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.235623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:20.235787 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:39:20.235738 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 10 02:39:20.235787 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:39:20.235789 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert podName:dc33103d-7473-4931-a68b-9f96f0fe339f nodeName:}" failed. No retries permitted until 2026-09-10 02:39:21.235769998 +0000 UTC m=+340.907411021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert") pod "odh-model-controller-7998c67dc4-lvrbl" (UID: "dc33103d-7473-4931-a68b-9f96f0fe339f") : secret "odh-model-controller-webhook-cert" not found Sep 10 02:39:20.336169 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.336118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.336362 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.336346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8prb\" (UniqueName: \"kubernetes.io/projected/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-kube-api-access-z8prb\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.336748 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:39:20.336539 2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 10 02:39:20.336748 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:39:20.336633 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-tls-certs podName:2f12ccbd-abc5-48a5-bf80-49dd3b87249e nodeName:}" failed. No retries permitted until 2026-09-10 02:39:20.83661235 +0000 UTC m=+340.508253386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-tls-certs") pod "model-serving-api-54d89bd5fc-wb64c" (UID: "2f12ccbd-abc5-48a5-bf80-49dd3b87249e") : secret "model-serving-api-tls" not found Sep 10 02:39:20.348772 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.348743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8prb\" (UniqueName: \"kubernetes.io/projected/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-kube-api-access-z8prb\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.840891 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.840853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:20.843759 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:20.843736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f12ccbd-abc5-48a5-bf80-49dd3b87249e-tls-certs\") pod \"model-serving-api-54d89bd5fc-wb64c\" (UID: \"2f12ccbd-abc5-48a5-bf80-49dd3b87249e\") " pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:21.101297 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.101213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:21.243304 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.243264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:21.246294 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.246262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc33103d-7473-4931-a68b-9f96f0fe339f-cert\") pod \"odh-model-controller-7998c67dc4-lvrbl\" (UID: \"dc33103d-7473-4931-a68b-9f96f0fe339f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:21.446793 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.446706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:21.684529 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.684482 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 02:39:21.684645 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.684577 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 02:39:21.684645 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.684627 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 02:39:21.879369 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.879336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wb64c"] Sep 10 02:39:21.883903 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:21.883789 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lvrbl"] Sep 10 02:39:21.887113 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:39:21.887069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc33103d_7473_4931_a68b_9f96f0fe339f.slice/crio-7a4043a62c9353d74d2827eb4b6a4b35f011084f610047b5b1f294249482bddb WatchSource:0}: Error finding container 7a4043a62c9353d74d2827eb4b6a4b35f011084f610047b5b1f294249482bddb: Status 404 returned error can't find the container with id 7a4043a62c9353d74d2827eb4b6a4b35f011084f610047b5b1f294249482bddb Sep 10 02:39:22.479132 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:22.479092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" event={"ID":"2f12ccbd-abc5-48a5-bf80-49dd3b87249e","Type":"ContainerStarted","Data":"c4e01ad151afa13195978723a967d6453144c1571eef055f9d9ae7552de7b167"} Sep 10 02:39:22.480670 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:22.480632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" event={"ID":"dc33103d-7473-4931-a68b-9f96f0fe339f","Type":"ContainerStarted","Data":"7a4043a62c9353d74d2827eb4b6a4b35f011084f610047b5b1f294249482bddb"} Sep 10 02:39:22.482470 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:22.482436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" event={"ID":"8ba230bb-6e53-4a23-9743-847606cbcbe6","Type":"ContainerStarted","Data":"f1d58aca2864eaa4e3eb8d758389db510ff3ab53886f786d70beed519b6cea04"} Sep 10 02:39:22.504681 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:22.504634 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" podStartSLOduration=1.80574651 podStartE2EDuration="4.504617543s" totalImagesPullingTime="2.698871033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:39:22.503290964 +0000 UTC m=+342.174931991" watchObservedRunningTime="2026-09-10 02:39:22.504617543 +0000 UTC m=+342.176258586" Sep 10 02:39:22.704337 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:22.704300 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:22.711024 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:22.710918 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:23.488859 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:23.488820 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:23.489993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:23.489966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk" Sep 10 02:39:26.506405 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:26.506366 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" event={"ID":"dc33103d-7473-4931-a68b-9f96f0fe339f","Type":"ContainerStarted","Data":"38252c622c8d47fdde4469080e9676afafbbf52f7cc7e2be8e05f6e2074f825a"} Sep 10 02:39:26.506814 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:26.506524 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:26.508013 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:26.507989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" event={"ID":"2f12ccbd-abc5-48a5-bf80-49dd3b87249e","Type":"ContainerStarted","Data":"6cc03e70ea5ea04261d929c46d6b221eb329bed7906383604c7c59bd5efb72cb"} Sep 10 02:39:26.508139 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:26.508110 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:39:26.526337 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:26.526293 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" podStartSLOduration=3.463834625 podStartE2EDuration="7.526278999s" totalImagesPullingTime="4.062444374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:39:26.524703535 +0000 UTC m=+346.196344580" watchObservedRunningTime="2026-09-10 02:39:26.526278999 +0000 UTC m=+346.197920080" Sep 10 02:39:26.548637 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:26.548593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" podStartSLOduration=2.473115728 podStartE2EDuration="6.54857882s" totalImagesPullingTime="4.075463092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:39:26.547168009 +0000 UTC m=+346.218809050" watchObservedRunningTime="2026-09-10 02:39:26.54857882 +0000 UTC m=+346.220219864" Sep 10 02:39:28.600750 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.600715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh"] Sep 10 02:39:28.603719 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.603702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.606787 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.606763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 02:39:28.606913 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.606880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cg2z8\"" Sep 10 02:39:28.609345 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.609323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 02:39:28.609425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.609323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 02:39:28.640837 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.640811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh"] Sep 10 02:39:28.709926 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.709899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgh5k\" (UniqueName: \"kubernetes.io/projected/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-kube-api-access-pgh5k\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.710082 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.709938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.710082 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.709978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.710082 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.709996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.710082 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.710024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.710082 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.710056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.710082 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.710077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810630 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810782 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgh5k\" (UniqueName: \"kubernetes.io/projected/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-kube-api-access-pgh5k\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.810993 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.810823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.811409 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.811381 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.813423 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.813396 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.813536 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.813438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.813646 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.813626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.813706 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.813657 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.819116 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.819086 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.819299 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.819276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgh5k\" (UniqueName: \"kubernetes.io/projected/1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb-kube-api-access-pgh5k\") pod \"istiod-openshift-gateway-5677ccb49b-2n2kh\" (UID: \"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:28.912385 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:28.912299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:29.221831 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:29.221805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh"] Sep 10 02:39:29.222987 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:39:29.222958 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8b58b3_06a7_49a8_a2fd_0f3e9bda45cb.slice/crio-a76f25266614acbf9d278ddd6bf77137bc16a78351c977e79e07cedf5e546afc WatchSource:0}: Error finding container a76f25266614acbf9d278ddd6bf77137bc16a78351c977e79e07cedf5e546afc: Status 404 returned error can't find the container with id a76f25266614acbf9d278ddd6bf77137bc16a78351c977e79e07cedf5e546afc Sep 10 02:39:29.522544 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:29.522462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" event={"ID":"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb","Type":"ContainerStarted","Data":"a76f25266614acbf9d278ddd6bf77137bc16a78351c977e79e07cedf5e546afc"} Sep 10 02:39:31.667390 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:31.667350 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 02:39:31.667699 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:31.667433 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 10 02:39:32.548459 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:32.548418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" event={"ID":"1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb","Type":"ContainerStarted","Data":"46b64318cb2805f882aa5b3bd77648f05b1a02f8ddf4b071a6f83ff71ff648c7"} Sep 10 02:39:32.548673 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:32.548650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:32.550594 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:32.550569 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-2n2kh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 02:39:32.550712 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:32.550617 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" podUID="1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 02:39:32.583048 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:32.582990 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" podStartSLOduration=2.140951635 podStartE2EDuration="4.582977579s" totalImagesPullingTime="2.442025944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:39:32.582028505 +0000 UTC m=+352.253669549" watchObservedRunningTime="2026-09-10 02:39:32.582977579 +0000 UTC m=+352.254618624" Sep 10 02:39:33.554634 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:33.554602 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2n2kh" Sep 10 02:39:37.514740 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:37.514708 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lvrbl" Sep 10 02:39:37.516743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:39:37.516724 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wb64c" Sep 10 02:40:09.568131 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.568099 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cd77d4d7-ngvpp"] Sep 10 02:40:09.576336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.576315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.587686 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.587659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cd77d4d7-ngvpp"] Sep 10 02:40:09.752419 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-config\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.752419 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-oauth-config\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.752655 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-serving-cert\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.752655 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr4gf\" (UniqueName: \"kubernetes.io/projected/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-kube-api-access-pr4gf\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.752655 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-service-ca\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.752655 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-trusted-ca-bundle\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.752655 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.752585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-oauth-serving-cert\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853734 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-config\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853734 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-oauth-config\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853734 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-serving-cert\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853961 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr4gf\" (UniqueName: \"kubernetes.io/projected/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-kube-api-access-pr4gf\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853961 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-service-ca\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853961 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-trusted-ca-bundle\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.853961 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.853842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-oauth-serving-cert\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.854505 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.854480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-config\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.854588 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.854483 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-service-ca\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.854588 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.854553 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-oauth-serving-cert\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.854878 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.854855 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-trusted-ca-bundle\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.856458 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.856438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-serving-cert\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.856550 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.856475 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-console-oauth-config\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.863095 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.863073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr4gf\" (UniqueName: \"kubernetes.io/projected/15ab2dc8-823b-49bf-8ee2-95fc94bd48ca-kube-api-access-pr4gf\") pod \"console-59cd77d4d7-ngvpp\" (UID: \"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca\") " pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:09.885929 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:09.885911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:10.190920 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:10.190895 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cd77d4d7-ngvpp"] Sep 10 02:40:10.193868 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:40:10.193840 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ab2dc8_823b_49bf_8ee2_95fc94bd48ca.slice/crio-4e8b0440e8223575e55fc4e0e2071053f837b27f58a760357fcba1eeff22dfc9 WatchSource:0}: Error finding container 4e8b0440e8223575e55fc4e0e2071053f837b27f58a760357fcba1eeff22dfc9: Status 404 returned error can't find the container with id 4e8b0440e8223575e55fc4e0e2071053f837b27f58a760357fcba1eeff22dfc9 Sep 10 02:40:10.729334 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:10.729289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd77d4d7-ngvpp" event={"ID":"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca","Type":"ContainerStarted","Data":"de877bea8fe67d7106a92bd2324c81f871af536e3126f97fec5322f57271ef95"} Sep 10 02:40:10.729714 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:10.729351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cd77d4d7-ngvpp" event={"ID":"15ab2dc8-823b-49bf-8ee2-95fc94bd48ca","Type":"ContainerStarted","Data":"4e8b0440e8223575e55fc4e0e2071053f837b27f58a760357fcba1eeff22dfc9"} Sep 10 02:40:10.750022 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:10.749974 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cd77d4d7-ngvpp" podStartSLOduration=1.749958872 podStartE2EDuration="1.749958872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:40:10.748938572 +0000 UTC m=+390.420579626" watchObservedRunningTime="2026-09-10 02:40:10.749958872 +0000 UTC m=+390.421599916" Sep 10 02:40:19.886571 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:19.886524 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:19.887004 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:19.886597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:19.891477 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:19.891456 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:20.781830 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:20.781774 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cd77d4d7-ngvpp" Sep 10 02:40:20.846647 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:20.846618 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd6c7b8c7-2s776"] Sep 10 02:40:25.040571 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.040536 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx"] Sep 10 02:40:25.044444 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.044423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.046759 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.046738 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-prnmw\"" Sep 10 02:40:25.046872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.046738 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:40:25.047325 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.047310 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:40:25.053436 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.053415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx"] Sep 10 02:40:25.144998 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.144959 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8"] Sep 10 02:40:25.148546 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.148529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.156163 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.156143 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8"] Sep 10 02:40:25.180747 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.180724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.180872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.180755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.180872 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.180798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgpqr\" (UniqueName: \"kubernetes.io/projected/de308e6c-3f9a-4842-ab8a-bfe888eaed87-kube-api-access-bgpqr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.235626 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.235601 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq"] Sep 10 02:40:25.239197 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.239170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.247172 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.247154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq"] Sep 10 02:40:25.282308 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgpqr\" (UniqueName: \"kubernetes.io/projected/de308e6c-3f9a-4842-ab8a-bfe888eaed87-kube-api-access-bgpqr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m645\" (UniqueName: \"kubernetes.io/projected/c2eae546-003b-4065-9d98-2e30381d0def-kube-api-access-6m645\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.282502 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.282744 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.282813 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.282795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.290937 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.290887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgpqr\" (UniqueName: \"kubernetes.io/projected/de308e6c-3f9a-4842-ab8a-bfe888eaed87-kube-api-access-bgpqr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.342812 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.342786 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb"] Sep 10 02:40:25.350914 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.350887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.353765 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.353747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:25.355437 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.355412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb"] Sep 10 02:40:25.383235 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.383382 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m645\" (UniqueName: \"kubernetes.io/projected/c2eae546-003b-4065-9d98-2e30381d0def-kube-api-access-6m645\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.383382 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.383382 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.383555 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.383555 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvgjk\" (UniqueName: \"kubernetes.io/projected/e686da3d-1bd7-41db-8526-84389dbd7c20-kube-api-access-hvgjk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.383711 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.383767 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.383732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.392731 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.392701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m645\" (UniqueName: \"kubernetes.io/projected/c2eae546-003b-4065-9d98-2e30381d0def-kube-api-access-6m645\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.458621 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.458583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:25.485254 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d87mv\" (UniqueName: \"kubernetes.io/projected/c0308f8c-a2cc-4b9e-b751-f682df01816d-kube-api-access-d87mv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.485386 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.485386 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.485386 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.485548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.485548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvgjk\" (UniqueName: \"kubernetes.io/projected/e686da3d-1bd7-41db-8526-84389dbd7c20-kube-api-access-hvgjk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.485761 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485738 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.485816 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.485738 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.494490 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.494464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvgjk\" (UniqueName: \"kubernetes.io/projected/e686da3d-1bd7-41db-8526-84389dbd7c20-kube-api-access-hvgjk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.549266 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.549169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:25.586936 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.585932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d87mv\" (UniqueName: \"kubernetes.io/projected/c0308f8c-a2cc-4b9e-b751-f682df01816d-kube-api-access-d87mv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.586936 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.586006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.586936 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.586046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.586936 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.586519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.586936 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.586624 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.601083 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.600094 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d87mv\" (UniqueName: \"kubernetes.io/projected/c0308f8c-a2cc-4b9e-b751-f682df01816d-kube-api-access-d87mv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.632199 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:40:25.632148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde308e6c_3f9a_4842_ab8a_bfe888eaed87.slice/crio-3297b300e51f39f5ba0dca2fa1197f4bc6cc34388bff6252cc7833fe3f96369d WatchSource:0}: Error finding container 3297b300e51f39f5ba0dca2fa1197f4bc6cc34388bff6252cc7833fe3f96369d: Status 404 returned error can't find the container with id 3297b300e51f39f5ba0dca2fa1197f4bc6cc34388bff6252cc7833fe3f96369d Sep 10 02:40:25.632494 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.632468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx"] Sep 10 02:40:25.664535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.662931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:25.736919 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.735202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8"] Sep 10 02:40:25.738899 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:40:25.738696 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2eae546_003b_4065_9d98_2e30381d0def.slice/crio-4f69f932e5d3a77c184b6f26b75a1e0ea630c3563ae962ea45a23e99fabce832 WatchSource:0}: Error finding container 4f69f932e5d3a77c184b6f26b75a1e0ea630c3563ae962ea45a23e99fabce832: Status 404 returned error can't find the container with id 4f69f932e5d3a77c184b6f26b75a1e0ea630c3563ae962ea45a23e99fabce832 Sep 10 02:40:25.811828 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.811800 2576 generic.go:356] "Generic (PLEG): container finished" podID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerID="86d7a78daefce01e14ca63944d53c0f465bbe74d597e35365ee14773d6bc8346" exitCode=0 Sep 10 02:40:25.811977 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.811876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" event={"ID":"de308e6c-3f9a-4842-ab8a-bfe888eaed87","Type":"ContainerDied","Data":"86d7a78daefce01e14ca63944d53c0f465bbe74d597e35365ee14773d6bc8346"} Sep 10 02:40:25.811977 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.811925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" event={"ID":"de308e6c-3f9a-4842-ab8a-bfe888eaed87","Type":"ContainerStarted","Data":"3297b300e51f39f5ba0dca2fa1197f4bc6cc34388bff6252cc7833fe3f96369d"} Sep 10 02:40:25.813592 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.813497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" event={"ID":"c2eae546-003b-4065-9d98-2e30381d0def","Type":"ContainerStarted","Data":"4f69f932e5d3a77c184b6f26b75a1e0ea630c3563ae962ea45a23e99fabce832"} Sep 10 02:40:25.824696 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.824674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq"] Sep 10 02:40:25.831367 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:40:25.831339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode686da3d_1bd7_41db_8526_84389dbd7c20.slice/crio-b0a7acd95b422ff96a91836150a39c5a4363eae79e26ed78270ba27d2d7f554d WatchSource:0}: Error finding container b0a7acd95b422ff96a91836150a39c5a4363eae79e26ed78270ba27d2d7f554d: Status 404 returned error can't find the container with id b0a7acd95b422ff96a91836150a39c5a4363eae79e26ed78270ba27d2d7f554d Sep 10 02:40:25.971924 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:25.971805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb"] Sep 10 02:40:25.999023 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:40:25.998995 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0308f8c_a2cc_4b9e_b751_f682df01816d.slice/crio-3b3bcec876cb8ce135a14e82aea1930a59d0a171e20a05ae564e6a81dc24a004 WatchSource:0}: Error finding container 3b3bcec876cb8ce135a14e82aea1930a59d0a171e20a05ae564e6a81dc24a004: Status 404 returned error can't find the container with id 3b3bcec876cb8ce135a14e82aea1930a59d0a171e20a05ae564e6a81dc24a004 Sep 10 02:40:26.819294 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.819257 2576 generic.go:356] "Generic (PLEG): container finished" podID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerID="cd273c0f6e5fe3b44958bf7eb8d320e6c051709d4d51d36e6b82bd529ab7bd4a" exitCode=0 Sep 10 02:40:26.819699 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.819318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" event={"ID":"e686da3d-1bd7-41db-8526-84389dbd7c20","Type":"ContainerDied","Data":"cd273c0f6e5fe3b44958bf7eb8d320e6c051709d4d51d36e6b82bd529ab7bd4a"} Sep 10 02:40:26.819699 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.819362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" event={"ID":"e686da3d-1bd7-41db-8526-84389dbd7c20","Type":"ContainerStarted","Data":"b0a7acd95b422ff96a91836150a39c5a4363eae79e26ed78270ba27d2d7f554d"} Sep 10 02:40:26.820980 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.820960 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2eae546-003b-4065-9d98-2e30381d0def" containerID="543f91fba1749764e64963caddba14b80c1a432f667bdc36becd6ea88e987ef8" exitCode=0 Sep 10 02:40:26.821069 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.821048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" event={"ID":"c2eae546-003b-4065-9d98-2e30381d0def","Type":"ContainerDied","Data":"543f91fba1749764e64963caddba14b80c1a432f667bdc36becd6ea88e987ef8"} Sep 10 02:40:26.822903 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.822879 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerID="4d44dbb50dd823bc649b05ebf2c5939a3f30cade49deb677c6f90fb87d4c8608" exitCode=0 Sep 10 02:40:26.823009 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.822964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" event={"ID":"c0308f8c-a2cc-4b9e-b751-f682df01816d","Type":"ContainerDied","Data":"4d44dbb50dd823bc649b05ebf2c5939a3f30cade49deb677c6f90fb87d4c8608"} Sep 10 02:40:26.823076 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.823007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" event={"ID":"c0308f8c-a2cc-4b9e-b751-f682df01816d","Type":"ContainerStarted","Data":"3b3bcec876cb8ce135a14e82aea1930a59d0a171e20a05ae564e6a81dc24a004"} Sep 10 02:40:26.824924 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.824906 2576 generic.go:356] "Generic (PLEG): container finished" podID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerID="7361f87a9a75ec4a5d110d874e64bff1057228b64792e6a757df3878966efb91" exitCode=0 Sep 10 02:40:26.825001 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:26.824931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" event={"ID":"de308e6c-3f9a-4842-ab8a-bfe888eaed87","Type":"ContainerDied","Data":"7361f87a9a75ec4a5d110d874e64bff1057228b64792e6a757df3878966efb91"} Sep 10 02:40:27.832051 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:27.832018 2576 generic.go:356] "Generic (PLEG): container finished" podID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerID="4d6a8b9ae27ef99d1bd4cb8d493ed4d669c21c0dd6306e6b7edb942f4e06803c" exitCode=0 Sep 10 02:40:27.832373 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:27.832066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" event={"ID":"de308e6c-3f9a-4842-ab8a-bfe888eaed87","Type":"ContainerDied","Data":"4d6a8b9ae27ef99d1bd4cb8d493ed4d669c21c0dd6306e6b7edb942f4e06803c"} Sep 10 02:40:27.834031 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:27.834011 2576 generic.go:356] "Generic (PLEG): container finished" podID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerID="5cbb7424ef52c0da5325a88885adb04bffa8b0e8db7825fb17eab31fca966b56" exitCode=0 Sep 10 02:40:27.834144 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:27.834093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" event={"ID":"e686da3d-1bd7-41db-8526-84389dbd7c20","Type":"ContainerDied","Data":"5cbb7424ef52c0da5325a88885adb04bffa8b0e8db7825fb17eab31fca966b56"} Sep 10 02:40:27.836112 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:27.836091 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerID="382dc6fa6d82e298b25133f703e87a5d0d0384e82b938cd687c0917ee9e62b21" exitCode=0 Sep 10 02:40:27.836243 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:27.836125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" event={"ID":"c0308f8c-a2cc-4b9e-b751-f682df01816d","Type":"ContainerDied","Data":"382dc6fa6d82e298b25133f703e87a5d0d0384e82b938cd687c0917ee9e62b21"} Sep 10 02:40:28.843607 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.843568 2576 generic.go:356] "Generic (PLEG): container finished" podID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerID="0cb88d8256a9cf6cca992298f29c15404f371af818f5beb47f8538aceee90451" exitCode=0 Sep 10 02:40:28.843957 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.843648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" event={"ID":"e686da3d-1bd7-41db-8526-84389dbd7c20","Type":"ContainerDied","Data":"0cb88d8256a9cf6cca992298f29c15404f371af818f5beb47f8538aceee90451"} Sep 10 02:40:28.845440 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.845418 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2eae546-003b-4065-9d98-2e30381d0def" containerID="9a17bc5238d7e0705141a3501a215f848bdd00e5a0cbbb52b8d438c02358893e" exitCode=0 Sep 10 02:40:28.845547 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.845503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" event={"ID":"c2eae546-003b-4065-9d98-2e30381d0def","Type":"ContainerDied","Data":"9a17bc5238d7e0705141a3501a215f848bdd00e5a0cbbb52b8d438c02358893e"} Sep 10 02:40:28.847942 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.847922 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerID="06000bbc9718c4b157463d25f0c9736c43b96c2888429ad1bcb95d302f3a6965" exitCode=0 Sep 10 02:40:28.848034 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.848001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" event={"ID":"c0308f8c-a2cc-4b9e-b751-f682df01816d","Type":"ContainerDied","Data":"06000bbc9718c4b157463d25f0c9736c43b96c2888429ad1bcb95d302f3a6965"} Sep 10 02:40:28.981893 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:28.981868 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:29.014090 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.014069 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgpqr\" (UniqueName: \"kubernetes.io/projected/de308e6c-3f9a-4842-ab8a-bfe888eaed87-kube-api-access-bgpqr\") pod \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " Sep 10 02:40:29.014357 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.014156 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-bundle\") pod \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " Sep 10 02:40:29.014357 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.014178 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-util\") pod \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\" (UID: \"de308e6c-3f9a-4842-ab8a-bfe888eaed87\") " Sep 10 02:40:29.014620 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.014602 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-bundle" (OuterVolumeSpecName: "bundle") pod "de308e6c-3f9a-4842-ab8a-bfe888eaed87" (UID: "de308e6c-3f9a-4842-ab8a-bfe888eaed87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:29.016330 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.016305 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de308e6c-3f9a-4842-ab8a-bfe888eaed87-kube-api-access-bgpqr" (OuterVolumeSpecName: "kube-api-access-bgpqr") pod "de308e6c-3f9a-4842-ab8a-bfe888eaed87" (UID: "de308e6c-3f9a-4842-ab8a-bfe888eaed87"). InnerVolumeSpecName "kube-api-access-bgpqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:40:29.023133 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.023092 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-util" (OuterVolumeSpecName: "util") pod "de308e6c-3f9a-4842-ab8a-bfe888eaed87" (UID: "de308e6c-3f9a-4842-ab8a-bfe888eaed87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:29.114826 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.114795 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgpqr\" (UniqueName: \"kubernetes.io/projected/de308e6c-3f9a-4842-ab8a-bfe888eaed87-kube-api-access-bgpqr\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:29.114826 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.114825 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:29.114980 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.114835 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de308e6c-3f9a-4842-ab8a-bfe888eaed87-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:29.854998 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.854971 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" Sep 10 02:40:29.854998 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.854988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c659rxx" event={"ID":"de308e6c-3f9a-4842-ab8a-bfe888eaed87","Type":"ContainerDied","Data":"3297b300e51f39f5ba0dca2fa1197f4bc6cc34388bff6252cc7833fe3f96369d"} Sep 10 02:40:29.855436 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.855032 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3297b300e51f39f5ba0dca2fa1197f4bc6cc34388bff6252cc7833fe3f96369d" Sep 10 02:40:29.857447 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.857420 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2eae546-003b-4065-9d98-2e30381d0def" containerID="1aec45f6065f798174d123d4d94dd117fc902642644cdcdadb3640e4444b2f29" exitCode=0 Sep 10 02:40:29.857575 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:29.857508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" event={"ID":"c2eae546-003b-4065-9d98-2e30381d0def","Type":"ContainerDied","Data":"1aec45f6065f798174d123d4d94dd117fc902642644cdcdadb3640e4444b2f29"} Sep 10 02:40:30.019453 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.019429 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:30.022084 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.021986 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:30.121839 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.121814 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-util\") pod \"c0308f8c-a2cc-4b9e-b751-f682df01816d\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " Sep 10 02:40:30.121987 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.121858 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-bundle\") pod \"e686da3d-1bd7-41db-8526-84389dbd7c20\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " Sep 10 02:40:30.121987 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.121915 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-util\") pod \"e686da3d-1bd7-41db-8526-84389dbd7c20\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " Sep 10 02:40:30.121987 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.121951 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvgjk\" (UniqueName: \"kubernetes.io/projected/e686da3d-1bd7-41db-8526-84389dbd7c20-kube-api-access-hvgjk\") pod \"e686da3d-1bd7-41db-8526-84389dbd7c20\" (UID: \"e686da3d-1bd7-41db-8526-84389dbd7c20\") " Sep 10 02:40:30.121987 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.121975 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d87mv\" (UniqueName: \"kubernetes.io/projected/c0308f8c-a2cc-4b9e-b751-f682df01816d-kube-api-access-d87mv\") pod \"c0308f8c-a2cc-4b9e-b751-f682df01816d\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " Sep 10 02:40:30.122288 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.122002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-bundle\") pod \"c0308f8c-a2cc-4b9e-b751-f682df01816d\" (UID: \"c0308f8c-a2cc-4b9e-b751-f682df01816d\") " Sep 10 02:40:30.122641 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.122584 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-bundle" (OuterVolumeSpecName: "bundle") pod "c0308f8c-a2cc-4b9e-b751-f682df01816d" (UID: "c0308f8c-a2cc-4b9e-b751-f682df01816d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:30.122754 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.122714 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-bundle" (OuterVolumeSpecName: "bundle") pod "e686da3d-1bd7-41db-8526-84389dbd7c20" (UID: "e686da3d-1bd7-41db-8526-84389dbd7c20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:30.124248 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.124216 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0308f8c-a2cc-4b9e-b751-f682df01816d-kube-api-access-d87mv" (OuterVolumeSpecName: "kube-api-access-d87mv") pod "c0308f8c-a2cc-4b9e-b751-f682df01816d" (UID: "c0308f8c-a2cc-4b9e-b751-f682df01816d"). InnerVolumeSpecName "kube-api-access-d87mv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:40:30.124475 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.124455 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e686da3d-1bd7-41db-8526-84389dbd7c20-kube-api-access-hvgjk" (OuterVolumeSpecName: "kube-api-access-hvgjk") pod "e686da3d-1bd7-41db-8526-84389dbd7c20" (UID: "e686da3d-1bd7-41db-8526-84389dbd7c20"). InnerVolumeSpecName "kube-api-access-hvgjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:40:30.127747 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.127726 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-util" (OuterVolumeSpecName: "util") pod "c0308f8c-a2cc-4b9e-b751-f682df01816d" (UID: "c0308f8c-a2cc-4b9e-b751-f682df01816d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:30.128699 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.128680 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-util" (OuterVolumeSpecName: "util") pod "e686da3d-1bd7-41db-8526-84389dbd7c20" (UID: "e686da3d-1bd7-41db-8526-84389dbd7c20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:30.223319 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.223169 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvgjk\" (UniqueName: \"kubernetes.io/projected/e686da3d-1bd7-41db-8526-84389dbd7c20-kube-api-access-hvgjk\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:30.223319 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.223313 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d87mv\" (UniqueName: \"kubernetes.io/projected/c0308f8c-a2cc-4b9e-b751-f682df01816d-kube-api-access-d87mv\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:30.223319 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.223324 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:30.223549 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.223334 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0308f8c-a2cc-4b9e-b751-f682df01816d-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:30.223549 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.223341 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:30.223549 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.223349 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e686da3d-1bd7-41db-8526-84389dbd7c20-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:30.864415 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.864385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" event={"ID":"c0308f8c-a2cc-4b9e-b751-f682df01816d","Type":"ContainerDied","Data":"3b3bcec876cb8ce135a14e82aea1930a59d0a171e20a05ae564e6a81dc24a004"} Sep 10 02:40:30.864770 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.864428 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b3bcec876cb8ce135a14e82aea1930a59d0a171e20a05ae564e6a81dc24a004" Sep 10 02:40:30.864770 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.864400 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w62nb" Sep 10 02:40:30.866628 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.866599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" event={"ID":"e686da3d-1bd7-41db-8526-84389dbd7c20","Type":"ContainerDied","Data":"b0a7acd95b422ff96a91836150a39c5a4363eae79e26ed78270ba27d2d7f554d"} Sep 10 02:40:30.866745 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.866635 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0a7acd95b422ff96a91836150a39c5a4363eae79e26ed78270ba27d2d7f554d" Sep 10 02:40:30.866745 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.866682 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awrkdq" Sep 10 02:40:30.997360 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:30.997338 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:31.030494 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.030472 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m645\" (UniqueName: \"kubernetes.io/projected/c2eae546-003b-4065-9d98-2e30381d0def-kube-api-access-6m645\") pod \"c2eae546-003b-4065-9d98-2e30381d0def\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " Sep 10 02:40:31.030625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.030527 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-bundle\") pod \"c2eae546-003b-4065-9d98-2e30381d0def\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " Sep 10 02:40:31.030625 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.030578 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-util\") pod \"c2eae546-003b-4065-9d98-2e30381d0def\" (UID: \"c2eae546-003b-4065-9d98-2e30381d0def\") " Sep 10 02:40:31.031233 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.031151 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-bundle" (OuterVolumeSpecName: "bundle") pod "c2eae546-003b-4065-9d98-2e30381d0def" (UID: "c2eae546-003b-4065-9d98-2e30381d0def"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:31.032616 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.032585 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2eae546-003b-4065-9d98-2e30381d0def-kube-api-access-6m645" (OuterVolumeSpecName: "kube-api-access-6m645") pod "c2eae546-003b-4065-9d98-2e30381d0def" (UID: "c2eae546-003b-4065-9d98-2e30381d0def"). InnerVolumeSpecName "kube-api-access-6m645". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:40:31.036104 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.036071 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-util" (OuterVolumeSpecName: "util") pod "c2eae546-003b-4065-9d98-2e30381d0def" (UID: "c2eae546-003b-4065-9d98-2e30381d0def"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:40:31.131076 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.131019 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m645\" (UniqueName: \"kubernetes.io/projected/c2eae546-003b-4065-9d98-2e30381d0def-kube-api-access-6m645\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:31.131076 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.131042 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:31.131076 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.131051 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2eae546-003b-4065-9d98-2e30381d0def-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:31.873972 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.873943 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" Sep 10 02:40:31.873972 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.873964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn92h8" event={"ID":"c2eae546-003b-4065-9d98-2e30381d0def","Type":"ContainerDied","Data":"4f69f932e5d3a77c184b6f26b75a1e0ea630c3563ae962ea45a23e99fabce832"} Sep 10 02:40:31.874394 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:31.874003 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f69f932e5d3a77c184b6f26b75a1e0ea630c3563ae962ea45a23e99fabce832" Sep 10 02:40:45.868567 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:45.868509 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dd6c7b8c7-2s776" podUID="86521152-01fe-4cdd-919a-1e4b3c101a42" containerName="console" containerID="cri-o://94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6" gracePeriod=15 Sep 10 02:40:46.118104 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.118080 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:40:46.160792 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.160738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-serving-cert\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.160792 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.160775 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-oauth-config\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.160959 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.160807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-trusted-ca-bundle\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.160959 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.160832 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-console-config\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.160959 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.160859 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-service-ca\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.160959 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.160911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79h9t\" (UniqueName: \"kubernetes.io/projected/86521152-01fe-4cdd-919a-1e4b3c101a42-kube-api-access-79h9t\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.161271 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161244 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-oauth-serving-cert\") pod \"86521152-01fe-4cdd-919a-1e4b3c101a42\" (UID: \"86521152-01fe-4cdd-919a-1e4b3c101a42\") " Sep 10 02:40:46.161271 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161254 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:40:46.161411 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161279 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-console-config" (OuterVolumeSpecName: "console-config") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:40:46.161607 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161560 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:40:46.161868 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161736 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-trusted-ca-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.161868 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161757 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-console-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.161868 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161775 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-oauth-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.162087 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.161891 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-service-ca" (OuterVolumeSpecName: "service-ca") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:40:46.163138 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.163106 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86521152-01fe-4cdd-919a-1e4b3c101a42-kube-api-access-79h9t" (OuterVolumeSpecName: "kube-api-access-79h9t") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "kube-api-access-79h9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:40:46.163138 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.163116 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:40:46.163336 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.163180 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86521152-01fe-4cdd-919a-1e4b3c101a42" (UID: "86521152-01fe-4cdd-919a-1e4b3c101a42"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:40:46.262281 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.262256 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.262281 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.262279 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86521152-01fe-4cdd-919a-1e4b3c101a42-console-oauth-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.262425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.262288 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86521152-01fe-4cdd-919a-1e4b3c101a42-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.262425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.262297 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79h9t\" (UniqueName: \"kubernetes.io/projected/86521152-01fe-4cdd-919a-1e4b3c101a42-kube-api-access-79h9t\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:40:46.955160 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.955124 2576 generic.go:356] "Generic (PLEG): container finished" podID="86521152-01fe-4cdd-919a-1e4b3c101a42" containerID="94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6" exitCode=0 Sep 10 02:40:46.955560 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.955173 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd6c7b8c7-2s776" Sep 10 02:40:46.955560 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.955218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd6c7b8c7-2s776" event={"ID":"86521152-01fe-4cdd-919a-1e4b3c101a42","Type":"ContainerDied","Data":"94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6"} Sep 10 02:40:46.955560 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.955275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd6c7b8c7-2s776" event={"ID":"86521152-01fe-4cdd-919a-1e4b3c101a42","Type":"ContainerDied","Data":"01e1f0b96bbe116ab7e6f139fea1ba3f30cc51c164ccc36788c9e02ab45e3e56"} Sep 10 02:40:46.955560 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.955300 2576 scope.go:117] "RemoveContainer" containerID="94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6" Sep 10 02:40:46.963958 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.963942 2576 scope.go:117] "RemoveContainer" containerID="94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6" Sep 10 02:40:46.964238 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:40:46.964221 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6\": container with ID starting with 94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6 not found: ID does not exist" containerID="94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6" Sep 10 02:40:46.964293 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.964246 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6"} err="failed to get container status \"94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6\": rpc error: code = NotFound desc = could not find container \"94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6\": container with ID starting with 94152be45961d536020104392cf64fcf9ba4f7ac691b4152c8a4f888ec2a29c6 not found: ID does not exist" Sep 10 02:40:46.978335 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.978314 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd6c7b8c7-2s776"] Sep 10 02:40:46.982849 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:46.982830 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dd6c7b8c7-2s776"] Sep 10 02:40:48.817391 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:40:48.817361 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86521152-01fe-4cdd-919a-1e4b3c101a42" path="/var/lib/kubelet/pods/86521152-01fe-4cdd-919a-1e4b3c101a42/volumes" Sep 10 02:42:17.480550 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480517 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c45ff78b9-dxv9v"] Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480825 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480836 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480848 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480854 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480863 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480868 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480876 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480880 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480886 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480891 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480898 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86521152-01fe-4cdd-919a-1e4b3c101a42" containerName="console" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480903 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86521152-01fe-4cdd-919a-1e4b3c101a42" containerName="console" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480911 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480915 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480921 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480926 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480930 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480935 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480942 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480946 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480953 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480958 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480965 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480969 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="pull" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480976 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.480980 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="util" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.481028 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86521152-01fe-4cdd-919a-1e4b3c101a42" containerName="console" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.481036 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0308f8c-a2cc-4b9e-b751-f682df01816d" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.481042 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2eae546-003b-4065-9d98-2e30381d0def" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.481049 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de308e6c-3f9a-4842-ab8a-bfe888eaed87" containerName="extract" Sep 10 02:42:17.481036 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.481055 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e686da3d-1bd7-41db-8526-84389dbd7c20" containerName="extract" Sep 10 02:42:17.483860 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.483844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.487301 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.487274 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 02:42:17.487542 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.487520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 02:42:17.487602 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.487579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 02:42:17.487757 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.487737 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x4g2w\"" Sep 10 02:42:17.496361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.496334 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c45ff78b9-dxv9v"] Sep 10 02:42:17.608069 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.608041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.608232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.608080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.608232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.608153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2st4\" (UniqueName: \"kubernetes.io/projected/a7e24e36-30f0-42d8-9142-3afa31b6e006-kube-api-access-v2st4\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.653801 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.653766 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f96678dcb-pxkch"] Sep 10 02:42:17.656929 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.656909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.667245 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.667218 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f96678dcb-pxkch"] Sep 10 02:42:17.709001 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.708966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2st4\" (UniqueName: \"kubernetes.io/projected/a7e24e36-30f0-42d8-9142-3afa31b6e006-kube-api-access-v2st4\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.709142 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.709050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.709142 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.709095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.709263 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:17.709223 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 02:42:17.709307 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:17.709272 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert podName:a7e24e36-30f0-42d8-9142-3afa31b6e006 nodeName:}" failed. No retries permitted until 2026-09-10 02:42:18.209258191 +0000 UTC m=+517.880899212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert") pod "maas-controller-7c45ff78b9-dxv9v" (UID: "a7e24e36-30f0-42d8-9142-3afa31b6e006") : secret "maas-controller-webhook-cert" not found Sep 10 02:42:17.709307 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:17.709282 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 10 02:42:17.709393 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:17.709340 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs podName:a7e24e36-30f0-42d8-9142-3afa31b6e006 nodeName:}" failed. No retries permitted until 2026-09-10 02:42:18.209327611 +0000 UTC m=+517.880968634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs") pod "maas-controller-7c45ff78b9-dxv9v" (UID: "a7e24e36-30f0-42d8-9142-3afa31b6e006") : secret "maas-controller-metrics-tls" not found Sep 10 02:42:17.718342 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.718323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2st4\" (UniqueName: \"kubernetes.io/projected/a7e24e36-30f0-42d8-9142-3afa31b6e006-kube-api-access-v2st4\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:17.810045 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.810020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltz54\" (UniqueName: \"kubernetes.io/projected/5f13fc45-5ad1-4063-93af-7ef35fbf665a-kube-api-access-ltz54\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.810208 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.810059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-metrics-certs\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.810208 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.810158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.910982 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.910948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltz54\" (UniqueName: \"kubernetes.io/projected/5f13fc45-5ad1-4063-93af-7ef35fbf665a-kube-api-access-ltz54\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.910982 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.910987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-metrics-certs\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.911145 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.911032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.911145 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:17.911128 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 02:42:17.911260 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:17.911202 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert podName:5f13fc45-5ad1-4063-93af-7ef35fbf665a nodeName:}" failed. No retries permitted until 2026-09-10 02:42:18.411165243 +0000 UTC m=+518.082806265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert") pod "maas-controller-7f96678dcb-pxkch" (UID: "5f13fc45-5ad1-4063-93af-7ef35fbf665a") : secret "maas-controller-webhook-cert" not found Sep 10 02:42:17.913675 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.913642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-metrics-certs\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:17.923319 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:17.923297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltz54\" (UniqueName: \"kubernetes.io/projected/5f13fc45-5ad1-4063-93af-7ef35fbf665a-kube-api-access-ltz54\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:18.213355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:18.213283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:18.213355 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:18.213318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:18.213514 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:18.213425 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 02:42:18.213514 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:18.213486 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert podName:a7e24e36-30f0-42d8-9142-3afa31b6e006 nodeName:}" failed. No retries permitted until 2026-09-10 02:42:19.213467952 +0000 UTC m=+518.885108987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert") pod "maas-controller-7c45ff78b9-dxv9v" (UID: "a7e24e36-30f0-42d8-9142-3afa31b6e006") : secret "maas-controller-webhook-cert" not found Sep 10 02:42:18.215599 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:18.215571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:18.414614 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:18.414581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:18.414778 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:18.414717 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 02:42:18.414778 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:18.414771 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert podName:5f13fc45-5ad1-4063-93af-7ef35fbf665a nodeName:}" failed. No retries permitted until 2026-09-10 02:42:19.414757926 +0000 UTC m=+519.086398948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert") pod "maas-controller-7f96678dcb-pxkch" (UID: "5f13fc45-5ad1-4063-93af-7ef35fbf665a") : secret "maas-controller-webhook-cert" not found Sep 10 02:42:19.218839 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.218805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:19.221317 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.221292 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") pod \"maas-controller-7c45ff78b9-dxv9v\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:19.293817 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.293793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:19.420839 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.420809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:19.423311 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.423285 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f13fc45-5ad1-4063-93af-7ef35fbf665a-webhook-cert\") pod \"maas-controller-7f96678dcb-pxkch\" (UID: \"5f13fc45-5ad1-4063-93af-7ef35fbf665a\") " pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:19.467106 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.467080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:19.564009 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.563985 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c45ff78b9-dxv9v"] Sep 10 02:42:19.565854 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:42:19.565827 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e24e36_30f0_42d8_9142_3afa31b6e006.slice/crio-e7358037214f6fb0752ea44762233bacbf42f2c77573217689340de29ba3ce84 WatchSource:0}: Error finding container e7358037214f6fb0752ea44762233bacbf42f2c77573217689340de29ba3ce84: Status 404 returned error can't find the container with id e7358037214f6fb0752ea44762233bacbf42f2c77573217689340de29ba3ce84 Sep 10 02:42:19.744056 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:19.744034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f96678dcb-pxkch"] Sep 10 02:42:19.745949 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:42:19.745923 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f13fc45_5ad1_4063_93af_7ef35fbf665a.slice/crio-2cb4b84dbd0e99c23793d8e2d03fb380b1a9b33ff84ae3d6b993c7db5ca3aea9 WatchSource:0}: Error finding container 2cb4b84dbd0e99c23793d8e2d03fb380b1a9b33ff84ae3d6b993c7db5ca3aea9: Status 404 returned error can't find the container with id 2cb4b84dbd0e99c23793d8e2d03fb380b1a9b33ff84ae3d6b993c7db5ca3aea9 Sep 10 02:42:20.426314 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:20.426234 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f96678dcb-pxkch" event={"ID":"5f13fc45-5ad1-4063-93af-7ef35fbf665a","Type":"ContainerStarted","Data":"2cb4b84dbd0e99c23793d8e2d03fb380b1a9b33ff84ae3d6b993c7db5ca3aea9"} Sep 10 02:42:20.428115 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:20.428085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" event={"ID":"a7e24e36-30f0-42d8-9142-3afa31b6e006","Type":"ContainerStarted","Data":"e7358037214f6fb0752ea44762233bacbf42f2c77573217689340de29ba3ce84"} Sep 10 02:42:22.444373 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:22.444330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f96678dcb-pxkch" event={"ID":"5f13fc45-5ad1-4063-93af-7ef35fbf665a","Type":"ContainerStarted","Data":"9c4920c47f2ae52c16ed15ef48b325009415be433150652f8375c7a65430fbf4"} Sep 10 02:42:22.444835 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:22.444536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:22.446090 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:22.446065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" event={"ID":"a7e24e36-30f0-42d8-9142-3afa31b6e006","Type":"ContainerStarted","Data":"356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8"} Sep 10 02:42:22.446208 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:22.446121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:22.464566 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:22.464517 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f96678dcb-pxkch" podStartSLOduration=2.979019849 podStartE2EDuration="5.464502411s" totalImagesPullingTime="2.485482562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:42:22.463302404 +0000 UTC m=+522.134943447" watchObservedRunningTime="2026-09-10 02:42:22.464502411 +0000 UTC m=+522.136143456" Sep 10 02:42:22.484501 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:22.484430 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" podStartSLOduration=2.811915694 podStartE2EDuration="5.484417303s" totalImagesPullingTime="2.672501609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:42:22.482600712 +0000 UTC m=+522.154241755" watchObservedRunningTime="2026-09-10 02:42:22.484417303 +0000 UTC m=+522.156058346" Sep 10 02:42:33.454371 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.454291 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f96678dcb-pxkch" Sep 10 02:42:33.454914 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.454380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:33.544163 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.544129 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c45ff78b9-dxv9v"] Sep 10 02:42:33.544388 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.544339 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" podUID="a7e24e36-30f0-42d8-9142-3afa31b6e006" containerName="manager" containerID="cri-o://356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8" gracePeriod=30 Sep 10 02:42:33.785409 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.785388 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:33.837594 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.837565 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") pod \"a7e24e36-30f0-42d8-9142-3afa31b6e006\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " Sep 10 02:42:33.837727 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.837610 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs\") pod \"a7e24e36-30f0-42d8-9142-3afa31b6e006\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " Sep 10 02:42:33.837727 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.837662 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2st4\" (UniqueName: \"kubernetes.io/projected/a7e24e36-30f0-42d8-9142-3afa31b6e006-kube-api-access-v2st4\") pod \"a7e24e36-30f0-42d8-9142-3afa31b6e006\" (UID: \"a7e24e36-30f0-42d8-9142-3afa31b6e006\") " Sep 10 02:42:33.839884 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.839853 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7e24e36-30f0-42d8-9142-3afa31b6e006" (UID: "a7e24e36-30f0-42d8-9142-3afa31b6e006"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:42:33.839884 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.839882 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a7e24e36-30f0-42d8-9142-3afa31b6e006" (UID: "a7e24e36-30f0-42d8-9142-3afa31b6e006"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:42:33.840021 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.839882 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e24e36-30f0-42d8-9142-3afa31b6e006-kube-api-access-v2st4" (OuterVolumeSpecName: "kube-api-access-v2st4") pod "a7e24e36-30f0-42d8-9142-3afa31b6e006" (UID: "a7e24e36-30f0-42d8-9142-3afa31b6e006"). InnerVolumeSpecName "kube-api-access-v2st4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:42:33.938195 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.938157 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-webhook-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:42:33.938302 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.938181 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7e24e36-30f0-42d8-9142-3afa31b6e006-metrics-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:42:33.938302 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:33.938213 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2st4\" (UniqueName: \"kubernetes.io/projected/a7e24e36-30f0-42d8-9142-3afa31b6e006-kube-api-access-v2st4\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Sep 10 02:42:34.512002 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.511964 2576 generic.go:356] "Generic (PLEG): container finished" podID="a7e24e36-30f0-42d8-9142-3afa31b6e006" containerID="356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8" exitCode=0 Sep 10 02:42:34.512425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.512015 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" Sep 10 02:42:34.512425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.512047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" event={"ID":"a7e24e36-30f0-42d8-9142-3afa31b6e006","Type":"ContainerDied","Data":"356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8"} Sep 10 02:42:34.512425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.512101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45ff78b9-dxv9v" event={"ID":"a7e24e36-30f0-42d8-9142-3afa31b6e006","Type":"ContainerDied","Data":"e7358037214f6fb0752ea44762233bacbf42f2c77573217689340de29ba3ce84"} Sep 10 02:42:34.512425 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.512124 2576 scope.go:117] "RemoveContainer" containerID="356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8" Sep 10 02:42:34.521217 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.521175 2576 scope.go:117] "RemoveContainer" containerID="356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8" Sep 10 02:42:34.521506 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:42:34.521488 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8\": container with ID starting with 356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8 not found: ID does not exist" containerID="356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8" Sep 10 02:42:34.521546 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.521514 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8"} err="failed to get container status \"356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8\": rpc error: code = NotFound desc = could not find container \"356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8\": container with ID starting with 356ce87132afc1090f72eb86069ff3f9d1b725d2ba973c55ddd2ff08c80457b8 not found: ID does not exist" Sep 10 02:42:34.532846 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.532826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c45ff78b9-dxv9v"] Sep 10 02:42:34.536951 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.536930 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c45ff78b9-dxv9v"] Sep 10 02:42:34.818268 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:34.818244 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e24e36-30f0-42d8-9142-3afa31b6e006" path="/var/lib/kubelet/pods/a7e24e36-30f0-42d8-9142-3afa31b6e006/volumes" Sep 10 02:42:55.923326 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.923289 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj"] Sep 10 02:42:55.923705 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.923657 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e24e36-30f0-42d8-9142-3afa31b6e006" containerName="manager" Sep 10 02:42:55.923705 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.923670 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e24e36-30f0-42d8-9142-3afa31b6e006" containerName="manager" Sep 10 02:42:55.923777 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.923725 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e24e36-30f0-42d8-9142-3afa31b6e006" containerName="manager" Sep 10 02:42:55.958823 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.958786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj"] Sep 10 02:42:55.958985 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.958885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:55.960865 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.960840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 02:42:55.960865 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:55.960841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l9t6z\"" Sep 10 02:42:56.017992 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.017945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-mkswj\" (UID: \"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.018226 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.018019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4vx\" (UniqueName: \"kubernetes.io/projected/9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9-kube-api-access-bf4vx\") pod \"payload-pre-processing-59fbc47bf8-mkswj\" (UID: \"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.119423 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.119388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-mkswj\" (UID: \"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.119617 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.119442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4vx\" (UniqueName: \"kubernetes.io/projected/9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9-kube-api-access-bf4vx\") pod \"payload-pre-processing-59fbc47bf8-mkswj\" (UID: \"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.120422 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.120394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-mkswj\" (UID: \"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.128610 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.128579 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4vx\" (UniqueName: \"kubernetes.io/projected/9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9-kube-api-access-bf4vx\") pod \"payload-pre-processing-59fbc47bf8-mkswj\" (UID: \"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.269558 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.269478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:56.540111 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.540038 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj"] Sep 10 02:42:56.543809 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:42:56.543773 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3ffbda_0a99_4a28_9ceb_db9f1d6f80f9.slice/crio-04c660975c2337ad8b85d5bb9c0e8461504a3106b2032ff2a1a96983ea38fb05 WatchSource:0}: Error finding container 04c660975c2337ad8b85d5bb9c0e8461504a3106b2032ff2a1a96983ea38fb05: Status 404 returned error can't find the container with id 04c660975c2337ad8b85d5bb9c0e8461504a3106b2032ff2a1a96983ea38fb05 Sep 10 02:42:56.619172 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:56.619143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" event={"ID":"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9","Type":"ContainerStarted","Data":"04c660975c2337ad8b85d5bb9c0e8461504a3106b2032ff2a1a96983ea38fb05"} Sep 10 02:42:58.633501 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:58.633460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" event={"ID":"9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9","Type":"ContainerStarted","Data":"e3f5e153f3c0119769d6669f7b99c46d93f474f602ab669ed4b66046e9f1dcca"} Sep 10 02:42:58.633928 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:58.633564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:42:58.655892 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:42:58.655835 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" podStartSLOduration=1.9678710050000001 podStartE2EDuration="3.655819849s" totalImagesPullingTime="1.687948844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:42:58.65175987 +0000 UTC m=+558.323400916" watchObservedRunningTime="2026-09-10 02:42:58.655819849 +0000 UTC m=+558.327460894" Sep 10 02:43:09.641068 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:09.641035 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-mkswj" Sep 10 02:43:14.416904 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.416865 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv"] Sep 10 02:43:14.420293 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.420269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.422622 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.422597 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 02:43:14.423168 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.423151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 02:43:14.423254 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.423152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 02:43:14.423589 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.423562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g7ctp\"" Sep 10 02:43:14.432274 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.432253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv"] Sep 10 02:43:14.582879 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.582845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.583035 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.582890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.583035 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.582911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df43209f-9cdf-4781-a35d-b6e9412094ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.583035 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.583002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.583143 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.583039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.583143 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.583080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ph5\" (UniqueName: \"kubernetes.io/projected/df43209f-9cdf-4781-a35d-b6e9412094ef-kube-api-access-x7ph5\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684527 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684527 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df43209f-9cdf-4781-a35d-b6e9412094ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ph5\" (UniqueName: \"kubernetes.io/projected/df43209f-9cdf-4781-a35d-b6e9412094ef-kube-api-access-x7ph5\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684743 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.684967 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.685028 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.684987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.685079 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.685032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.686945 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.686915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df43209f-9cdf-4781-a35d-b6e9412094ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.687130 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.687116 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df43209f-9cdf-4781-a35d-b6e9412094ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.692897 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.692872 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ph5\" (UniqueName: \"kubernetes.io/projected/df43209f-9cdf-4781-a35d-b6e9412094ef-kube-api-access-x7ph5\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jv9fv\" (UID: \"df43209f-9cdf-4781-a35d-b6e9412094ef\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:14.730773 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:14.730748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:15.008740 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:15.008718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv"] Sep 10 02:43:15.010587 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:43:15.010551 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf43209f_9cdf_4781_a35d_b6e9412094ef.slice/crio-425dcb9342b5e8dae69c94f74026ae9a3d16b819fc468dfff9f9cceb155d7ac5 WatchSource:0}: Error finding container 425dcb9342b5e8dae69c94f74026ae9a3d16b819fc468dfff9f9cceb155d7ac5: Status 404 returned error can't find the container with id 425dcb9342b5e8dae69c94f74026ae9a3d16b819fc468dfff9f9cceb155d7ac5 Sep 10 02:43:15.718244 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:15.718213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerStarted","Data":"425dcb9342b5e8dae69c94f74026ae9a3d16b819fc468dfff9f9cceb155d7ac5"} Sep 10 02:43:16.726894 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:16.726858 2576 generic.go:356] "Generic (PLEG): container finished" podID="df43209f-9cdf-4781-a35d-b6e9412094ef" containerID="6d1e8eb9a991327b43f3c38a8aba7755c35713418cd7f5e828cbe74c3edf8ce6" exitCode=0 Sep 10 02:43:16.727357 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:16.726951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerDied","Data":"6d1e8eb9a991327b43f3c38a8aba7755c35713418cd7f5e828cbe74c3edf8ce6"} Sep 10 02:43:16.727357 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:16.727169 2576 scope.go:117] "RemoveContainer" containerID="6d1e8eb9a991327b43f3c38a8aba7755c35713418cd7f5e828cbe74c3edf8ce6" Sep 10 02:43:17.734368 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:17.734332 2576 generic.go:356] "Generic (PLEG): container finished" podID="df43209f-9cdf-4781-a35d-b6e9412094ef" containerID="1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48" exitCode=0 Sep 10 02:43:17.734762 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:17.734422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerDied","Data":"1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48"} Sep 10 02:43:17.734762 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:17.734489 2576 scope.go:117] "RemoveContainer" containerID="6d1e8eb9a991327b43f3c38a8aba7755c35713418cd7f5e828cbe74c3edf8ce6" Sep 10 02:43:17.735037 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:17.734771 2576 scope.go:117] "RemoveContainer" containerID="1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48" Sep 10 02:43:17.735037 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:43:17.734969 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:43:18.740781 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:18.740752 2576 scope.go:117] "RemoveContainer" containerID="1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48" Sep 10 02:43:18.741164 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:43:18.740954 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:43:21.901407 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.901378 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc"] Sep 10 02:43:21.906017 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.905993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:21.908011 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.907991 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 10 02:43:21.915874 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.915849 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc"] Sep 10 02:43:21.944091 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.944064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:21.944267 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.944133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:21.944267 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.944164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:21.944267 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.944180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:21.944267 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.944215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557588d-6d89-47c3-b8d9-1c5b4493dc11-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:21.944424 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:21.944262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5p6w\" (UniqueName: \"kubernetes.io/projected/a557588d-6d89-47c3-b8d9-1c5b4493dc11-kube-api-access-f5p6w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045108 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045308 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045308 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045308 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045308 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557588d-6d89-47c3-b8d9-1c5b4493dc11-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045522 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5p6w\" (UniqueName: \"kubernetes.io/projected/a557588d-6d89-47c3-b8d9-1c5b4493dc11-kube-api-access-f5p6w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045574 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045574 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045561 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.045679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.045612 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.047707 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.047687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557588d-6d89-47c3-b8d9-1c5b4493dc11-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.047897 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.047880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557588d-6d89-47c3-b8d9-1c5b4493dc11-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.056426 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.056400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5p6w\" (UniqueName: \"kubernetes.io/projected/a557588d-6d89-47c3-b8d9-1c5b4493dc11-kube-api-access-f5p6w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc\" (UID: \"a557588d-6d89-47c3-b8d9-1c5b4493dc11\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.217536 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.217450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:22.497529 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.497499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc"] Sep 10 02:43:22.498926 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:43:22.498896 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda557588d_6d89_47c3_b8d9_1c5b4493dc11.slice/crio-e464eb0560689519255d4785bc537a1130617052bce101bb64c9cc0b2f444ee8 WatchSource:0}: Error finding container e464eb0560689519255d4785bc537a1130617052bce101bb64c9cc0b2f444ee8: Status 404 returned error can't find the container with id e464eb0560689519255d4785bc537a1130617052bce101bb64c9cc0b2f444ee8 Sep 10 02:43:22.761303 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.761232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" event={"ID":"a557588d-6d89-47c3-b8d9-1c5b4493dc11","Type":"ContainerStarted","Data":"d71e44b20f53de360209a8248c27d06dae0e02dacb6754b8e7689384305ec3b0"} Sep 10 02:43:22.761303 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.761296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" event={"ID":"a557588d-6d89-47c3-b8d9-1c5b4493dc11","Type":"ContainerStarted","Data":"e464eb0560689519255d4785bc537a1130617052bce101bb64c9cc0b2f444ee8"} Sep 10 02:43:22.778076 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:22.778029 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" podStartSLOduration=1.600682709 podStartE2EDuration="1.778015008s" totalImagesPullingTime="177.332299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:43:22.776060427 +0000 UTC m=+582.447701472" watchObservedRunningTime="2026-09-10 02:43:22.778015008 +0000 UTC m=+582.449656091" Sep 10 02:43:24.731483 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:24.731450 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:24.731852 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:24.731516 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:24.731852 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:24.731537 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:24.731852 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:24.731551 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:24.731951 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:24.731887 2576 scope.go:117] "RemoveContainer" containerID="1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48" Sep 10 02:43:24.732067 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:43:24.732048 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:43:32.218596 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:32.218557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:32.218995 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:32.218628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:32.231081 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:32.231057 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:32.824439 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:32.824412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc" Sep 10 02:43:36.812583 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:36.812552 2576 scope.go:117] "RemoveContainer" containerID="1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48" Sep 10 02:43:37.844019 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:37.843981 2576 generic.go:356] "Generic (PLEG): container finished" podID="df43209f-9cdf-4781-a35d-b6e9412094ef" containerID="ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af" exitCode=0 Sep 10 02:43:37.844019 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:37.844020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerDied","Data":"ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af"} Sep 10 02:43:37.844509 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:37.844066 2576 scope.go:117] "RemoveContainer" containerID="1f9766fc31053c49757255e478ed5f7fd880d01d336345955b2ba00b63bcfe48" Sep 10 02:43:37.844509 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:37.844451 2576 scope.go:117] "RemoveContainer" containerID="ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af" Sep 10 02:43:37.844664 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:43:37.844640 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:43:40.737307 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:40.737279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:43:40.738679 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:40.738646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:43:43.513564 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.513528 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z"] Sep 10 02:43:43.518707 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.518686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.520977 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.520955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 02:43:43.530282 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.530256 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z"] Sep 10 02:43:43.624936 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.624905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.625091 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.624955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.625091 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.625020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.625091 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.625046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.625091 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.625077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.625257 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.625101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x88bl\" (UniqueName: \"kubernetes.io/projected/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-kube-api-access-x88bl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726004 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.725965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726157 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726157 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726297 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726297 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726297 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x88bl\" (UniqueName: \"kubernetes.io/projected/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-kube-api-access-x88bl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726457 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726591 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.726649 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.726571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.728460 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.728442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.728708 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.728689 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.733667 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.733644 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x88bl\" (UniqueName: \"kubernetes.io/projected/cf3c8c3f-cc55-40dc-a24a-ba0be86e2685-kube-api-access-x88bl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z\" (UID: \"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:43.830098 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:43.830070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:44.101869 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.101712 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z"] Sep 10 02:43:44.103968 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:43:44.103941 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3c8c3f_cc55_40dc_a24a_ba0be86e2685.slice/crio-7d760669b24cdc8f58e0d29a2256ee59bf28d246719817cde53a9ddc9bcc217a WatchSource:0}: Error finding container 7d760669b24cdc8f58e0d29a2256ee59bf28d246719817cde53a9ddc9bcc217a: Status 404 returned error can't find the container with id 7d760669b24cdc8f58e0d29a2256ee59bf28d246719817cde53a9ddc9bcc217a Sep 10 02:43:44.731284 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.731253 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:44.731630 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.731310 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:44.731630 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.731326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:44.731630 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.731343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:43:44.731729 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.731686 2576 scope.go:117] "RemoveContainer" containerID="ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af" Sep 10 02:43:44.731886 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:43:44.731866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:43:44.879764 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.879732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" event={"ID":"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685","Type":"ContainerStarted","Data":"4d59d73354b1432610e96a2587f466381652379dbd2f6296b148f00ec9a27f22"} Sep 10 02:43:44.879969 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.879783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" event={"ID":"cf3c8c3f-cc55-40dc-a24a-ba0be86e2685","Type":"ContainerStarted","Data":"7d760669b24cdc8f58e0d29a2256ee59bf28d246719817cde53a9ddc9bcc217a"} Sep 10 02:43:44.899774 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:44.899722 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" podStartSLOduration=1.730479301 podStartE2EDuration="1.899706595s" totalImagesPullingTime="169.227294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:43:44.897632914 +0000 UTC m=+604.569273959" watchObservedRunningTime="2026-09-10 02:43:44.899706595 +0000 UTC m=+604.571347697" Sep 10 02:43:53.831120 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:53.831080 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:53.833627 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:53.831141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:53.843902 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:53.843882 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:53.936535 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:53.936513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z" Sep 10 02:43:56.812445 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:43:56.812408 2576 scope.go:117] "RemoveContainer" containerID="ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af" Sep 10 02:43:56.812897 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:43:56.812638 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:10.815131 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:10.815061 2576 scope.go:117] "RemoveContainer" containerID="ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af" Sep 10 02:44:10.815524 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:10.815392 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:44:12.018228 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:12.018177 2576 generic.go:356] "Generic (PLEG): container finished" podID="df43209f-9cdf-4781-a35d-b6e9412094ef" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" exitCode=0 Sep 10 02:44:12.018228 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:12.018221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerDied","Data":"3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa"} Sep 10 02:44:12.018845 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:12.018284 2576 scope.go:117] "RemoveContainer" containerID="ecefc784d471cb24eedbc39394835b4872f364751418599ced1c85b8e08852af" Sep 10 02:44:12.018845 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:12.018663 2576 scope.go:117] "RemoveContainer" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" Sep 10 02:44:12.018954 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:12.018891 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:14.731173 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:14.731139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:14.731580 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:14.731224 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:14.731580 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:14.731247 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:14.731580 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:14.731268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:14.731692 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:14.731582 2576 scope.go:117] "RemoveContainer" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" Sep 10 02:44:14.731778 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:14.731759 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:28.811889 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:28.811856 2576 scope.go:117] "RemoveContainer" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" Sep 10 02:44:28.812365 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:28.812032 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:39.812691 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:39.812662 2576 scope.go:117] "RemoveContainer" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" Sep 10 02:44:39.813138 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:39.812828 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:53.811844 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:53.811808 2576 scope.go:117] "RemoveContainer" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" Sep 10 02:44:54.234057 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.234027 2576 generic.go:356] "Generic (PLEG): container finished" podID="df43209f-9cdf-4781-a35d-b6e9412094ef" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" exitCode=0 Sep 10 02:44:54.234205 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.234099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerDied","Data":"82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd"} Sep 10 02:44:54.234205 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.234159 2576 scope.go:117] "RemoveContainer" containerID="3ef7218dccb1def3d0c72e494d1e605139ac6329639b31877fc99034e3ede7aa" Sep 10 02:44:54.234483 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.234467 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:44:54.234687 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:54.234656 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:54.731870 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.731841 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:54.732030 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.731892 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:54.732030 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.731907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:54.732030 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:54.731920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:44:55.241468 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:55.241441 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:44:55.241808 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:55.241621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:44:56.246777 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:44:56.246748 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:44:56.247136 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:44:56.246929 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:45:06.812520 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:45:06.812483 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:45:06.813014 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:45:06.812668 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:45:21.812437 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:45:21.812408 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:45:21.812847 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:45:21.812574 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:45:32.812712 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:45:32.812639 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:45:32.813280 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:45:32.812821 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:45:47.811984 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:45:47.811944 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:45:47.812481 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:45:47.812149 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:46:02.812406 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:02.812371 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:46:02.812748 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:46:02.812548 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:46:13.812252 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:13.812220 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:46:13.812725 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:46:13.812429 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:46:25.812117 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:25.812087 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:46:26.718373 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:26.718340 2576 generic.go:356] "Generic (PLEG): container finished" podID="df43209f-9cdf-4781-a35d-b6e9412094ef" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" exitCode=0 Sep 10 02:46:26.718531 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:26.718419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" event={"ID":"df43209f-9cdf-4781-a35d-b6e9412094ef","Type":"ContainerDied","Data":"b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038"} Sep 10 02:46:26.718531 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:26.718511 2576 scope.go:117] "RemoveContainer" containerID="82f22d5dfe9e7dbe9b5dce3f65f5b9702fb12e67c195d574eb6e0a21932560dd" Sep 10 02:46:26.718840 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:26.718816 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:46:26.719022 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:46:26.719005 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:46:34.730878 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:34.730841 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:46:34.731350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:34.730908 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:46:34.731350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:34.730928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:46:34.731350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:34.730947 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" Sep 10 02:46:34.731350 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:34.731335 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:46:34.731549 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:46:34.731530 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:46:45.812023 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:45.811989 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:46:45.812521 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:46:45.812180 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:46:58.812575 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:46:58.812544 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:46:58.812943 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:46:58.812751 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:47:13.812021 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:47:13.811988 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:47:13.812425 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:47:13.812167 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:47:28.811924 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:47:28.811894 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:47:28.812426 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:47:28.812087 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:47:39.812650 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:47:39.812622 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:47:39.813103 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:47:39.812775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:47:51.812259 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:47:51.812225 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:47:51.812705 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:47:51.812408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:48:02.811916 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:02.811889 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:48:02.812397 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:48:02.812061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:48:17.812753 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:17.812721 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:48:17.813154 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:48:17.812930 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:48:19.821144 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:19.821113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f96678dcb-pxkch_5f13fc45-5ad1-4063-93af-7ef35fbf665a/manager/0.log" Sep 10 02:48:19.938277 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:19.938256 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wb64c_2f12ccbd-abc5-48a5-bf80-49dd3b87249e/server/0.log" Sep 10 02:48:20.065414 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:20.065388 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lvrbl_dc33103d-7473-4931-a68b-9f96f0fe339f/manager/0.log" Sep 10 02:48:20.207669 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:20.207604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-7x7mm_1df3b7d5-8a75-441a-92ff-dbfda1dffbc2/manager/0.log" Sep 10 02:48:20.214037 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:20.214017 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-7x7mm_1df3b7d5-8a75-441a-92ff-dbfda1dffbc2/copy-manifests/0.log" Sep 10 02:48:22.953697 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:22.953650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk_8ba230bb-6e53-4a23-9743-847606cbcbe6/istio-proxy/0.log" Sep 10 02:48:23.077559 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:23.077529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2n2kh_1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb/discovery/0.log" Sep 10 02:48:23.567837 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:23.567809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mkswj_9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9/payload-pre-processing/0.log" Sep 10 02:48:24.181134 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:24.181105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-jv9fv_df43209f-9cdf-4781-a35d-b6e9412094ef/main/5.log" Sep 10 02:48:24.420801 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:24.420772 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-6p9lc_a557588d-6d89-47c3-b8d9-1c5b4493dc11/main/0.log" Sep 10 02:48:24.653979 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:24.653953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fr987z_cf3c8c3f-cc55-40dc-a24a-ba0be86e2685/main/0.log" Sep 10 02:48:31.812752 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:31.812677 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:48:31.813210 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:48:31.812861 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:48:33.528005 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:33.527971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qdg75_52ce502c-4e66-4b68-b86c-ccc945149575/global-pull-secret-syncer/0.log" Sep 10 02:48:33.722732 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:33.722702 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s57p9_ff97aea9-d48d-49a2-8baa-68b423b94cb9/konnectivity-agent/0.log" Sep 10 02:48:33.744550 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:33.744534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-96.ec2.internal_277c30dbbf575dc44122b1220e5c2c65/haproxy/0.log" Sep 10 02:48:39.647946 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.647911 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/alertmanager/0.log" Sep 10 02:48:39.672163 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.672140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/config-reloader/0.log" Sep 10 02:48:39.697061 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.697041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/kube-rbac-proxy-web/0.log" Sep 10 02:48:39.721931 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.721906 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/kube-rbac-proxy/0.log" Sep 10 02:48:39.746781 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.746761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/kube-rbac-proxy-metric/0.log" Sep 10 02:48:39.770716 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.770699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/prom-label-proxy/0.log" Sep 10 02:48:39.793295 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.793277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45694257-775a-4cc8-aad5-049a35d29427/init-config-reloader/0.log" Sep 10 02:48:39.923551 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.923481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6bcc645f85-rrwpj_9b78f9f1-5339-4f7a-a9b2-59618963c008/metrics-server/0.log" Sep 10 02:48:39.949092 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:39.949073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-s7bh6_f7dd9168-51b1-46e9-83b5-1d2899045e94/monitoring-plugin/0.log" Sep 10 02:48:40.147560 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.147530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p648w_7358d723-4fde-4241-9afe-16fed2c6e8e6/node-exporter/0.log" Sep 10 02:48:40.168196 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.168168 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p648w_7358d723-4fde-4241-9afe-16fed2c6e8e6/kube-rbac-proxy/0.log" Sep 10 02:48:40.191848 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.191782 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p648w_7358d723-4fde-4241-9afe-16fed2c6e8e6/init-textfile/0.log" Sep 10 02:48:40.621941 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.621913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-688c4dc5b9-qkn4s_c92ffe5b-b286-46e4-a8b6-c8e402e48ad1/telemeter-client/0.log" Sep 10 02:48:40.651045 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.651022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-688c4dc5b9-qkn4s_c92ffe5b-b286-46e4-a8b6-c8e402e48ad1/reload/0.log" Sep 10 02:48:40.682288 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.682262 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-688c4dc5b9-qkn4s_c92ffe5b-b286-46e4-a8b6-c8e402e48ad1/kube-rbac-proxy/0.log" Sep 10 02:48:40.775902 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.775869 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:48:40.776044 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:40.775929 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:48:43.681727 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.681699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59cd77d4d7-ngvpp_15ab2dc8-823b-49bf-8ee2-95fc94bd48ca/console/0.log" Sep 10 02:48:43.970300 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.970220 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt"] Sep 10 02:48:43.973585 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.973566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:43.975664 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.975643 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4dzq\"/\"openshift-service-ca.crt\"" Sep 10 02:48:43.975747 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.975643 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m4dzq\"/\"default-dockercfg-9mkwm\"" Sep 10 02:48:43.976127 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.976107 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4dzq\"/\"kube-root-ca.crt\"" Sep 10 02:48:43.983470 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:43.983449 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt"] Sep 10 02:48:44.043983 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.043954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-podres\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.044121 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.044012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv75m\" (UniqueName: \"kubernetes.io/projected/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-kube-api-access-qv75m\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.044121 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.044050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-lib-modules\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.044280 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.044134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-sys\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.044280 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.044157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-proc\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145032 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-podres\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145151 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv75m\" (UniqueName: \"kubernetes.io/projected/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-kube-api-access-qv75m\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145151 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-lib-modules\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145151 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-sys\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145151 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-proc\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-podres\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-sys\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-proc\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.145361 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.145287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-lib-modules\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.152225 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.152207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv75m\" (UniqueName: \"kubernetes.io/projected/59f1edcc-edf9-40bf-9bc1-d92a3d6d2739-kube-api-access-qv75m\") pod \"perf-node-gather-daemonset-rvrbt\" (UID: \"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.284145 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.284091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:44.556430 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:44.556407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt"] Sep 10 02:48:44.558002 ip-10-0-137-96 kubenswrapper[2576]: W0910 02:48:44.557971 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod59f1edcc_edf9_40bf_9bc1_d92a3d6d2739.slice/crio-91a039b0a6b87082c9277ff701e36f66ffee955bf30e7909cfa126ce9dbcafd7 WatchSource:0}: Error finding container 91a039b0a6b87082c9277ff701e36f66ffee955bf30e7909cfa126ce9dbcafd7: Status 404 returned error can't find the container with id 91a039b0a6b87082c9277ff701e36f66ffee955bf30e7909cfa126ce9dbcafd7 Sep 10 02:48:45.434146 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.434107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" event={"ID":"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739","Type":"ContainerStarted","Data":"d14ad2dc25550888d32eb6b76be9d055d937ed33f3c6cdb842ca9dc3adca8ebc"} Sep 10 02:48:45.434548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.434172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" event={"ID":"59f1edcc-edf9-40bf-9bc1-d92a3d6d2739","Type":"ContainerStarted","Data":"91a039b0a6b87082c9277ff701e36f66ffee955bf30e7909cfa126ce9dbcafd7"} Sep 10 02:48:45.434548 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.434241 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:45.448366 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.448325 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" podStartSLOduration=2.4483108160000002 podStartE2EDuration="2.448310816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:48:45.447074027 +0000 UTC m=+905.118715082" watchObservedRunningTime="2026-09-10 02:48:45.448310816 +0000 UTC m=+905.119951861" Sep 10 02:48:45.601317 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.601295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbsq8_a565a40c-36d0-465a-b1cd-fdd398fd953f/dns/0.log" Sep 10 02:48:45.623312 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.623289 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbsq8_a565a40c-36d0-465a-b1cd-fdd398fd953f/kube-rbac-proxy/0.log" Sep 10 02:48:45.749231 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:45.749138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qtkvt_7dc4e86c-c220-464e-b3ea-8ef77e6cafb0/dns-node-resolver/0.log" Sep 10 02:48:46.248432 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:46.248404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c69fb8f77-tzfz2_9825542e-b5b6-455c-9c19-4b6d10197d0a/registry/0.log" Sep 10 02:48:46.298369 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:46.298346 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mxhzh_15511c0e-419d-46b9-a7b2-ef8e2eb5a9bc/node-ca/0.log" Sep 10 02:48:46.812684 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:46.812652 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:48:46.813139 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:48:46.812825 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:48:47.267658 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:47.267579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk_8ba230bb-6e53-4a23-9743-847606cbcbe6/istio-proxy/0.log" Sep 10 02:48:47.317232 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:47.317205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2n2kh_1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb/discovery/0.log" Sep 10 02:48:47.411717 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:47.411698 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mkswj_9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9/payload-pre-processing/0.log" Sep 10 02:48:48.099331 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:48.099301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lw8lx_b376c4a3-ea5e-4c59-a4dd-0f966a47813a/serve-healthcheck-canary/0.log" Sep 10 02:48:48.752059 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:48.752031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rknjs_c59f0540-3599-4dd4-8ffa-0c870cf2f817/kube-rbac-proxy/0.log" Sep 10 02:48:48.773703 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:48.773682 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rknjs_c59f0540-3599-4dd4-8ffa-0c870cf2f817/exporter/0.log" Sep 10 02:48:48.795736 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:48.795712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rknjs_c59f0540-3599-4dd4-8ffa-0c870cf2f817/extractor/0.log" Sep 10 02:48:50.939712 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:50.939684 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f96678dcb-pxkch_5f13fc45-5ad1-4063-93af-7ef35fbf665a/manager/0.log" Sep 10 02:48:50.959865 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:50.959844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wb64c_2f12ccbd-abc5-48a5-bf80-49dd3b87249e/server/0.log" Sep 10 02:48:51.005745 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:51.005724 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lvrbl_dc33103d-7473-4931-a68b-9f96f0fe339f/manager/0.log" Sep 10 02:48:51.052239 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:51.052215 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-7x7mm_1df3b7d5-8a75-441a-92ff-dbfda1dffbc2/manager/0.log" Sep 10 02:48:51.072905 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:51.072888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-7x7mm_1df3b7d5-8a75-441a-92ff-dbfda1dffbc2/copy-manifests/0.log" Sep 10 02:48:51.450161 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:51.450138 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-rvrbt" Sep 10 02:48:52.317665 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:52.317635 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-748c765c7f-8p25g_38e3d787-71a9-4a6e-a0b7-fe4aa533a70e/manager/0.log" Sep 10 02:48:54.018720 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:54.018627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk_8ba230bb-6e53-4a23-9743-847606cbcbe6/istio-proxy/0.log" Sep 10 02:48:54.060391 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:54.060371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2n2kh_1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb/discovery/0.log" Sep 10 02:48:54.132821 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:54.132765 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mkswj_9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9/payload-pre-processing/0.log" Sep 10 02:48:55.243875 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:55.243845 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7xqk_8ba230bb-6e53-4a23-9743-847606cbcbe6/istio-proxy/0.log" Sep 10 02:48:55.281716 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:55.281683 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2n2kh_1e8b58b3-06a7-49a8-a2fd-0f3e9bda45cb/discovery/0.log" Sep 10 02:48:55.352615 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:55.352537 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-mkswj_9a3ffbda-0a99-4a28-9ceb-db9f1d6f80f9/payload-pre-processing/0.log" Sep 10 02:48:59.285270 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.285243 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/kube-multus-additional-cni-plugins/0.log" Sep 10 02:48:59.309823 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.309770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/egress-router-binary-copy/0.log" Sep 10 02:48:59.332132 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.332109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/cni-plugins/0.log" Sep 10 02:48:59.355609 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.355585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/bond-cni-plugin/0.log" Sep 10 02:48:59.376975 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.376960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/routeoverride-cni/0.log" Sep 10 02:48:59.399070 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.399052 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/whereabouts-cni-bincopy/0.log" Sep 10 02:48:59.420280 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.420254 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fbjg_980357a5-0ec8-4679-b29e-1edd5f55d693/whereabouts-cni/0.log" Sep 10 02:48:59.770982 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.770961 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dwkjm_2cdf42c9-b5bd-42d3-aa5d-50dbdf54a85d/kube-multus/0.log" Sep 10 02:48:59.812162 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.812133 2576 scope.go:117] "RemoveContainer" containerID="b8e9abd556e17794bcc8620c3369b703ed7471810cb05db39ace28f60d565038" Sep 10 02:48:59.812403 ip-10-0-137-96 kubenswrapper[2576]: E0910 02:48:59.812380 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jv9fv_llm(df43209f-9cdf-4781-a35d-b6e9412094ef)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jv9fv" podUID="df43209f-9cdf-4781-a35d-b6e9412094ef" Sep 10 02:48:59.820670 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.820648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6ftmw_8c806bf8-3f7e-44f9-bfb0-e8df626d9c68/network-metrics-daemon/0.log" Sep 10 02:48:59.840658 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:48:59.840635 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6ftmw_8c806bf8-3f7e-44f9-bfb0-e8df626d9c68/kube-rbac-proxy/0.log" Sep 10 02:49:00.704631 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.704597 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-controller/0.log" Sep 10 02:49:00.725671 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.725646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/0.log" Sep 10 02:49:00.725797 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.725728 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovn-acl-logging/1.log" Sep 10 02:49:00.751595 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.751572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/kube-rbac-proxy-node/0.log" Sep 10 02:49:00.786980 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.786962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 02:49:00.808465 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.808446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/northd/0.log" Sep 10 02:49:00.829977 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.829961 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/nbdb/0.log" Sep 10 02:49:00.852723 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.852703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/sbdb/0.log" Sep 10 02:49:00.893882 ip-10-0-137-96 kubenswrapper[2576]: I0910 02:49:00.893864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8k7l8_faf34934-2893-429c-a49e-46b2b67fd61f/ovnkube-controller/0.log"