Sep 10 02:49:15.393550 ip-10-0-134-49 systemd[1]: Starting Kubernetes Kubelet... Sep 10 02:49:15.809401 ip-10-0-134-49 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:49:15.809401 ip-10-0-134-49 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 02:49:15.809401 ip-10-0-134-49 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:49:15.809401 ip-10-0-134-49 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 02:49:15.809401 ip-10-0-134-49 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:49:15.810081 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.809461 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 02:49:15.812928 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812912 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:49:15.812928 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812927 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812931 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812934 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812942 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812945 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812948 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812950 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812953 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812956 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812958 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812961 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812964 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812966 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812969 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812972 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812975 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812977 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812980 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812982 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812985 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:49:15.812995 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812987 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812990 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812993 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812995 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.812998 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813000 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813003 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813008 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813012 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813015 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813018 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813021 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813023 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813026 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813028 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813031 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813033 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813036 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813038 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813041 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:49:15.813503 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813043 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813046 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813048 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813052 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813054 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813056 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813059 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813061 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813064 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813066 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813069 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813071 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813074 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813078 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813082 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813085 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813088 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813091 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813094 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:49:15.813983 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813097 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813099 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813103 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813106 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813108 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813111 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813113 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813116 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813118 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813121 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813124 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813126 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813129 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813131 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813134 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813136 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813140 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813143 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813147 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:49:15.814479 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813150 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813153 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813156 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813158 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813161 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813163 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813166 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813168 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813171 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813174 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813177 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813180 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813182 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813185 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813187 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813190 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813193 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813196 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813198 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813201 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:49:15.814940 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813935 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813942 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813946 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813950 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813952 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813955 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813958 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813961 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813965 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813969 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813972 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813975 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813979 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813982 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813986 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813989 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813992 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813995 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.813998 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:49:15.815482 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814001 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814005 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814008 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814011 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814013 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814016 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814018 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814021 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814023 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814026 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814031 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814034 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814036 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814039 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814041 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814044 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814047 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814049 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814052 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814055 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:49:15.815945 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814057 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814060 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814062 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814065 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814067 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814070 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814072 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814075 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814077 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814080 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814082 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814085 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814088 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814091 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814094 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814097 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814099 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814102 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814105 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814107 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:49:15.816473 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814110 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814112 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814115 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814118 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814121 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814123 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814125 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814128 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814132 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814135 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814137 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814139 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814142 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814144 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814147 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814150 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814152 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814155 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814157 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:49:15.817060 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814160 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814162 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814165 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814168 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814170 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814173 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814176 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814178 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814181 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814183 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814186 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814188 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814191 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814194 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814198 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814200 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814203 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814207 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814209 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:49:15.817563 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814212 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814215 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814590 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814595 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814598 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814600 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814603 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814606 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814608 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814611 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814614 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814617 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814619 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814622 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814624 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814627 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814630 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814633 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814636 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814638 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:49:15.818025 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814641 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814643 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814646 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814648 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814651 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814653 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814656 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814659 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814661 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814664 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814667 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814669 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814672 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814674 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814677 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814679 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814682 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814685 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814687 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:49:15.818527 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814690 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814692 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814697 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814700 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814703 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814705 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814708 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814710 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814713 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814716 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814718 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814720 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814723 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814725 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814729 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814733 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814736 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814738 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814741 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:49:15.818982 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814743 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814745 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814748 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814751 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814753 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814756 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814759 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814763 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814767 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814770 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814773 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814776 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814779 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814782 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814785 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814791 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814795 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814800 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814803 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:49:15.819466 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814806 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814808 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814811 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814814 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814816 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814819 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814822 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814825 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814827 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814830 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814833 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814835 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814837 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814840 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814842 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814845 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814847 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814850 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814853 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814856 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:49:15.819930 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814858 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814861 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814863 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.814866 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814934 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814965 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814971 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814980 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814987 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814990 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814994 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.814998 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815001 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815004 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815008 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815011 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815015 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815018 2578 flags.go:64] FLAG: --cgroup-root="" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815020 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815024 2578 flags.go:64] FLAG: --client-ca-file="" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815027 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815030 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815034 2578 flags.go:64] FLAG: --cluster-domain="" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815036 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 02:49:15.820421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815039 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815042 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815046 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815049 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815052 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815055 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815059 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815062 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815065 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815068 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815071 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815074 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815078 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815081 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815083 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815086 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815091 2578 flags.go:64] FLAG: --enable-server="true" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815094 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815099 2578 flags.go:64] FLAG: --event-burst="100" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815102 2578 flags.go:64] FLAG: --event-qps="50" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815105 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815108 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815111 2578 flags.go:64] FLAG: --eviction-hard="" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815125 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 02:49:15.820995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815128 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815131 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815134 2578 flags.go:64] FLAG: --eviction-soft="" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815137 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815140 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815143 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815146 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815149 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815152 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815154 2578 flags.go:64] FLAG: --feature-gates="" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815158 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815161 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815164 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815167 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815170 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815173 2578 flags.go:64] FLAG: --help="false" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815176 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-134-49.ec2.internal" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815179 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815183 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815186 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815189 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815192 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815195 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 02:49:15.821591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815198 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815202 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815205 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815208 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815211 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815214 2578 flags.go:64] FLAG: --kube-reserved="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815217 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815236 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815239 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815242 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815245 2578 flags.go:64] FLAG: --lock-file="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815248 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815251 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815254 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815259 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815263 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815265 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815268 2578 flags.go:64] FLAG: --logging-format="text" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815271 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815274 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815278 2578 flags.go:64] FLAG: --manifest-url="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815281 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815285 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815288 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815292 2578 flags.go:64] FLAG: --max-pods="110" Sep 10 02:49:15.822231 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815295 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815298 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815301 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815304 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815307 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815310 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815313 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815320 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815325 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815328 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815331 2578 flags.go:64] FLAG: --pod-cidr="" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815333 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815339 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815342 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815345 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815348 2578 flags.go:64] FLAG: --port="10250" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815351 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815354 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1b13ddb3dc55cae" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815357 2578 flags.go:64] FLAG: --qos-reserved="" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815360 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815363 2578 flags.go:64] FLAG: --register-node="true" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815366 2578 flags.go:64] FLAG: --register-with-taints="" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815369 2578 flags.go:64] FLAG: --registry-burst="10" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815372 2578 flags.go:64] FLAG: --registry-qps="5" Sep 10 02:49:15.822853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815375 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815378 2578 flags.go:64] FLAG: --reserved-memory="" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815381 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815384 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815387 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815390 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815393 2578 flags.go:64] FLAG: --runonce="false" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815395 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815398 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815401 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815404 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815407 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815410 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815413 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815416 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815419 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815423 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815429 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815431 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815434 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815437 2578 flags.go:64] FLAG: --system-cgroups="" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815440 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815445 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815448 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815451 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 02:49:15.823455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815455 2578 flags.go:64] FLAG: --tls-min-version="" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815458 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815460 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815463 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815466 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815469 2578 flags.go:64] FLAG: --v="2" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815473 2578 flags.go:64] FLAG: --version="false" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815477 2578 flags.go:64] FLAG: --vmodule="" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815480 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.815484 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815598 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815603 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815606 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815609 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815612 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815615 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815617 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815620 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815623 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815626 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815628 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815631 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:49:15.824116 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815634 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815640 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815645 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815647 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815650 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815653 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815655 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815658 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815660 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815663 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815666 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815669 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815673 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815676 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815679 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815682 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815685 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815687 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815690 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:49:15.824963 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815693 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815695 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815698 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815700 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815703 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815705 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815708 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815710 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815713 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815715 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815718 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815721 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815725 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815728 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815735 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815740 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815742 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815745 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815748 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815751 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:49:15.825485 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815753 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815757 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815760 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815763 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815766 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815769 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815772 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815775 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815778 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815782 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815785 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815787 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815790 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815793 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815796 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815798 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815801 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815803 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815806 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:49:15.826019 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815809 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815811 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815814 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815816 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815819 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815822 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815825 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815829 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815834 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815837 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815839 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815842 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815844 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815847 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815849 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815852 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815855 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815857 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815859 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815862 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:49:15.826501 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815865 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815867 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815870 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815873 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815875 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815878 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815880 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815883 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.815885 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.816526 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.825698 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.825714 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.826437 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.826447 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826505 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:49:15.826996 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826510 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826513 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826517 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826520 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826523 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826526 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826529 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826532 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826535 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826537 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826540 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826543 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826545 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826548 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826551 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826554 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826556 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826559 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826562 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826565 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:49:15.827402 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826568 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826570 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826573 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826576 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826578 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826581 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826583 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826586 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826590 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826592 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826595 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826598 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826600 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826603 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826605 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826608 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826610 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826613 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826616 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826618 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:49:15.827885 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826621 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826625 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826628 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826632 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826635 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826638 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826641 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826644 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826647 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826650 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826653 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826656 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826658 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826661 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826664 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826667 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826669 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826671 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826674 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:49:15.828394 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826677 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826680 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826684 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826688 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826691 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826694 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826698 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826702 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826706 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826709 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826712 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826715 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826718 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826720 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826723 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826726 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826728 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826731 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826733 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:49:15.828852 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826737 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826739 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826742 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826745 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826747 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826750 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826753 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826756 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826758 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826761 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826763 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826766 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826768 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826771 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826774 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826777 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826780 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826782 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826785 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:49:15.829372 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826788 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.826793 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826906 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826912 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826915 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826919 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826921 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826924 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826927 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826929 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826932 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826935 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826937 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826940 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826943 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:49:15.829838 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826945 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826948 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826951 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826953 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826956 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826958 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826961 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826964 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826968 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826971 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826974 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826977 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826981 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826983 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826986 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826989 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826991 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826994 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.826997 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:49:15.830202 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827000 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827002 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827005 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827007 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827010 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827012 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827016 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827020 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827023 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827026 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827029 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827031 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827034 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827037 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827040 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827043 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827045 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827048 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827051 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:49:15.830678 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827053 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827056 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827058 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827061 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827064 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827066 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827069 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827072 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827075 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827077 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827079 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827082 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827084 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827087 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827090 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827092 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827095 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827097 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827100 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827102 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:49:15.831146 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827105 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827107 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827110 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827120 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827124 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827126 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827129 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827133 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827136 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827139 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827142 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827145 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827148 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827151 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827153 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827156 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827158 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827161 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827164 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827166 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:49:15.831639 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827169 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827172 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827174 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827177 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827179 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827182 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827184 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:15.827187 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.827192 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.827317 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 02:49:15.832114 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.831446 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 02:49:15.832378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.832311 2578 server.go:1019] "Starting client certificate rotation" Sep 10 02:49:15.832426 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.832407 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 02:49:15.832455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.832440 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 02:49:15.834771 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.834758 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 02:49:15.837911 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.837893 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 02:49:15.849685 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.849661 2578 log.go:25] "Validated CRI v1 runtime API" Sep 10 02:49:15.855543 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.855522 2578 log.go:25] "Validated CRI v1 image API" Sep 10 02:49:15.856455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.856440 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 02:49:15.861352 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.861330 2578 fs.go:135] Filesystem UUIDs: map[5ccde016-9a5d-4378-b977-ec5ea7b9a0c8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fca3e80c-f2bf-4de1-8b42-82c92a9b71c0:/dev/nvme0n1p4] Sep 10 02:49:15.861426 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.861349 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 02:49:15.867294 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.867170 2578 manager.go:216] Machine: {Timestamp:2026-09-10 02:49:15.865761506 +0000 UTC m=+0.351756771 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3171137 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228d8d60dbb46cdf5bd02b73284a13 SystemUUID:ec228d8d-60db-b46c-df5b-d02b73284a13 BootID:0f371b70-d56d-4f03-8f35-5a8968b1f80f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:19:94:c4:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:19:94:c4:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:1b:a5:98:95:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 02:49:15.867294 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.867292 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 02:49:15.867407 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.867376 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 02:49:15.869462 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.869413 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 02:49:15.869846 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.869486 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 02:49:15.870405 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.870391 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 02:49:15.870449 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.870409 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 02:49:15.870449 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.870421 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 02:49:15.870652 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.870636 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 02:49:15.871048 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.871037 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 02:49:15.872285 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.872275 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 02:49:15.875199 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875188 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 10 02:49:15.875326 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875317 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 02:49:15.875363 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875346 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 10 02:49:15.875363 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875356 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 02:49:15.875417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875370 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 02:49:15.875417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875379 2578 kubelet.go:398] "Adding apiserver pod source" Sep 10 02:49:15.875417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875388 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 02:49:15.875711 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875697 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 02:49:15.875711 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.875715 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 02:49:15.877892 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.877872 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 02:49:15.880018 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880005 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 02:49:15.880057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880035 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 02:49:15.880196 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880187 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 02:49:15.880246 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880202 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 02:49:15.880246 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880208 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 02:49:15.880246 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880214 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 02:49:15.880246 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880241 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 02:49:15.880246 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.880248 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 02:49:15.881021 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.881012 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 02:49:15.881050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.881022 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 02:49:15.881050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.881030 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 02:49:15.881050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.881036 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 02:49:15.881050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.881045 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 02:49:15.881149 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.881053 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 02:49:15.882670 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.882657 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 02:49:15.882670 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.882673 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 02:49:15.886399 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.886386 2578 server.go:1268] "Started kubelet" Sep 10 02:49:15.886495 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.886471 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 02:49:15.886569 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.886527 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 02:49:15.886627 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.886591 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 02:49:15.887969 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.887949 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 02:49:15.888566 ip-10-0-134-49 systemd[1]: Started Kubernetes Kubelet. Sep 10 02:49:15.890016 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.889999 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 10 02:49:15.890789 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.890769 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 02:49:15.892342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.892327 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 02:49:15.893012 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.892993 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 02:49:15.893562 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.893215 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:15.893768 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893748 2578 factory.go:55] Registering systemd factory Sep 10 02:49:15.893768 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893770 2578 factory.go:223] Registration of the systemd container factory successfully Sep 10 02:49:15.893911 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893755 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 02:49:15.893911 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893830 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 02:49:15.893911 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893752 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 02:49:15.894038 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893970 2578 factory.go:153] Registering CRI-O factory Sep 10 02:49:15.894038 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893986 2578 factory.go:223] Registration of the crio container factory successfully Sep 10 02:49:15.894038 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.893993 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 10 02:49:15.894038 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.894002 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 10 02:49:15.894244 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.894063 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 02:49:15.894244 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.894191 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 02:49:15.894244 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.894200 2578 factory.go:103] Registering Raw factory Sep 10 02:49:15.894446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.894251 2578 manager.go:1196] Started watching for new ooms in manager Sep 10 02:49:15.894812 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.894777 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 02:49:15.894934 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.894923 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 02:49:15.895250 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.895237 2578 manager.go:349] Starting recovery of all containers Sep 10 02:49:15.895661 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.894542 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd91bd6b25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.886340901 +0000 UTC m=+0.372336166,LastTimestamp:2026-09-10 02:49:15.886340901 +0000 UTC m=+0.372336166,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.897106 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.897062 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 02:49:15.897269 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.897242 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 02:49:15.903048 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.902833 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 02:49:15.906902 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.906880 2578 manager.go:354] Recovery completed Sep 10 02:49:15.911712 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.911699 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:15.913342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913319 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:15.913395 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913355 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:15.913395 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913366 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:15.913875 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913861 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 02:49:15.913875 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913873 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:15.913994 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913874 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 02:49:15.913994 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.913900 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 10 02:49:15.914561 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.914545 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:15.914624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.914576 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:15.914624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.914587 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:15.915126 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.915104 2578 policy_none.go:49] "None policy: Start" Sep 10 02:49:15.915162 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.915129 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 02:49:15.915162 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.915139 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 02:49:15.915986 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.915926 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd93596be3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.913341923 +0000 UTC m=+0.399337187,LastTimestamp:2026-09-10 02:49:15.913341923 +0000 UTC m=+0.399337187,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.916209 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.916200 2578 policy_none.go:47] "Start" Sep 10 02:49:15.928575 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.928479 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd9359b12a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-49.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.913359658 +0000 UTC m=+0.399354923,LastTimestamp:2026-09-10 02:49:15.913359658 +0000 UTC m=+0.399354923,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.932155 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.932096 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd9359d89f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-49.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.913369759 +0000 UTC m=+0.399365025,LastTimestamp:2026-09-10 02:49:15.913369759 +0000 UTC m=+0.399365025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.941471 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.941414 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-49.ec2.internal.18d3d5cd93596be3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd93596be3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.913341923 +0000 UTC m=+0.399337187,LastTimestamp:2026-09-10 02:49:15.914559281 +0000 UTC m=+0.400554547,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.945820 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.945802 2578 manager.go:337] "Starting Device Plugin manager" Sep 10 02:49:15.945891 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.945854 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 02:49:15.945891 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.945868 2578 server.go:87] "Starting device plugin registration server" Sep 10 02:49:15.946248 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.946215 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 02:49:15.946333 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.946248 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 02:49:15.946446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.946352 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 02:49:15.946503 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.946449 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 02:49:15.946503 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.946458 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 02:49:15.946610 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.946543 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-49.ec2.internal.18d3d5cd9359b12a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd9359b12a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-49.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.913359658 +0000 UTC m=+0.399354923,LastTimestamp:2026-09-10 02:49:15.9145816 +0000 UTC m=+0.400576864,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.947175 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.947064 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 02:49:15.947175 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.947102 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:15.955748 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.955691 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-49.ec2.internal.18d3d5cd9359d89f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd9359d89f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-49.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.913369759 +0000 UTC m=+0.399365025,LastTimestamp:2026-09-10 02:49:15.91459099 +0000 UTC m=+0.400586255,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.956631 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.956605 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrgfq" Sep 10 02:49:15.963647 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:15.963591 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d3d5cd95c13325 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-10 02:49:15.953697573 +0000 UTC m=+0.439692830,LastTimestamp:2026-09-10 02:49:15.953697573 +0000 UTC m=+0.439692830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}" Sep 10 02:49:15.979945 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:15.967611 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrgfq" Sep 10 02:49:16.035901 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.035871 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 02:49:16.036020 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.035927 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 02:49:16.036020 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.035949 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 02:49:16.036107 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.036046 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 02:49:16.038772 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.038745 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Sep 10 02:49:16.047110 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.047095 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:16.047897 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.047881 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:16.047974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.047908 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:16.047974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.047918 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:16.047974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.047940 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.067940 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.067896 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.067940 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.067919 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-49.ec2.internal\": node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.090075 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.090055 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.136647 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.136621 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"] Sep 10 02:49:16.136717 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.136693 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:16.137694 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.137679 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:16.137767 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.137708 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:16.137767 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.137724 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:16.138989 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.138977 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:16.139147 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.139201 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139162 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:16.139681 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139664 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:16.139760 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139686 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:16.139760 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139694 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:16.139760 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139669 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:16.139760 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139760 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:16.139914 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.139769 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:16.140925 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.140910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.141020 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.140934 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:49:16.141638 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.141625 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:49:16.141733 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.141653 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:49:16.141733 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.141667 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:49:16.171950 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.171928 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-49.ec2.internal\" not found" node="ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.176536 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.176522 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-49.ec2.internal\" not found" node="ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.190159 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.190142 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.195390 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.195376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f669ab1cb85cf052360045999e4a40a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"f669ab1cb85cf052360045999e4a40a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.195435 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.195400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f669ab1cb85cf052360045999e4a40a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"f669ab1cb85cf052360045999e4a40a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.195435 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.195422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/20f67e3f1462365a445fa83981cf652e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-49.ec2.internal\" (UID: \"20f67e3f1462365a445fa83981cf652e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.291239 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.291197 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.296541 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.296523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f669ab1cb85cf052360045999e4a40a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"f669ab1cb85cf052360045999e4a40a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.296591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.296550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f669ab1cb85cf052360045999e4a40a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"f669ab1cb85cf052360045999e4a40a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.296591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.296567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/20f67e3f1462365a445fa83981cf652e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-49.ec2.internal\" (UID: \"20f67e3f1462365a445fa83981cf652e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.296656 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.296602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/20f67e3f1462365a445fa83981cf652e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-49.ec2.internal\" (UID: \"20f67e3f1462365a445fa83981cf652e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.296656 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.296621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f669ab1cb85cf052360045999e4a40a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"f669ab1cb85cf052360045999e4a40a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.296656 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.296636 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f669ab1cb85cf052360045999e4a40a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"f669ab1cb85cf052360045999e4a40a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.392029 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.391954 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.474411 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.474373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.479309 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.479287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.492831 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.492809 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.593724 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.593681 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.694152 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.694083 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.794596 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.794554 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found" Sep 10 02:49:16.827316 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.827292 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:49:16.832541 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.832528 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 02:49:16.832651 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.832636 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 02:49:16.875844 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.875820 2578 apiserver.go:52] "Watching apiserver" Sep 10 02:49:16.892482 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.892453 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 02:49:16.893549 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.893530 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.895545 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.895526 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 02:49:16.897765 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.897743 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-dtfl5","openshift-multus/multus-5fv5c","openshift-multus/multus-additional-cni-plugins-pqmfg","openshift-multus/network-metrics-daemon-wsc8g","openshift-network-diagnostics/network-check-target-lt6v2","openshift-network-operator/iptables-alerter-qwssf","openshift-ovn-kubernetes/ovnkube-node-k9chs","kube-system/global-pull-secret-syncer-j8g7l","kube-system/konnectivity-agent-6ckhp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc","openshift-dns/node-resolver-mf2nr","openshift-cluster-node-tuning-operator/tuned-5mwjc"] Sep 10 02:49:16.899071 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.899056 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:16.900251 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.900211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5fv5c" Sep 10 02:49:16.901470 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.901454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:16.902507 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.902495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:16.902572 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.902555 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:16.903573 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.903561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:16.903615 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.903605 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:16.904603 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.904592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:16.905644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.905630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gch8l\"" Sep 10 02:49:16.905914 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.905901 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 02:49:16.906312 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.906294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:16.906601 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.906575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.906813 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.906794 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.907088 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907072 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.907552 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:16.907637 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:16.907577 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:16.907637 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907627 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 02:49:16.907742 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907667 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wn9v4\"" Sep 10 02:49:16.907742 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907690 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" Sep 10 02:49:16.907742 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907695 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4hhk9\"" Sep 10 02:49:16.907916 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907899 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 02:49:16.908016 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.907988 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.908070 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.908046 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 02:49:16.908113 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.908078 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 02:49:16.908113 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.908050 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 02:49:16.908638 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.908623 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 02:49:16.908891 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.908877 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:16.910023 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.909993 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.910023 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.909996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.910155 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7f9h2\"" Sep 10 02:49:16.910389 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:16.910475 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910457 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.910532 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910517 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 02:49:16.910627 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910463 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:49:16.910732 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pj658\"" Sep 10 02:49:16.910874 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.910859 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 02:49:16.912084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.911667 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.912084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.911702 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 02:49:16.912084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.911711 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 02:49:16.912084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.912057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:16.912320 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.911669 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 02:49:16.913715 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.913692 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-plbfk\"" Sep 10 02:49:16.913843 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.913820 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 02:49:16.913903 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.913860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 02:49:16.913903 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.913868 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 02:49:16.914106 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.914087 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.914204 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.914189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8gfj6\"" Sep 10 02:49:16.914298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.914283 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.915171 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.915145 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"] Sep 10 02:49:16.915496 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.915480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:16.919253 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.919234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kk2pb\"" Sep 10 02:49:16.919340 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.919237 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.919340 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.919301 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 02:49:16.919565 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.919552 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"] Sep 10 02:49:16.920181 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.920160 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.920283 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.920195 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 02:49:16.920283 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.920216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hk2hr\"" Sep 10 02:49:16.920358 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.920236 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:49:16.932558 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.932529 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k5bq8" Sep 10 02:49:16.941351 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.941336 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k5bq8" Sep 10 02:49:16.970730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.970697 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 02:44:16 +0000 UTC" deadline="2028-04-28 16:48:04.017903328 +0000 UTC" Sep 10 02:49:16.970730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.970730 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14317h58m47.047175705s" Sep 10 02:49:16.994697 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.994674 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 02:49:17.000008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:16.999987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysctl-conf\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.000116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-kubelet\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.000116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-device-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.000116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-host\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.000116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-lib-modules\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.000318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-systemd-units\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/747a6e3e-dfb1-4508-9123-c8283943012a-ovn-node-metrics-cert\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-cni-bin\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.000318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfgkw\" (UniqueName: \"kubernetes.io/projected/7f7f0030-f843-43ed-9b45-d0de21dc9898-kube-api-access-dfgkw\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.000318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98w8s\" (UniqueName: \"kubernetes.io/projected/9a7dbd9b-664e-4bb9-b016-4879b1960508-kube-api-access-98w8s\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-slash\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpcw\" (UniqueName: \"kubernetes.io/projected/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-kube-api-access-lrpcw\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhqtd\" (UniqueName: \"kubernetes.io/projected/ace2833d-01ca-4b37-ab1d-3227783758ba-kube-api-access-vhqtd\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-modprobe-d\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysconfig\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29961115-3d62-44e7-9d1c-5b9a19d5207f-host\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-cni-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.000522 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-hostroot\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-systemd\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbc44c17-25c5-4ad9-b10a-ca5782438ddf-agent-certs\") pod \"konnectivity-agent-6ckhp\" (UID: \"dbc44c17-25c5-4ad9-b10a-ca5782438ddf\") " pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b381fd0c-3486-4e78-8aad-8eccd5d0c551-hosts-file\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-systemd\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-socket-dir-parent\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-socket-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-sys-fs\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b381fd0c-3486-4e78-8aad-8eccd5d0c551-tmp-dir\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-log-socket\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29961115-3d62-44e7-9d1c-5b9a19d5207f-serviceca\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-k8s-cni-cncf-io\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-run-netns\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbc44c17-25c5-4ad9-b10a-ca5782438ddf-konnectivity-ca\") pod \"konnectivity-agent-6ckhp\" (UID: \"dbc44c17-25c5-4ad9-b10a-ca5782438ddf\") " pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-iptables-alerter-script\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-registration-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.000913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-kubernetes\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f7f0030-f843-43ed-9b45-d0de21dc9898-cni-binary-copy\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-node-log\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-cni-netd\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.000981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-tuned\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rl7x\" (UniqueName: \"kubernetes.io/projected/3232c456-e59c-4f15-8d3e-0758d7624cdc-kube-api-access-8rl7x\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-etc-kubernetes\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-cni-bin\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-var-lib-kubelet\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-cnibin\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-netns\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-conf-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.001467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-system-cni-dir\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3232c456-e59c-4f15-8d3e-0758d7624cdc-tmp\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-system-cni-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-daemon-config\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zcc9\" (UniqueName: \"kubernetes.io/projected/747a6e3e-dfb1-4508-9123-c8283943012a-kube-api-access-8zcc9\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8rv\" (UniqueName: \"kubernetes.io/projected/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-kube-api-access-5k8rv\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-run\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-sys\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-ovnkube-script-lib\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysctl-d\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4md\" (UniqueName: \"kubernetes.io/projected/29961115-3d62-44e7-9d1c-5b9a19d5207f-kube-api-access-px4md\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-kubelet\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.002035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-var-lib-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-dbus\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-ovn\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-ovnkube-config\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-host-slash\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-cni-multus\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-multus-certs\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-env-overrides\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-kubelet-config\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.001880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6c7\" (UniqueName: \"kubernetes.io/projected/b381fd0c-3486-4e78-8aad-8eccd5d0c551-kube-api-access-gn6c7\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.002008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-cnibin\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.002585 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.002043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-etc-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.103210 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-cnibin\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.103346 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-etc-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.103346 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysctl-conf\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.103346 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-cnibin\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.103346 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-kubelet\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-kubelet\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-etc-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-device-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysctl-conf\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103455 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-host\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-device-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-lib-modules\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.103553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-host\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-systemd-units\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/747a6e3e-dfb1-4508-9123-c8283943012a-ovn-node-metrics-cert\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-cni-bin\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgkw\" (UniqueName: \"kubernetes.io/projected/7f7f0030-f843-43ed-9b45-d0de21dc9898-kube-api-access-dfgkw\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-systemd-units\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-cni-bin\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98w8s\" (UniqueName: \"kubernetes.io/projected/9a7dbd9b-664e-4bb9-b016-4879b1960508-kube-api-access-98w8s\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-slash\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpcw\" (UniqueName: \"kubernetes.io/projected/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-kube-api-access-lrpcw\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhqtd\" (UniqueName: \"kubernetes.io/projected/ace2833d-01ca-4b37-ab1d-3227783758ba-kube-api-access-vhqtd\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-modprobe-d\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysconfig\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29961115-3d62-44e7-9d1c-5b9a19d5207f-host\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-cni-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-hostroot\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-systemd\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbc44c17-25c5-4ad9-b10a-ca5782438ddf-agent-certs\") pod \"konnectivity-agent-6ckhp\" (UID: \"dbc44c17-25c5-4ad9-b10a-ca5782438ddf\") " pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-lib-modules\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b381fd0c-3486-4e78-8aad-8eccd5d0c551-hosts-file\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-systemd\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.103990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b381fd0c-3486-4e78-8aad-8eccd5d0c551-hosts-file\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-socket-dir-parent\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-socket-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-sys-fs\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104062 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-cni-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b381fd0c-3486-4e78-8aad-8eccd5d0c551-tmp-dir\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-log-socket\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29961115-3d62-44e7-9d1c-5b9a19d5207f-serviceca\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-k8s-cni-cncf-io\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-run-netns\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-hostroot\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbc44c17-25c5-4ad9-b10a-ca5782438ddf-konnectivity-ca\") pod \"konnectivity-agent-6ckhp\" (UID: \"dbc44c17-25c5-4ad9-b10a-ca5782438ddf\") " pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-iptables-alerter-script\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.104864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104311 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b381fd0c-3486-4e78-8aad-8eccd5d0c551-tmp-dir\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-registration-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104333 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-slash\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-kubernetes\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f7f0030-f843-43ed-9b45-d0de21dc9898-cni-binary-copy\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-node-log\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-socket-dir-parent\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-cni-netd\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-tuned\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rl7x\" (UniqueName: \"kubernetes.io/projected/3232c456-e59c-4f15-8d3e-0758d7624cdc-kube-api-access-8rl7x\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-etc-kubernetes\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-sys-fs\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-cni-bin\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.105730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104700 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-log-socket\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-var-lib-kubelet\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29961115-3d62-44e7-9d1c-5b9a19d5207f-host\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-systemd\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104830 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-k8s-cni-cncf-io\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104882 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbc44c17-25c5-4ad9-b10a-ca5782438ddf-konnectivity-ca\") pod \"konnectivity-agent-6ckhp\" (UID: \"dbc44c17-25c5-4ad9-b10a-ca5782438ddf\") " pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-kubernetes\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-var-lib-kubelet\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-cnibin\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104766 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-registration-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104569 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ace2833d-01ca-4b37-ab1d-3227783758ba-socket-dir\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.104422 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-systemd\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105049 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysconfig\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-run-netns\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-etc-kubernetes\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-node-log\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106441 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-cni-bin\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105215 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-cni-netd\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105302 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29961115-3d62-44e7-9d1c-5b9a19d5207f-serviceca\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f7f0030-f843-43ed-9b45-d0de21dc9898-cni-binary-copy\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.105339 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-cnibin\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.105397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:17.605378234 +0000 UTC m=+2.091373499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-iptables-alerter-script\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-modprobe-d\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-netns\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-conf-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-netns\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-system-cni-dir\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a7dbd9b-664e-4bb9-b016-4879b1960508-system-cni-dir\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-conf-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.106953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.105645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.108353 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3232c456-e59c-4f15-8d3e-0758d7624cdc-tmp\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.108463 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-system-cni-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.108463 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-daemon-config\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.108463 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.108624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zcc9\" (UniqueName: \"kubernetes.io/projected/747a6e3e-dfb1-4508-9123-c8283943012a-kube-api-access-8zcc9\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.108624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8rv\" (UniqueName: \"kubernetes.io/projected/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-kube-api-access-5k8rv\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:17.108624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-run\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.108624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-sys\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.108624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.108624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-ovnkube-script-lib\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysctl-d\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4md\" (UniqueName: \"kubernetes.io/projected/29961115-3d62-44e7-9d1c-5b9a19d5207f-kube-api-access-px4md\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-kubelet\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-var-lib-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbc44c17-25c5-4ad9-b10a-ca5782438ddf-agent-certs\") pod \"konnectivity-agent-6ckhp\" (UID: \"dbc44c17-25c5-4ad9-b10a-ca5782438ddf\") " pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-dbus\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.108876 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-dbus\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.108920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-ovn\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-tuned\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109108 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/747a6e3e-dfb1-4508-9123-c8283943012a-ovn-node-metrics-cert\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109154 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-run\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109175 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-sys\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.109360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-ovnkube-config\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-host-slash\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-cni-multus\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-ovnkube-script-lib\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-multus-certs\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109813 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-run-ovn\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-env-overrides\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-kubelet-config\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.109853 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-host-slash\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.110429 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6c7\" (UniqueName: \"kubernetes.io/projected/b381fd0c-3486-4e78-8aad-8eccd5d0c551-kube-api-access-gn6c7\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.110429 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.109915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-system-cni-dir\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.110429 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.110119 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-var-lib-openvswitch\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.110597 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.110439 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:17.110597 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.110498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-env-overrides\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.110597 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.110512 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:49:17.610485976 +0000 UTC m=+2.096481242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:17.110597 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.110567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-run-multus-certs\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.110969 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.110948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.111076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-cni-multus\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.111076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/747a6e3e-dfb1-4508-9123-c8283943012a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.111193 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111142 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3232c456-e59c-4f15-8d3e-0758d7624cdc-etc-sysctl-d\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.111193 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f7f0030-f843-43ed-9b45-d0de21dc9898-host-var-lib-kubelet\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.111317 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111193 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f7f0030-f843-43ed-9b45-d0de21dc9898-multus-daemon-config\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.111673 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/747a6e3e-dfb1-4508-9123-c8283943012a-ovnkube-config\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.111756 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.111718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-kubelet-config\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.112962 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.112343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3232c456-e59c-4f15-8d3e-0758d7624cdc-tmp\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.113045 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.112956 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:49:17.113548 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.113509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.113646 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.113627 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a7dbd9b-664e-4bb9-b016-4879b1960508-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.115714 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.115679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhqtd\" (UniqueName: \"kubernetes.io/projected/ace2833d-01ca-4b37-ab1d-3227783758ba-kube-api-access-vhqtd\") pod \"aws-ebs-csi-driver-node-4m6kc\" (UID: \"ace2833d-01ca-4b37-ab1d-3227783758ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.116476 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.116423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfgkw\" (UniqueName: \"kubernetes.io/projected/7f7f0030-f843-43ed-9b45-d0de21dc9898-kube-api-access-dfgkw\") pod \"multus-5fv5c\" (UID: \"7f7f0030-f843-43ed-9b45-d0de21dc9898\") " pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.116625 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.116604 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpcw\" (UniqueName: \"kubernetes.io/projected/4ea63a46-974d-49ae-a7d4-20a11dfdfb44-kube-api-access-lrpcw\") pod \"iptables-alerter-qwssf\" (UID: \"4ea63a46-974d-49ae-a7d4-20a11dfdfb44\") " pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.116859 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.116841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98w8s\" (UniqueName: \"kubernetes.io/projected/9a7dbd9b-664e-4bb9-b016-4879b1960508-kube-api-access-98w8s\") pod \"multus-additional-cni-plugins-pqmfg\" (UID: \"9a7dbd9b-664e-4bb9-b016-4879b1960508\") " pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.118580 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.118562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rl7x\" (UniqueName: \"kubernetes.io/projected/3232c456-e59c-4f15-8d3e-0758d7624cdc-kube-api-access-8rl7x\") pod \"tuned-5mwjc\" (UID: \"3232c456-e59c-4f15-8d3e-0758d7624cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.121623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.121600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8rv\" (UniqueName: \"kubernetes.io/projected/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-kube-api-access-5k8rv\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:17.122089 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.122069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4md\" (UniqueName: \"kubernetes.io/projected/29961115-3d62-44e7-9d1c-5b9a19d5207f-kube-api-access-px4md\") pod \"node-ca-dtfl5\" (UID: \"29961115-3d62-44e7-9d1c-5b9a19d5207f\") " pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.122665 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.122648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zcc9\" (UniqueName: \"kubernetes.io/projected/747a6e3e-dfb1-4508-9123-c8283943012a-kube-api-access-8zcc9\") pod \"ovnkube-node-k9chs\" (UID: \"747a6e3e-dfb1-4508-9123-c8283943012a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.123707 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.123691 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:17.123756 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.123709 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:17.123756 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.123718 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:17.123822 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.123768 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:17.623755927 +0000 UTC m=+2.109751184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:17.127203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.127179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6c7\" (UniqueName: \"kubernetes.io/projected/b381fd0c-3486-4e78-8aad-8eccd5d0c551-kube-api-access-gn6c7\") pod \"node-resolver-mf2nr\" (UID: \"b381fd0c-3486-4e78-8aad-8eccd5d0c551\") " pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.186988 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.186962 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:49:17.206163 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.206097 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:49:17.224603 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.224580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtfl5" Sep 10 02:49:17.234274 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.234238 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29961115_3d62_44e7_9d1c_5b9a19d5207f.slice/crio-92171fb4aede121f0bb0b0089d33bb3a637b5be5364a3630b57dc41baf9d3789 WatchSource:0}: Error finding container 92171fb4aede121f0bb0b0089d33bb3a637b5be5364a3630b57dc41baf9d3789: Status 404 returned error can't find the container with id 92171fb4aede121f0bb0b0089d33bb3a637b5be5364a3630b57dc41baf9d3789 Sep 10 02:49:17.237319 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.237304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5fv5c" Sep 10 02:49:17.243903 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.243882 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7f0030_f843_43ed_9b45_d0de21dc9898.slice/crio-4bd71ecec3614d7ab2495a406736e5aec8bed1c15f475d6d7b979005ad8d1521 WatchSource:0}: Error finding container 4bd71ecec3614d7ab2495a406736e5aec8bed1c15f475d6d7b979005ad8d1521: Status 404 returned error can't find the container with id 4bd71ecec3614d7ab2495a406736e5aec8bed1c15f475d6d7b979005ad8d1521 Sep 10 02:49:17.256930 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.256906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" Sep 10 02:49:17.264908 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.264882 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7dbd9b_664e_4bb9_b016_4879b1960508.slice/crio-4f0c3c29fd27d09bf91d59a85d3fe7a0cc93a77ac1f015108f17d477ea021361 WatchSource:0}: Error finding container 4f0c3c29fd27d09bf91d59a85d3fe7a0cc93a77ac1f015108f17d477ea021361: Status 404 returned error can't find the container with id 4f0c3c29fd27d09bf91d59a85d3fe7a0cc93a77ac1f015108f17d477ea021361 Sep 10 02:49:17.268905 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.268883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwssf" Sep 10 02:49:17.275516 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.275497 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea63a46_974d_49ae_a7d4_20a11dfdfb44.slice/crio-9e0809318e951d1cc27690d4ce9830b970b130a88a22d18692a51f7ded9c7f86 WatchSource:0}: Error finding container 9e0809318e951d1cc27690d4ce9830b970b130a88a22d18692a51f7ded9c7f86: Status 404 returned error can't find the container with id 9e0809318e951d1cc27690d4ce9830b970b130a88a22d18692a51f7ded9c7f86 Sep 10 02:49:17.286432 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.286413 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:17.292833 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.292814 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747a6e3e_dfb1_4508_9123_c8283943012a.slice/crio-90aab740b7149e602db672082ef03acc1aab1f6a0842f7669d12caf96d603032 WatchSource:0}: Error finding container 90aab740b7149e602db672082ef03acc1aab1f6a0842f7669d12caf96d603032: Status 404 returned error can't find the container with id 90aab740b7149e602db672082ef03acc1aab1f6a0842f7669d12caf96d603032 Sep 10 02:49:17.300021 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.300001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:17.306801 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.306645 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc44c17_25c5_4ad9_b10a_ca5782438ddf.slice/crio-559f4160175afd1b2f2bd705b8a6ba5c11e108a6ea2791511e72e4793f973e24 WatchSource:0}: Error finding container 559f4160175afd1b2f2bd705b8a6ba5c11e108a6ea2791511e72e4793f973e24: Status 404 returned error can't find the container with id 559f4160175afd1b2f2bd705b8a6ba5c11e108a6ea2791511e72e4793f973e24 Sep 10 02:49:17.315738 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.315715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" Sep 10 02:49:17.322355 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.322333 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace2833d_01ca_4b37_ab1d_3227783758ba.slice/crio-7e1bd08d410cc4dedc9288eab9fa5329c1968ad70d86923f53c244c4c54c9993 WatchSource:0}: Error finding container 7e1bd08d410cc4dedc9288eab9fa5329c1968ad70d86923f53c244c4c54c9993: Status 404 returned error can't find the container with id 7e1bd08d410cc4dedc9288eab9fa5329c1968ad70d86923f53c244c4c54c9993 Sep 10 02:49:17.335295 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.335268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mf2nr" Sep 10 02:49:17.340106 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.340087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" Sep 10 02:49:17.342071 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.342048 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb381fd0c_3486_4e78_8aad_8eccd5d0c551.slice/crio-e6e8baa72dab06d592dd073e7e226e7010080a8bc47f2253086a8b31010c6635 WatchSource:0}: Error finding container e6e8baa72dab06d592dd073e7e226e7010080a8bc47f2253086a8b31010c6635: Status 404 returned error can't find the container with id e6e8baa72dab06d592dd073e7e226e7010080a8bc47f2253086a8b31010c6635 Sep 10 02:49:17.347290 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:17.347272 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3232c456_e59c_4f15_8d3e_0758d7624cdc.slice/crio-9ba8d3542e19e82f0d9c2133bbf74bdd074142b9143a8b716095a7fe1c368ce6 WatchSource:0}: Error finding container 9ba8d3542e19e82f0d9c2133bbf74bdd074142b9143a8b716095a7fe1c368ce6: Status 404 returned error can't find the container with id 9ba8d3542e19e82f0d9c2133bbf74bdd074142b9143a8b716095a7fe1c368ce6 Sep 10 02:49:17.613242 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.613198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:17.613413 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.613291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:17.613413 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.613339 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:17.613522 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.613417 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:18.613393312 +0000 UTC m=+3.099388585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:17.613522 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.613421 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:17.613522 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.613474 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:49:18.61345846 +0000 UTC m=+3.099453735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:17.714783 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.714548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:17.714783 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.714722 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:17.714783 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.714747 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:17.714783 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.714762 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:17.715087 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:17.714816 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:18.714796827 +0000 UTC m=+3.200792084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:17.944131 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.944047 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:44:17 +0000 UTC" deadline="2028-02-10 16:12:14.817996356 +0000 UTC" Sep 10 02:49:17.944131 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:17.944084 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12445h22m56.87391731s" Sep 10 02:49:18.037950 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.037356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:18.037950 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.037492 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:18.038615 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.038300 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:18.038615 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.038416 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:18.054980 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.054803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6ckhp" event={"ID":"dbc44c17-25c5-4ad9-b10a-ca5782438ddf","Type":"ContainerStarted","Data":"559f4160175afd1b2f2bd705b8a6ba5c11e108a6ea2791511e72e4793f973e24"} Sep 10 02:49:18.058198 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.058166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwssf" event={"ID":"4ea63a46-974d-49ae-a7d4-20a11dfdfb44","Type":"ContainerStarted","Data":"9e0809318e951d1cc27690d4ce9830b970b130a88a22d18692a51f7ded9c7f86"} Sep 10 02:49:18.062914 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.062887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerStarted","Data":"4f0c3c29fd27d09bf91d59a85d3fe7a0cc93a77ac1f015108f17d477ea021361"} Sep 10 02:49:18.075914 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.075879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5fv5c" event={"ID":"7f7f0030-f843-43ed-9b45-d0de21dc9898","Type":"ContainerStarted","Data":"4bd71ecec3614d7ab2495a406736e5aec8bed1c15f475d6d7b979005ad8d1521"} Sep 10 02:49:18.085693 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.085658 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" event={"ID":"f669ab1cb85cf052360045999e4a40a4","Type":"ContainerStarted","Data":"0830ef2db50f39e8cd88760d32a976adf6d34c18dfdaa677f1801765dbfac658"} Sep 10 02:49:18.101134 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.101075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" event={"ID":"20f67e3f1462365a445fa83981cf652e","Type":"ContainerStarted","Data":"e4656268d7d3de001c1758e91cbea7b87afb73ca7a127e7238e98ba6dce1f23b"} Sep 10 02:49:18.115713 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.115679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" event={"ID":"3232c456-e59c-4f15-8d3e-0758d7624cdc","Type":"ContainerStarted","Data":"9ba8d3542e19e82f0d9c2133bbf74bdd074142b9143a8b716095a7fe1c368ce6"} Sep 10 02:49:18.137180 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.137104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mf2nr" event={"ID":"b381fd0c-3486-4e78-8aad-8eccd5d0c551","Type":"ContainerStarted","Data":"e6e8baa72dab06d592dd073e7e226e7010080a8bc47f2253086a8b31010c6635"} Sep 10 02:49:18.152636 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.152601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" event={"ID":"ace2833d-01ca-4b37-ab1d-3227783758ba","Type":"ContainerStarted","Data":"7e1bd08d410cc4dedc9288eab9fa5329c1968ad70d86923f53c244c4c54c9993"} Sep 10 02:49:18.167804 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.167771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"90aab740b7149e602db672082ef03acc1aab1f6a0842f7669d12caf96d603032"} Sep 10 02:49:18.175435 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.175408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtfl5" event={"ID":"29961115-3d62-44e7-9d1c-5b9a19d5207f","Type":"ContainerStarted","Data":"92171fb4aede121f0bb0b0089d33bb3a637b5be5364a3630b57dc41baf9d3789"} Sep 10 02:49:18.623843 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.623799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:18.624029 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.623891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:18.624029 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.623972 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:18.624029 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.624000 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:18.624218 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.624061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:20.624032804 +0000 UTC m=+5.110028056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:18.624218 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.624083 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:49:20.624073081 +0000 UTC m=+5.110068338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:18.725506 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.724778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:18.725506 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.725018 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:18.725506 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.725041 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:18.725506 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.725055 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:18.725506 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:18.725115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:20.72509575 +0000 UTC m=+5.211091025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:18.915541 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.915459 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:49:18.944829 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.944763 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:44:17 +0000 UTC" deadline="2028-02-29 18:25:20.841591224 +0000 UTC" Sep 10 02:49:18.944829 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:18.944826 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12903h36m1.896768729s" Sep 10 02:49:19.037464 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:19.036985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:19.037464 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:19.037102 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:20.037513 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:20.036756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:20.037513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.036907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:20.037513 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:20.037370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:20.037513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.037470 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:20.642070 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:20.642026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:20.642286 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:20.642117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:20.642539 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.642302 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:20.642539 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.642370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:24.64235064 +0000 UTC m=+9.128345897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:20.642805 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.642787 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:20.642874 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.642840 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:49:24.642823779 +0000 UTC m=+9.128819039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:20.743436 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:20.743230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:20.743616 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.743467 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:20.743616 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.743507 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:20.743616 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.743521 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:20.743616 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:20.743583 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:24.743565146 +0000 UTC m=+9.229560399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:21.036599 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:21.036530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:21.036780 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:21.036681 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:22.036713 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:22.036200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:22.036713 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:22.036354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:22.036713 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:22.036372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:22.036713 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:22.036478 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:23.037053 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:23.037017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:23.037574 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:23.037170 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:24.036728 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:24.036692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:24.036728 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:24.036737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:24.036970 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.036818 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:24.037033 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.036968 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:24.675612 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:24.675007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:24.675612 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:24.675083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:24.675612 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.675234 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:24.675612 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.675297 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:32.675278537 +0000 UTC m=+17.161273810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:24.675612 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.675314 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:24.675612 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.675352 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:49:32.675340456 +0000 UTC m=+17.161335708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:24.776177 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:24.776136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:24.776379 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.776351 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:24.776458 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.776390 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:24.776458 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.776405 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:24.776562 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:24.776470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:32.776451488 +0000 UTC m=+17.262446753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:25.036215 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:25.036180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:25.036393 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:25.036338 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:26.037939 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:26.037899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:26.038534 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:26.038019 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:26.038534 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:26.038421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:26.038534 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:26.038514 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:27.036179 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:27.036151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:27.036365 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:27.036294 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:28.036370 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:28.036333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:28.036819 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:28.036333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:28.036819 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:28.036474 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:28.036819 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:28.036552 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:29.036389 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:29.036349 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:29.036812 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:29.036490 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:30.037183 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:30.037121 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:30.037638 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:30.037321 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:30.037638 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:30.037376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:30.037638 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:30.037482 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:31.036491 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:31.036455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:31.036661 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:31.036582 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:32.036626 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:32.036589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:32.037003 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.036722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:32.037003 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:32.036780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:32.037003 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.036873 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:32.735357 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:32.735320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:32.735541 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:32.735390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:32.735541 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.735479 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:32.735541 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.735494 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:32.735541 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.735539 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:49:48.735524057 +0000 UTC m=+33.221519310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:32.735712 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.735555 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:48.735548736 +0000 UTC m=+33.221543988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:32.836622 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:32.836594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:32.836792 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.836759 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:32.836792 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.836781 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:32.836792 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.836790 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:32.836916 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:32.836844 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:48.836828198 +0000 UTC m=+33.322823466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:33.036137 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:33.036102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:33.036373 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:33.036239 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:34.036568 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:34.036528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:34.036987 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:34.036671 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:34.036987 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:34.036723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:34.036987 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:34.036840 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:35.036148 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:35.036116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:35.036335 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:35.036265 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:36.037483 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:36.037446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:36.037933 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:36.037565 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:36.037933 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:36.037632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:36.037933 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:36.037746 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:37.036385 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.036362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:37.036488 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:37.036469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:37.248746 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.248623 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5fv5c" event={"ID":"7f7f0030-f843-43ed-9b45-d0de21dc9898","Type":"ContainerStarted","Data":"1eb90ddba394b0096edc50378cda91f372c371a6f2795ddfb7dede4f30421002"} Sep 10 02:49:37.268607 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.268245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" event={"ID":"20f67e3f1462365a445fa83981cf652e","Type":"ContainerStarted","Data":"ceef6ff53514e02a28b8d5ea991e0fc6fe8fc23b881484031fa26e13289ccc80"} Sep 10 02:49:37.273925 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.273897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" event={"ID":"3232c456-e59c-4f15-8d3e-0758d7624cdc","Type":"ContainerStarted","Data":"7bd2f6b0fd811be3a6a83a312783f0e5ea8585e068b6ada763bd8ad305d17e1e"} Sep 10 02:49:37.288543 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.288216 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5fv5c" podStartSLOduration=1.6195193799999998 podStartE2EDuration="21.288196409s" totalImagesPullingTime="19.668677029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:37.27334398 +0000 UTC m=+21.759339255" watchObservedRunningTime="2026-09-10 02:49:37.288196409 +0000 UTC m=+21.774191686" Sep 10 02:49:37.290709 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.290657 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" podStartSLOduration=20.290643161 podStartE2EDuration="20.290643161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:37.288940527 +0000 UTC m=+21.774935802" watchObservedRunningTime="2026-09-10 02:49:37.290643161 +0000 UTC m=+21.776638436" Sep 10 02:49:37.305697 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:37.305635 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5mwjc" podStartSLOduration=1.739719629 podStartE2EDuration="21.3056147s" totalImagesPullingTime="19.565895071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:37.305538528 +0000 UTC m=+21.791533801" watchObservedRunningTime="2026-09-10 02:49:37.3056147 +0000 UTC m=+21.791609971" Sep 10 02:49:38.036560 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.036388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:38.036703 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.036406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:38.036703 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:38.036627 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:38.036819 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:38.036709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:38.277989 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.277954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6ckhp" event={"ID":"dbc44c17-25c5-4ad9-b10a-ca5782438ddf","Type":"ContainerStarted","Data":"55f61e44d813000a514c89b7f81a5be3ce5662f8d311cd18b8f6bfd0fcf2c0a2"} Sep 10 02:49:38.279599 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.279576 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a7dbd9b-664e-4bb9-b016-4879b1960508" containerID="0b59d241ae444b6a1449c6f5b69b8e59945d6e2dfcb38b58f58cd470f9273e3c" exitCode=0 Sep 10 02:49:38.279686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.279649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerDied","Data":"0b59d241ae444b6a1449c6f5b69b8e59945d6e2dfcb38b58f58cd470f9273e3c"} Sep 10 02:49:38.281298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.281276 2578 generic.go:356] "Generic (PLEG): container finished" podID="f669ab1cb85cf052360045999e4a40a4" containerID="bc6375012e89a1938426cdccd496147a6dd0c06b97d20dd783d9e214c8925587" exitCode=0 Sep 10 02:49:38.281372 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.281356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" event={"ID":"f669ab1cb85cf052360045999e4a40a4","Type":"ContainerDied","Data":"bc6375012e89a1938426cdccd496147a6dd0c06b97d20dd783d9e214c8925587"} Sep 10 02:49:38.282971 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.282925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mf2nr" event={"ID":"b381fd0c-3486-4e78-8aad-8eccd5d0c551","Type":"ContainerStarted","Data":"cab97913c1d277454aa2e1bcd89b16556d4c162e4a3fa976cce27a6c10505aeb"} Sep 10 02:49:38.284411 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.284386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" event={"ID":"ace2833d-01ca-4b37-ab1d-3227783758ba","Type":"ContainerStarted","Data":"d6f86d5a4bcb68eb8388d92a0e3a663d037fa133b559a83657620c71f1cf651a"} Sep 10 02:49:38.287462 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.287417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"06e75ef8dc54d08cd34fce7d54b567aaa3c3e92449a99f63bfeb08c32be81f73"} Sep 10 02:49:38.287539 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.287470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"15e6109f7f3b8f2551702b9d5118afe40df0a761b5d3bf0fa0d6aac54beaa531"} Sep 10 02:49:38.287539 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.287518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"86c88d438f697a8250cc4a2b6c786d015c6c50955cafc514eaa2683e69dbaffb"} Sep 10 02:49:38.287629 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.287567 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"a16ee02e233cb0b5d3eea7fc2c99618c53505537599730c723eb2131672929b1"} Sep 10 02:49:38.287629 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.287614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"c6c616aa8c85ca0bdb580fb3cccc41238f4832eee8f599e570d6bf2f05303aab"} Sep 10 02:49:38.287696 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.287660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"d010caeb247f5ebfa4127825bfd000c1fcd6ac3b8f63b2b10cb2e145aaf2abe3"} Sep 10 02:49:38.288987 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.288957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtfl5" event={"ID":"29961115-3d62-44e7-9d1c-5b9a19d5207f","Type":"ContainerStarted","Data":"3619cd2c76ea5e324dbb743155135d4349041bf172326db618513def1e074193"} Sep 10 02:49:38.319322 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.319278 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6ckhp" podStartSLOduration=10.201997812 podStartE2EDuration="22.319264123s" totalImagesPullingTime="12.117266311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:38.301099895 +0000 UTC m=+22.787095170" watchObservedRunningTime="2026-09-10 02:49:38.319264123 +0000 UTC m=+22.805259398" Sep 10 02:49:38.334459 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.334416 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dtfl5" podStartSLOduration=2.860906842 podStartE2EDuration="22.33440106s" totalImagesPullingTime="19.473494218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:38.334131102 +0000 UTC m=+22.820126377" watchObservedRunningTime="2026-09-10 02:49:38.33440106 +0000 UTC m=+22.820396334" Sep 10 02:49:38.371697 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.371629 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mf2nr" podStartSLOduration=3.006245092 podStartE2EDuration="22.371607321s" totalImagesPullingTime="19.365362229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:38.370977964 +0000 UTC m=+22.856973370" watchObservedRunningTime="2026-09-10 02:49:38.371607321 +0000 UTC m=+22.857602597" Sep 10 02:49:38.501128 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.501079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:38.563495 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.563462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:38.960946 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:38.960922 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 02:49:39.007791 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.007607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:39.036685 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.036652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:39.036846 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:39.036782 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:39.108030 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.107955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:39.292737 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.292700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwssf" event={"ID":"4ea63a46-974d-49ae-a7d4-20a11dfdfb44","Type":"ContainerStarted","Data":"f703105d62d696f13561e2c49dfdda1814bbcc7e544d139b5363d9743c28ff65"} Sep 10 02:49:39.294720 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.294689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" event={"ID":"f669ab1cb85cf052360045999e4a40a4","Type":"ContainerStarted","Data":"ee9681b6849cf6831886ab888f88c3fdae5d8bc06e53c02c5a0dc785a45c71a2"} Sep 10 02:49:39.296604 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.296571 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" event={"ID":"ace2833d-01ca-4b37-ab1d-3227783758ba","Type":"ContainerStarted","Data":"5949b9bd793ac4eff34de300295aae352e3c5dc1624062fce3ef075866eebdd3"} Sep 10 02:49:39.309286 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.309237 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qwssf" podStartSLOduration=3.876756077 podStartE2EDuration="23.309207482s" totalImagesPullingTime="19.432451405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:39.309013357 +0000 UTC m=+23.795008630" watchObservedRunningTime="2026-09-10 02:49:39.309207482 +0000 UTC m=+23.795202755" Sep 10 02:49:39.324766 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.324724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" podStartSLOduration=22.324711299 podStartE2EDuration="22.324711299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:39.324116471 +0000 UTC m=+23.810111746" watchObservedRunningTime="2026-09-10 02:49:39.324711299 +0000 UTC m=+23.810706573" Sep 10 02:49:39.430775 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.430696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:39.528827 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.528790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:39.958552 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.958433 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T02:49:38.960941121Z","UUID":"bec682ce-22fd-47a3-92c2-30eee307c978","Handler":null,"Name":"","Endpoint":""} Sep 10 02:49:39.960408 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.960370 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 02:49:39.960544 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:39.960420 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 02:49:40.036318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.036292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:40.036442 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:40.036418 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:40.036838 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.036303 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:40.036838 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:40.036804 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:40.283563 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.283530 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:40.284232 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.284206 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:40.301548 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.301518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" event={"ID":"ace2833d-01ca-4b37-ab1d-3227783758ba","Type":"ContainerStarted","Data":"5212ffca574ae45fa972f0867286d0be586604cd595dd593d44b9cc964e6b0f9"} Sep 10 02:49:40.305508 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.305476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"aee6b152015910274a919be139797d8937a742b3fa018f8d6faa4be8dc5f22c8"} Sep 10 02:49:40.305957 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.305933 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:40.306388 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.306370 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6ckhp" Sep 10 02:49:40.385553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.385501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4m6kc" podStartSLOduration=2.699853218 podStartE2EDuration="24.38548475s" totalImagesPullingTime="21.685631532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:40.385115981 +0000 UTC m=+24.871111256" watchObservedRunningTime="2026-09-10 02:49:40.38548475 +0000 UTC m=+24.871480064" Sep 10 02:49:40.432888 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.432856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:40.935294 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:40.935255 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:41.035944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:41.035910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:41.036119 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:41.036076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:41.036195 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:41.036178 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:41.836607 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:41.836546 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:41.945077 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:41.945044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:42.036689 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:42.036657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:42.036861 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:42.036787 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:42.036861 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:42.036825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:42.036992 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:42.036897 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:42.062367 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:42.062334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:42.168082 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:42.168044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:42.987293 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:42.987257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:43.036173 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.036138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:43.036404 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:43.036290 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:43.088086 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.088058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:43.314978 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.314952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" event={"ID":"747a6e3e-dfb1-4508-9123-c8283943012a","Type":"ContainerStarted","Data":"47ec104b06f0500fe4a9be44505f3152b3f83843f35a4ac988a4cbebceb6c09d"} Sep 10 02:49:43.315285 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.315208 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:43.315395 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.315373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:43.315459 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.315411 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:43.330502 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.330477 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:43.331271 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.331253 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:49:43.344211 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:43.344157 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" podStartSLOduration=7.460080764 podStartE2EDuration="27.344138623s" totalImagesPullingTime="19.884057859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:43.343872256 +0000 UTC m=+27.829867530" watchObservedRunningTime="2026-09-10 02:49:43.344138623 +0000 UTC m=+27.830133898" Sep 10 02:49:44.037175 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:44.036987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:44.037630 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:44.037031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:44.037630 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:44.037299 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:44.037630 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:44.037332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:44.321241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:44.321104 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a7dbd9b-664e-4bb9-b016-4879b1960508" containerID="ab25f26d66c7cec440c2d01510ed9ef252adb89bd562e45d5eceeb5765d9a1c3" exitCode=0 Sep 10 02:49:44.321727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:44.321676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerDied","Data":"ab25f26d66c7cec440c2d01510ed9ef252adb89bd562e45d5eceeb5765d9a1c3"} Sep 10 02:49:44.942363 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:44.942334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:45.036955 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.036924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:45.037101 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:45.037042 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:45.464547 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.464518 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wsc8g"] Sep 10 02:49:45.465123 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.464640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:45.465123 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:45.464742 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:45.482375 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.482316 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lt6v2"] Sep 10 02:49:45.482735 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.482414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:45.482735 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:45.482505 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:45.482852 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.482755 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8g7l"] Sep 10 02:49:45.482852 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:45.482841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:45.482940 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:45.482916 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:46.328424 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:46.328155 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a7dbd9b-664e-4bb9-b016-4879b1960508" containerID="be16df9b5bd6f3fa3b8e7d7889c33cabded6510b2e52408dd6e06a2bea74cc2d" exitCode=0 Sep 10 02:49:46.328550 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:46.328251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerDied","Data":"be16df9b5bd6f3fa3b8e7d7889c33cabded6510b2e52408dd6e06a2bea74cc2d"} Sep 10 02:49:47.038106 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:47.037204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:47.038106 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:47.037352 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:47.038106 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:47.037477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:47.038106 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:47.037562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:47.038106 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:47.037631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:47.038106 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:47.037706 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:47.333624 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:47.333592 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a7dbd9b-664e-4bb9-b016-4879b1960508" containerID="aa3f31e39378bff69f53c5bef58946eb52d0db4d0fa825fa108547b72c78d1d3" exitCode=0 Sep 10 02:49:47.333756 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:47.333650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerDied","Data":"aa3f31e39378bff69f53c5bef58946eb52d0db4d0fa825fa108547b72c78d1d3"} Sep 10 02:49:48.765103 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:48.765003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:48.765103 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:48.765092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:48.765700 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.765172 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:48.765700 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.765217 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:48.765700 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.765277 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret podName:2eb59efe-5d2f-41ab-b4e4-a548795bbe44 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:20.765254421 +0000 UTC m=+65.251249690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret") pod "global-pull-secret-syncer-j8g7l" (UID: "2eb59efe-5d2f-41ab-b4e4-a548795bbe44") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:49:48.765700 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.765302 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs podName:c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe nodeName:}" failed. No retries permitted until 2026-09-10 02:50:20.765290792 +0000 UTC m=+65.251286046 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs") pod "network-metrics-daemon-wsc8g" (UID: "c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:49:48.866118 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:48.866079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:48.866313 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.866293 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:49:48.866359 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.866325 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:49:48.866359 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.866340 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2cvtf for pod openshift-network-diagnostics/network-check-target-lt6v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:48.866431 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:48.866406 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf podName:c2197572-5314-4791-b34c-49ed87a62e85 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:20.866385022 +0000 UTC m=+65.352380276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cvtf" (UniqueName: "kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf") pod "network-check-target-lt6v2" (UID: "c2197572-5314-4791-b34c-49ed87a62e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:49:49.036649 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.036615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:49.036828 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.036700 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:49.036828 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.036799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:49.036828 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:49.036808 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lt6v2" podUID="c2197572-5314-4791-b34c-49ed87a62e85" Sep 10 02:49:49.036985 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:49.036878 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8g7l" podUID="2eb59efe-5d2f-41ab-b4e4-a548795bbe44" Sep 10 02:49:49.037032 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:49.036983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wsc8g" podUID="c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe" Sep 10 02:49:49.504977 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.504880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:49.576507 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.576477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:49.804373 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.804343 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeReady" Sep 10 02:49:49.804880 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.804485 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 02:49:49.848510 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.848471 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d844c895b-dxprc"] Sep 10 02:49:49.850509 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.850483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.854801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.854774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 02:49:49.854801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.854799 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 02:49:49.855215 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.855196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 02:49:49.855315 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.855196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-glllk\"" Sep 10 02:49:49.862668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.861999 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 02:49:49.863778 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.863752 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hz9mf"] Sep 10 02:49:49.865886 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.865865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:49.870004 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.869984 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bvx8c"] Sep 10 02:49:49.871026 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.870863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 02:49:49.871334 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.871314 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nh6lc\"" Sep 10 02:49:49.871618 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.871597 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 02:49:49.871709 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.871669 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d844c895b-dxprc"] Sep 10 02:49:49.871963 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.871762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:49.874430 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.874411 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 02:49:49.874510 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.874457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 02:49:49.874681 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.874666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfrfr\"" Sep 10 02:49:49.874886 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.874868 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 02:49:49.890480 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.890457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bvx8c"] Sep 10 02:49:49.893408 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.893390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz9mf"] Sep 10 02:49:49.973149 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-image-registry-private-configuration\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973149 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:49.973447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-certificates\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-installation-pull-secrets\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-tmp-dir\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:49.973447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-bound-sa-token\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82687ebb-40cc-456c-b570-5dc4ed836c1a-ca-trust-extracted\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mdxq\" (UniqueName: \"kubernetes.io/projected/44f5c1e0-5bad-476a-8613-84ad8ee8f157-kube-api-access-6mdxq\") pod \"ingress-canary-bvx8c\" (UID: \"44f5c1e0-5bad-476a-8613-84ad8ee8f157\") " pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:49.973658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jbwg\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-kube-api-access-8jbwg\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:49.973658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmsmd\" (UniqueName: \"kubernetes.io/projected/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-kube-api-access-nmsmd\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:49.973658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f5c1e0-5bad-476a-8613-84ad8ee8f157-cert\") pod \"ingress-canary-bvx8c\" (UID: \"44f5c1e0-5bad-476a-8613-84ad8ee8f157\") " pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:49.973658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-config-volume\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:49.973658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:49.973581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-trusted-ca\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.056797 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.056720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:50.074563 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-bound-sa-token\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.074724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82687ebb-40cc-456c-b570-5dc4ed836c1a-ca-trust-extracted\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.074724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mdxq\" (UniqueName: \"kubernetes.io/projected/44f5c1e0-5bad-476a-8613-84ad8ee8f157-kube-api-access-6mdxq\") pod \"ingress-canary-bvx8c\" (UID: \"44f5c1e0-5bad-476a-8613-84ad8ee8f157\") " pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:50.074724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jbwg\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-kube-api-access-8jbwg\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.074724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmsmd\" (UniqueName: \"kubernetes.io/projected/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-kube-api-access-nmsmd\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.074925 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f5c1e0-5bad-476a-8613-84ad8ee8f157-cert\") pod \"ingress-canary-bvx8c\" (UID: \"44f5c1e0-5bad-476a-8613-84ad8ee8f157\") " pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:50.074925 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-config-volume\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.074925 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-trusted-ca\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-image-registry-private-configuration\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.075090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.074999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-certificates\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-installation-pull-secrets\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82687ebb-40cc-456c-b570-5dc4ed836c1a-ca-trust-extracted\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-tmp-dir\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.075396 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075396 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.075237 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 02:49:50.075396 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.075260 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d844c895b-dxprc: secret "image-registry-tls" not found Sep 10 02:49:50.075396 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.075319 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls podName:82687ebb-40cc-456c-b570-5dc4ed836c1a nodeName:}" failed. No retries permitted until 2026-09-10 02:49:50.575300961 +0000 UTC m=+35.061296217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls") pod "image-registry-6d844c895b-dxprc" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a") : secret "image-registry-tls" not found Sep 10 02:49:50.075598 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-config-volume\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.075598 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.075537 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 02:49:50.075598 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.075597 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls podName:3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:50.575579521 +0000 UTC m=+35.061574774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls") pod "dns-default-hz9mf" (UID: "3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8") : secret "dns-default-metrics-tls" not found Sep 10 02:49:50.075739 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-certificates\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075837 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075810 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-trusted-ca\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.075957 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.075843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-tmp-dir\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.079502 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.079480 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-installation-pull-secrets\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.079629 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.079557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f5c1e0-5bad-476a-8613-84ad8ee8f157-cert\") pod \"ingress-canary-bvx8c\" (UID: \"44f5c1e0-5bad-476a-8613-84ad8ee8f157\") " pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:50.079697 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.079644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-image-registry-private-configuration\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.085417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.085390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jbwg\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-kube-api-access-8jbwg\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.086882 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.086165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-bound-sa-token\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.086882 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.086481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mdxq\" (UniqueName: \"kubernetes.io/projected/44f5c1e0-5bad-476a-8613-84ad8ee8f157-kube-api-access-6mdxq\") pod \"ingress-canary-bvx8c\" (UID: \"44f5c1e0-5bad-476a-8613-84ad8ee8f157\") " pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:50.088678 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.088660 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmsmd\" (UniqueName: \"kubernetes.io/projected/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-kube-api-access-nmsmd\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.182033 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.181996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvx8c" Sep 10 02:49:50.462413 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.462141 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bvx8c"] Sep 10 02:49:50.466145 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:49:50.466122 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f5c1e0_5bad_476a_8613_84ad8ee8f157.slice/crio-817dcd93cf169ab624606150bdca5667f9a3b87fb3bf626a7fe8378a2d9edec5 WatchSource:0}: Error finding container 817dcd93cf169ab624606150bdca5667f9a3b87fb3bf626a7fe8378a2d9edec5: Status 404 returned error can't find the container with id 817dcd93cf169ab624606150bdca5667f9a3b87fb3bf626a7fe8378a2d9edec5 Sep 10 02:49:50.579198 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.579153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:50.579374 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:50.579267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:50.579374 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.579338 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 02:49:50.579503 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.579392 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 02:49:50.579503 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.579409 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d844c895b-dxprc: secret "image-registry-tls" not found Sep 10 02:49:50.579503 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.579419 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls podName:3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:51.579397172 +0000 UTC m=+36.065392427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls") pod "dns-default-hz9mf" (UID: "3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8") : secret "dns-default-metrics-tls" not found Sep 10 02:49:50.579503 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:50.579467 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls podName:82687ebb-40cc-456c-b570-5dc4ed836c1a nodeName:}" failed. No retries permitted until 2026-09-10 02:49:51.57944872 +0000 UTC m=+36.065443971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls") pod "image-registry-6d844c895b-dxprc" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a") : secret "image-registry-tls" not found Sep 10 02:49:51.037107 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.037073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:49:51.037107 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.037095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:49:51.037642 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.037084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:49:51.043553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.043524 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc7sq\"" Sep 10 02:49:51.043553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.043016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 02:49:51.043747 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.043598 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 02:49:51.043804 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.043752 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5skv\"" Sep 10 02:49:51.043850 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.043815 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 02:49:51.044376 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.044354 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 02:49:51.345583 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.345495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bvx8c" event={"ID":"44f5c1e0-5bad-476a-8613-84ad8ee8f157","Type":"ContainerStarted","Data":"817dcd93cf169ab624606150bdca5667f9a3b87fb3bf626a7fe8378a2d9edec5"} Sep 10 02:49:51.442963 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.442913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:51.588490 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.588452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:51.588654 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:51.588526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:51.588654 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:51.588630 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 02:49:51.588793 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:51.588658 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 02:49:51.588793 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:51.588679 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d844c895b-dxprc: secret "image-registry-tls" not found Sep 10 02:49:51.588793 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:51.588700 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls podName:3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:53.588684616 +0000 UTC m=+38.074679872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls") pod "dns-default-hz9mf" (UID: "3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8") : secret "dns-default-metrics-tls" not found Sep 10 02:49:51.588793 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:51.588746 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls podName:82687ebb-40cc-456c-b570-5dc4ed836c1a nodeName:}" failed. No retries permitted until 2026-09-10 02:49:53.588727958 +0000 UTC m=+38.074723229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls") pod "image-registry-6d844c895b-dxprc" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a") : secret "image-registry-tls" not found Sep 10 02:49:52.350119 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:52.350083 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a7dbd9b-664e-4bb9-b016-4879b1960508" containerID="236032b068e0eaf0bfffb7784aef7a70122cf2275a3c0df556604c65843c86f9" exitCode=0 Sep 10 02:49:52.350552 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:52.350129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerDied","Data":"236032b068e0eaf0bfffb7784aef7a70122cf2275a3c0df556604c65843c86f9"} Sep 10 02:49:53.070384 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.070351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:53.135796 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.135763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:53.356982 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.356899 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a7dbd9b-664e-4bb9-b016-4879b1960508" containerID="1f2949617e564ba22dd9ed9c6df75d74b22635bdb655fb84d5253aab40ac2ff0" exitCode=0 Sep 10 02:49:53.357546 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.356978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerDied","Data":"1f2949617e564ba22dd9ed9c6df75d74b22635bdb655fb84d5253aab40ac2ff0"} Sep 10 02:49:53.605886 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.605849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:53.606052 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.605912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:53.606052 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:53.606010 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 02:49:53.606052 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:53.606011 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 02:49:53.606052 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:53.606024 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d844c895b-dxprc: secret "image-registry-tls" not found Sep 10 02:49:53.606271 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:53.606121 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls podName:3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:57.606073329 +0000 UTC m=+42.092068583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls") pod "dns-default-hz9mf" (UID: "3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8") : secret "dns-default-metrics-tls" not found Sep 10 02:49:53.606271 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:53.606158 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls podName:82687ebb-40cc-456c-b570-5dc4ed836c1a nodeName:}" failed. No retries permitted until 2026-09-10 02:49:57.606140172 +0000 UTC m=+42.092135446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls") pod "image-registry-6d844c895b-dxprc" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a") : secret "image-registry-tls" not found Sep 10 02:49:53.807005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.806969 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:53.893859 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:53.893828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:54.362608 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:54.362578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" event={"ID":"9a7dbd9b-664e-4bb9-b016-4879b1960508","Type":"ContainerStarted","Data":"36f398031b7a272864fafcca049514aa81b053b144ef89edf10863aa14d82608"} Sep 10 02:49:54.401314 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:54.401266 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pqmfg" podStartSLOduration=7.508695767 podStartE2EDuration="38.40125175s" totalImagesPullingTime="30.892555983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:54.400663173 +0000 UTC m=+38.886658470" watchObservedRunningTime="2026-09-10 02:49:54.40125175 +0000 UTC m=+38.887247041" Sep 10 02:49:54.528369 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:54.528324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:54.627613 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:54.627377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:54.729801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:54.729771 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:55.366048 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:55.366011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bvx8c" event={"ID":"44f5c1e0-5bad-476a-8613-84ad8ee8f157","Type":"ContainerStarted","Data":"f4738c283e6d131d1e02e830b3b6d45ea8be263ed4d061662b42f7b1481754da"} Sep 10 02:49:55.384888 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:55.384841 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bvx8c" podStartSLOduration=2.518072729 podStartE2EDuration="6.384826428s" totalImagesPullingTime="3.866753699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:49:55.383960073 +0000 UTC m=+39.869955347" watchObservedRunningTime="2026-09-10 02:49:55.384826428 +0000 UTC m=+39.870821684" Sep 10 02:49:56.072934 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:56.072903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:56.159327 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:56.159289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:57.631092 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:57.631044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:49:57.631513 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:57.631110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:49:57.631513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:57.631216 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 02:49:57.631513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:57.631292 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls podName:3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:05.631275596 +0000 UTC m=+50.117270848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls") pod "dns-default-hz9mf" (UID: "3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8") : secret "dns-default-metrics-tls" not found Sep 10 02:49:57.631513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:57.631237 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 02:49:57.631513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:57.631325 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d844c895b-dxprc: secret "image-registry-tls" not found Sep 10 02:49:57.631513 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:57.631366 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls podName:82687ebb-40cc-456c-b570-5dc4ed836c1a nodeName:}" failed. No retries permitted until 2026-09-10 02:50:05.631355573 +0000 UTC m=+50.117350854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls") pod "image-registry-6d844c895b-dxprc" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a") : secret "image-registry-tls" not found Sep 10 02:49:58.029082 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.029000 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lf4dp"] Sep 10 02:49:58.043602 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.043570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:58.056732 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.056708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.063444 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.063271 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 02:49:58.063444 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.063315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 02:49:58.063658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.063641 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 02:49:58.063715 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.063640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 02:49:58.066544 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.066525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lf4dp"] Sep 10 02:49:58.074133 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.074115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6lnt\"" Sep 10 02:49:58.154754 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.154722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:58.235762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.235730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-crio-socket\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.235910 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.235783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-data-volume\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.235910 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.235810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r54td\" (UniqueName: \"kubernetes.io/projected/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-api-access-r54td\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.235910 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.235864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.235910 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.235902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.336701 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.336660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.336827 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.336708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.336827 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.336784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-crio-socket\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.336827 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.336806 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 02:49:58.337008 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.336844 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 02:49:58.337008 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.336864 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:58.836848288 +0000 UTC m=+43.322843539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : secret "insights-runtime-extractor-tls" not found Sep 10 02:49:58.337008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.336844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-data-volume\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.337008 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.336917 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:58.836900441 +0000 UTC m=+43.322895694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : configmap "kube-rbac-proxy" not found Sep 10 02:49:58.337008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.336954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r54td\" (UniqueName: \"kubernetes.io/projected/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-api-access-r54td\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.337280 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.337024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-crio-socket\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.337280 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.337161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-data-volume\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.342159 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.342129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:58.351767 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.351748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r54td\" (UniqueName: \"kubernetes.io/projected/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-api-access-r54td\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.489404 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.489371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:58.654578 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.654490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:58.802372 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.802319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:58.841500 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.841476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.841600 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.841507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:58.841654 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.841606 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 02:49:58.841654 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.841619 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 02:49:58.841732 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.841656 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:59.841642379 +0000 UTC m=+44.327637632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : configmap "kube-rbac-proxy" not found Sep 10 02:49:58.841732 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:58.841676 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:49:59.841662565 +0000 UTC m=+44.327657817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : secret "insights-runtime-extractor-tls" not found Sep 10 02:49:58.907457 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:58.907375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:59.012643 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:59.012608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:59.272512 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:59.272428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:59.359521 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:59.359487 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:49:59.849762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:59.849723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:59.849762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:49:59.849762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:49:59.850215 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:59.849836 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 02:49:59.850215 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:59.849896 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:01.849877977 +0000 UTC m=+46.335873244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : configmap "kube-rbac-proxy" not found Sep 10 02:49:59.850215 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:59.849894 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 02:49:59.850215 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:49:59.849958 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:01.849941836 +0000 UTC m=+46.335937088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : secret "insights-runtime-extractor-tls" not found Sep 10 02:50:00.138858 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:00.138755 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mf2nr_b381fd0c-3486-4e78-8aad-8eccd5d0c551/dns-node-resolver/0.log" Sep 10 02:50:00.735913 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:00.735755 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtfl5_29961115-3d62-44e7-9d1c-5b9a19d5207f/node-ca/0.log" Sep 10 02:50:00.854059 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:00.854003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:00.919128 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:00.919094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:01.539230 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:01.539205 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bvx8c_44f5c1e0-5bad-476a-8613-84ad8ee8f157/serve-healthcheck-canary/0.log" Sep 10 02:50:01.865564 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:01.865486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:01.865564 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:01.865518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:01.865936 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:01.865593 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 02:50:01.865936 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:01.865628 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 02:50:01.865936 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:01.865646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:05.865632478 +0000 UTC m=+50.351627730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : configmap "kube-rbac-proxy" not found Sep 10 02:50:01.865936 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:01.865679 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:05.865665584 +0000 UTC m=+50.351660836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : secret "insights-runtime-extractor-tls" not found Sep 10 02:50:02.198235 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:02.198133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:05.471993 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.471964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:05.613285 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.613252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:05.695410 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.695373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:50:05.695582 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.695452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:05.695582 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.695527 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 02:50:05.695675 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.695587 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 02:50:05.695675 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.695596 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls podName:3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:21.695580108 +0000 UTC m=+66.181575363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls") pod "dns-default-hz9mf" (UID: "3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8") : secret "dns-default-metrics-tls" not found Sep 10 02:50:05.695675 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.695600 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d844c895b-dxprc: secret "image-registry-tls" not found Sep 10 02:50:05.695675 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.695642 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls podName:82687ebb-40cc-456c-b570-5dc4ed836c1a nodeName:}" failed. No retries permitted until 2026-09-10 02:50:21.69562837 +0000 UTC m=+66.181623622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls") pod "image-registry-6d844c895b-dxprc" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a") : secret "image-registry-tls" not found Sep 10 02:50:05.735203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.735096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:05.839216 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.839172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:05.897455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.897424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:05.897455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.897458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:05.897671 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.897578 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 02:50:05.897671 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.897613 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 02:50:05.897671 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.897626 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:13.897613745 +0000 UTC m=+58.383608996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : configmap "kube-rbac-proxy" not found Sep 10 02:50:05.897793 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:05.897688 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:13.897668112 +0000 UTC m=+58.383663375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : secret "insights-runtime-extractor-tls" not found Sep 10 02:50:05.967792 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:05.967756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:06.110503 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:06.110460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:06.370688 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:06.370603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:06.749860 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:06.749767 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:07.154825 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:07.154778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:07.754208 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:07.754171 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:08.391072 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:08.391022 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:08.563631 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:08.563600 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:08.947426 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:08.947380 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:09.147682 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:09.147646 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:09.222536 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:09.222462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:09.355838 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:09.355808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:09.710387 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:09.710353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:10.159082 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:10.159046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:10.259727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:10.259688 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:10.597610 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:10.597578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:10.965215 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:10.965124 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:11.157654 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:11.157619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:11.223715 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:11.223621 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:11.563446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:11.563415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:11.943510 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:11.943425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:12.073360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:12.073325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:12.180545 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:12.180508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:12.275615 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:12.275513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:12.377446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:12.377420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:12.755643 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:12.755608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:13.632121 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.632088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:13.740209 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.740172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:13.841707 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.841666 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:13.955634 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.955545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:13.962514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.962493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:13.962622 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.962522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:13.962665 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:13.962648 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 02:50:13.962731 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:13.962718 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls podName:0c78b7ec-2446-4f36-baa4-0a0b13324fb4 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:29.962700581 +0000 UTC m=+74.448695833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf4dp" (UID: "0c78b7ec-2446-4f36-baa4-0a0b13324fb4") : secret "insights-runtime-extractor-tls" not found Sep 10 02:50:13.962996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:13.962978 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:14.355479 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:14.355439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:14.950722 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:14.950689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:15.343346 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:15.343321 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9chs" Sep 10 02:50:15.359501 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:15.359475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:15.758004 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:15.757912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:15.958047 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:15.958006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:16.251445 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:16.251397 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:20.812181 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.812136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:50:20.812584 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.812204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:50:20.815516 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.815496 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 02:50:20.816364 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.816350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 02:50:20.824920 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.824897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe-metrics-certs\") pod \"network-metrics-daemon-wsc8g\" (UID: \"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe\") " pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:50:20.825062 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.824922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2eb59efe-5d2f-41ab-b4e4-a548795bbe44-original-pull-secret\") pod \"global-pull-secret-syncer-j8g7l\" (UID: \"2eb59efe-5d2f-41ab-b4e4-a548795bbe44\") " pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:50:20.913264 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.913207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:50:20.916659 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.916643 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 02:50:20.927098 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.927075 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 02:50:20.937647 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:20.937621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvtf\" (UniqueName: \"kubernetes.io/projected/c2197572-5314-4791-b34c-49ed87a62e85-kube-api-access-2cvtf\") pod \"network-check-target-lt6v2\" (UID: \"c2197572-5314-4791-b34c-49ed87a62e85\") " pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:50:21.056072 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.056043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5skv\"" Sep 10 02:50:21.059667 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.059651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8g7l" Sep 10 02:50:21.063797 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.063754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wsc8g" Sep 10 02:50:21.068597 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.068575 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc7sq\"" Sep 10 02:50:21.076625 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.076601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:50:21.340566 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.340534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8g7l"] Sep 10 02:50:21.341413 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.341388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wsc8g"] Sep 10 02:50:21.343039 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:21.343015 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58dc4c7_2f61_4946_8e3b_1e6ca4ad75fe.slice/crio-e7645bf709aa6ca42341d6d12b83b6367c4e8d6ec0f1408cc34d0ee9704811cd WatchSource:0}: Error finding container e7645bf709aa6ca42341d6d12b83b6367c4e8d6ec0f1408cc34d0ee9704811cd: Status 404 returned error can't find the container with id e7645bf709aa6ca42341d6d12b83b6367c4e8d6ec0f1408cc34d0ee9704811cd Sep 10 02:50:21.344794 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:21.344768 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb59efe_5d2f_41ab_b4e4_a548795bbe44.slice/crio-5421e5d1d235adeb4760893874751943b8a57a255b0c44969f3f8b6d6fafaa99 WatchSource:0}: Error finding container 5421e5d1d235adeb4760893874751943b8a57a255b0c44969f3f8b6d6fafaa99: Status 404 returned error can't find the container with id 5421e5d1d235adeb4760893874751943b8a57a255b0c44969f3f8b6d6fafaa99 Sep 10 02:50:21.381813 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.381792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lt6v2"] Sep 10 02:50:21.383756 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:21.383733 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2197572_5314_4791_b34c_49ed87a62e85.slice/crio-d3938d09108fbeb066ba44fa3bd4dbdb2b8cf7f582c4a94598e6ce65ce01b46d WatchSource:0}: Error finding container d3938d09108fbeb066ba44fa3bd4dbdb2b8cf7f582c4a94598e6ce65ce01b46d: Status 404 returned error can't find the container with id d3938d09108fbeb066ba44fa3bd4dbdb2b8cf7f582c4a94598e6ce65ce01b46d Sep 10 02:50:21.425070 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.425036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lt6v2" event={"ID":"c2197572-5314-4791-b34c-49ed87a62e85","Type":"ContainerStarted","Data":"d3938d09108fbeb066ba44fa3bd4dbdb2b8cf7f582c4a94598e6ce65ce01b46d"} Sep 10 02:50:21.426171 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.426144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wsc8g" event={"ID":"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe","Type":"ContainerStarted","Data":"e7645bf709aa6ca42341d6d12b83b6367c4e8d6ec0f1408cc34d0ee9704811cd"} Sep 10 02:50:21.427173 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.427150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8g7l" event={"ID":"2eb59efe-5d2f-41ab-b4e4-a548795bbe44","Type":"ContainerStarted","Data":"5421e5d1d235adeb4760893874751943b8a57a255b0c44969f3f8b6d6fafaa99"} Sep 10 02:50:21.719130 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.719045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:21.719130 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.719104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:50:21.721538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.721508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8-metrics-tls\") pod \"dns-default-hz9mf\" (UID: \"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8\") " pod="openshift-dns/dns-default-hz9mf" Sep 10 02:50:21.721638 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.721550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"image-registry-6d844c895b-dxprc\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:21.953449 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.953416 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv"] Sep 10 02:50:21.956676 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.956650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:21.957458 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.957432 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-wzq6t"] Sep 10 02:50:21.959890 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.959681 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 02:50:21.960965 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.960491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:21.960965 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.960831 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 02:50:21.961142 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.961119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 02:50:21.961627 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.961609 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 02:50:21.961730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.961638 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb"] Sep 10 02:50:21.962902 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.962708 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 02:50:21.963051 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.963035 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ckmf2\"" Sep 10 02:50:21.963151 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.963066 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 02:50:21.964470 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.964451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:21.969317 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.969163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 02:50:21.969405 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.969347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jlpwj\"" Sep 10 02:50:21.970086 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.970067 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-glllk\"" Sep 10 02:50:21.976713 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.976547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:21.980278 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.980255 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d844c895b-dxprc"] Sep 10 02:50:21.982542 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.982520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv"] Sep 10 02:50:21.982642 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.982565 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-wzq6t"] Sep 10 02:50:21.983922 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.983726 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb"] Sep 10 02:50:21.983922 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.983743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nh6lc\"" Sep 10 02:50:21.986699 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:21.986554 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz9mf" Sep 10 02:50:22.021476 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4513bfe4-9e7f-4104-9032-01cf0a1763ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dff96694-kc2xb\" (UID: \"4513bfe4-9e7f-4104-9032-01cf0a1763ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.021579 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99da6d7e-3ba5-4c65-b829-56cda16a1e69-tmp\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.021579 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp884\" (UniqueName: \"kubernetes.io/projected/99da6d7e-3ba5-4c65-b829-56cda16a1e69-kube-api-access-vp884\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.021644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b5ec103c-9f3f-4163-b577-702b97294a29-nginx-conf\") pod \"networking-console-plugin-79977f9844-wzq6t\" (UID: \"b5ec103c-9f3f-4163-b577-702b97294a29\") " pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.021644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b5ec103c-9f3f-4163-b577-702b97294a29-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-wzq6t\" (UID: \"b5ec103c-9f3f-4163-b577-702b97294a29\") " pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.021712 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/99da6d7e-3ba5-4c65-b829-56cda16a1e69-klusterlet-config\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.021712 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.021675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5nlb\" (UniqueName: \"kubernetes.io/projected/4513bfe4-9e7f-4104-9032-01cf0a1763ae-kube-api-access-k5nlb\") pod \"managed-serviceaccount-addon-agent-6dff96694-kc2xb\" (UID: \"4513bfe4-9e7f-4104-9032-01cf0a1763ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.122488 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/99da6d7e-3ba5-4c65-b829-56cda16a1e69-klusterlet-config\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.122646 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5nlb\" (UniqueName: \"kubernetes.io/projected/4513bfe4-9e7f-4104-9032-01cf0a1763ae-kube-api-access-k5nlb\") pod \"managed-serviceaccount-addon-agent-6dff96694-kc2xb\" (UID: \"4513bfe4-9e7f-4104-9032-01cf0a1763ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.122646 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4513bfe4-9e7f-4104-9032-01cf0a1763ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dff96694-kc2xb\" (UID: \"4513bfe4-9e7f-4104-9032-01cf0a1763ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.122646 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99da6d7e-3ba5-4c65-b829-56cda16a1e69-tmp\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.122646 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp884\" (UniqueName: \"kubernetes.io/projected/99da6d7e-3ba5-4c65-b829-56cda16a1e69-kube-api-access-vp884\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.122905 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b5ec103c-9f3f-4163-b577-702b97294a29-nginx-conf\") pod \"networking-console-plugin-79977f9844-wzq6t\" (UID: \"b5ec103c-9f3f-4163-b577-702b97294a29\") " pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.122905 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.122684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b5ec103c-9f3f-4163-b577-702b97294a29-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-wzq6t\" (UID: \"b5ec103c-9f3f-4163-b577-702b97294a29\") " pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.124206 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.123836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99da6d7e-3ba5-4c65-b829-56cda16a1e69-tmp\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.124586 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.124556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b5ec103c-9f3f-4163-b577-702b97294a29-nginx-conf\") pod \"networking-console-plugin-79977f9844-wzq6t\" (UID: \"b5ec103c-9f3f-4163-b577-702b97294a29\") " pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.127798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.127774 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b5ec103c-9f3f-4163-b577-702b97294a29-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-wzq6t\" (UID: \"b5ec103c-9f3f-4163-b577-702b97294a29\") " pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.129020 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.128946 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/99da6d7e-3ba5-4c65-b829-56cda16a1e69-klusterlet-config\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.133477 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.133445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:22.134129 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.134103 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4513bfe4-9e7f-4104-9032-01cf0a1763ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dff96694-kc2xb\" (UID: \"4513bfe4-9e7f-4104-9032-01cf0a1763ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.135542 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.135520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp884\" (UniqueName: \"kubernetes.io/projected/99da6d7e-3ba5-4c65-b829-56cda16a1e69-kube-api-access-vp884\") pod \"klusterlet-addon-workmgr-99f986685-dhptv\" (UID: \"99da6d7e-3ba5-4c65-b829-56cda16a1e69\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.145666 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.145621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5nlb\" (UniqueName: \"kubernetes.io/projected/4513bfe4-9e7f-4104-9032-01cf0a1763ae-kube-api-access-k5nlb\") pod \"managed-serviceaccount-addon-agent-6dff96694-kc2xb\" (UID: \"4513bfe4-9e7f-4104-9032-01cf0a1763ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.240959 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.240873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:22.273295 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.273263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:22.287168 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.286994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" Sep 10 02:50:22.296028 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.296006 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz9mf"] Sep 10 02:50:22.298577 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:22.298549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbc2bf4_76f2_49f5_a554_2c2e7782c4c8.slice/crio-1ffec5725f1e73803e7ab7f913c1e594774cef63e084f4733462a033d8f0d6e0 WatchSource:0}: Error finding container 1ffec5725f1e73803e7ab7f913c1e594774cef63e084f4733462a033d8f0d6e0: Status 404 returned error can't find the container with id 1ffec5725f1e73803e7ab7f913c1e594774cef63e084f4733462a033d8f0d6e0 Sep 10 02:50:22.302058 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.301954 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d844c895b-dxprc"] Sep 10 02:50:22.306296 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.306079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" Sep 10 02:50:22.348017 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.347952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:22.435358 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.434944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" event={"ID":"82687ebb-40cc-456c-b570-5dc4ed836c1a","Type":"ContainerStarted","Data":"002d93255772b315487e4d701ccbd0e18aa5504cde34a39c6a7c979a2b8b00ed"} Sep 10 02:50:22.435358 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.435003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" event={"ID":"82687ebb-40cc-456c-b570-5dc4ed836c1a","Type":"ContainerStarted","Data":"26e16aec0f35d3e4650795f07fdab38f565fd6c7a0691ebe21dcf872b4682f79"} Sep 10 02:50:22.435676 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.435616 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:22.438182 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.438117 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz9mf" event={"ID":"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8","Type":"ContainerStarted","Data":"1ffec5725f1e73803e7ab7f913c1e594774cef63e084f4733462a033d8f0d6e0"} Sep 10 02:50:22.464324 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.463962 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" podStartSLOduration=33.463942489 podStartE2EDuration="33.463942489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:22.463339121 +0000 UTC m=+66.949334396" watchObservedRunningTime="2026-09-10 02:50:22.463942489 +0000 UTC m=+66.949937763" Sep 10 02:50:22.591020 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.590989 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-wzq6t"] Sep 10 02:50:22.591145 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.591094 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv"] Sep 10 02:50:22.623835 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:22.623800 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb"] Sep 10 02:50:23.444052 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.444012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" event={"ID":"4513bfe4-9e7f-4104-9032-01cf0a1763ae","Type":"ContainerStarted","Data":"1c365ede1838eca1df9d13651b50dd5404aa881d94d338d21658fc17f6ce29aa"} Sep 10 02:50:23.448922 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.448891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wsc8g" event={"ID":"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe","Type":"ContainerStarted","Data":"c1ee43a2364ed258944f33e701a6cbd49384b1abc06078860ec837bd62f23d03"} Sep 10 02:50:23.449076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.448951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wsc8g" event={"ID":"c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe","Type":"ContainerStarted","Data":"99e5ea87b8729167a31349698bccbdf20dd77bc570e45209d2c8b96d38180d38"} Sep 10 02:50:23.452035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.452004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" event={"ID":"99da6d7e-3ba5-4c65-b829-56cda16a1e69","Type":"ContainerStarted","Data":"524973ec11647e29ec99a33d163ebd84264b8f535a88dd84f177ef3b78373ee3"} Sep 10 02:50:23.454400 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.454356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" event={"ID":"b5ec103c-9f3f-4163-b577-702b97294a29","Type":"ContainerStarted","Data":"194177a9d07cbcbcb87893dfb178196ee7d07b5e93c34b5ea25134132786c772"} Sep 10 02:50:23.467339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.467290 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wsc8g" podStartSLOduration=66.011178367 podStartE2EDuration="1m7.467275426s" totalImagesPullingTime="1.456097059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:23.466493243 +0000 UTC m=+67.952488553" watchObservedRunningTime="2026-09-10 02:50:23.467275426 +0000 UTC m=+67.953270701" Sep 10 02:50:23.579520 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.579366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:23.648162 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:23.648129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:24.464318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:24.464260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:24.598131 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:24.598098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:24.680548 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:24.680494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:24.892944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:24.892838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:27.560061 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.560010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:27.649612 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.649581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:27.752733 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.752693 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-mp7lj"] Sep 10 02:50:27.756215 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.756180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:27.775179 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.773899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.775179 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.775114 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-mp7lj"] Sep 10 02:50:27.782908 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.782882 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 02:50:27.782908 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.782898 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 02:50:27.783151 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.783133 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 02:50:27.783740 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.783409 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 02:50:27.783740 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.783594 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 02:50:27.783740 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.783735 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ktvqr\"" Sep 10 02:50:27.849806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.849726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:27.870775 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.870738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ac7615-b6a5-495d-bee5-9218bfbb6202-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.870940 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.870796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszq4\" (UniqueName: \"kubernetes.io/projected/f9ac7615-b6a5-495d-bee5-9218bfbb6202-kube-api-access-qszq4\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.870940 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.870850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ac7615-b6a5-495d-bee5-9218bfbb6202-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.870940 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.870891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ac7615-b6a5-495d-bee5-9218bfbb6202-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.971857 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.971824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ac7615-b6a5-495d-bee5-9218bfbb6202-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.972030 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.971866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszq4\" (UniqueName: \"kubernetes.io/projected/f9ac7615-b6a5-495d-bee5-9218bfbb6202-kube-api-access-qszq4\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.972030 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.971910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ac7615-b6a5-495d-bee5-9218bfbb6202-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.972030 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.971953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ac7615-b6a5-495d-bee5-9218bfbb6202-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.972727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.972693 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9ac7615-b6a5-495d-bee5-9218bfbb6202-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.974836 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.974806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ac7615-b6a5-495d-bee5-9218bfbb6202-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.974969 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.974901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9ac7615-b6a5-495d-bee5-9218bfbb6202-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:27.982574 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:27.982551 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszq4\" (UniqueName: \"kubernetes.io/projected/f9ac7615-b6a5-495d-bee5-9218bfbb6202-kube-api-access-qszq4\") pod \"prometheus-operator-6f4946db56-mp7lj\" (UID: \"f9ac7615-b6a5-495d-bee5-9218bfbb6202\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:28.107519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:28.107427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" Sep 10 02:50:28.182174 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:28.182113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:28.280378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:28.280331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:29.988786 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:29.988734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:29.991519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:29.991485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c78b7ec-2446-4f36-baa4-0a0b13324fb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf4dp\" (UID: \"0c78b7ec-2446-4f36-baa4-0a0b13324fb4\") " pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:30.172469 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:30.172439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6lnt\"" Sep 10 02:50:30.179752 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:30.179728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lf4dp" Sep 10 02:50:31.300579 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.300147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:31.395576 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.395499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-mp7lj"] Sep 10 02:50:31.399459 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:31.399428 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ac7615_b6a5_495d_bee5_9218bfbb6202.slice/crio-a54421b0a0a3d1fe375b1a3242f7aaadcf61dd474e1158f17904a2d7b9201939 WatchSource:0}: Error finding container a54421b0a0a3d1fe375b1a3242f7aaadcf61dd474e1158f17904a2d7b9201939: Status 404 returned error can't find the container with id a54421b0a0a3d1fe375b1a3242f7aaadcf61dd474e1158f17904a2d7b9201939 Sep 10 02:50:31.407847 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.407787 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lf4dp"] Sep 10 02:50:31.410365 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.410338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:31.411496 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:31.411469 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c78b7ec_2446_4f36_baa4_0a0b13324fb4.slice/crio-3903346d621317a4d549d9d2e0b6f49cc1787fa396f6c9f82b4a32a9e36bdfae WatchSource:0}: Error finding container 3903346d621317a4d549d9d2e0b6f49cc1787fa396f6c9f82b4a32a9e36bdfae: Status 404 returned error can't find the container with id 3903346d621317a4d549d9d2e0b6f49cc1787fa396f6c9f82b4a32a9e36bdfae Sep 10 02:50:31.495300 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.495253 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lt6v2" event={"ID":"c2197572-5314-4791-b34c-49ed87a62e85","Type":"ContainerStarted","Data":"87ce2946c3729509e805b3f252e6eeaedd34c00c7cb3660c3df1f7f97f3e3892"} Sep 10 02:50:31.495456 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.495349 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:50:31.497216 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.497185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8g7l" event={"ID":"2eb59efe-5d2f-41ab-b4e4-a548795bbe44","Type":"ContainerStarted","Data":"ae76c78899edf32a9c86780374a0a7f0221b19863c419425e234515a08b2d016"} Sep 10 02:50:31.498729 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.498700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" event={"ID":"99da6d7e-3ba5-4c65-b829-56cda16a1e69","Type":"ContainerStarted","Data":"cb304ab390c4edc8dc6d0b3b6433dda1278f067c1b556849fc41b84595a99881"} Sep 10 02:50:31.498836 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.498745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:31.500301 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.500265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" event={"ID":"f9ac7615-b6a5-495d-bee5-9218bfbb6202","Type":"ContainerStarted","Data":"a54421b0a0a3d1fe375b1a3242f7aaadcf61dd474e1158f17904a2d7b9201939"} Sep 10 02:50:31.501694 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.501676 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" Sep 10 02:50:31.502159 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.502142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz9mf" event={"ID":"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8","Type":"ContainerStarted","Data":"f575d3ce22fbac3e26b06a323968df98e3f2e4b36469f02c43e5ec244c641e72"} Sep 10 02:50:31.502255 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.502180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz9mf" event={"ID":"3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8","Type":"ContainerStarted","Data":"874206259e6364784c3d9fdfd7522100494955b3e46e7d996787f2d758f2eef0"} Sep 10 02:50:31.502255 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.502217 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hz9mf" Sep 10 02:50:31.503750 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.503730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" event={"ID":"b5ec103c-9f3f-4163-b577-702b97294a29","Type":"ContainerStarted","Data":"016849f03601041601aefeaec43dba9b5b14db32454656f690263c53be09b95a"} Sep 10 02:50:31.505482 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.505463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf4dp" event={"ID":"0c78b7ec-2446-4f36-baa4-0a0b13324fb4","Type":"ContainerStarted","Data":"1e8f74da898d1fb2964748a45fabd6c3af94731e566a2ed88b06bdad92a34e2d"} Sep 10 02:50:31.505558 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.505497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf4dp" event={"ID":"0c78b7ec-2446-4f36-baa4-0a0b13324fb4","Type":"ContainerStarted","Data":"3903346d621317a4d549d9d2e0b6f49cc1787fa396f6c9f82b4a32a9e36bdfae"} Sep 10 02:50:31.507600 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.507579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" event={"ID":"4513bfe4-9e7f-4104-9032-01cf0a1763ae","Type":"ContainerStarted","Data":"f09902536ecf32844b8e2f0961aa34e630862e95efa3e8f78540a2cda522a5fe"} Sep 10 02:50:31.516963 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.516909 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lt6v2" podStartSLOduration=65.806487011 podStartE2EDuration="1m15.516891388s" totalImagesPullingTime="9.710404377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:31.516050918 +0000 UTC m=+76.002046193" watchObservedRunningTime="2026-09-10 02:50:31.516891388 +0000 UTC m=+76.002886666" Sep 10 02:50:31.539077 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.539027 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j8g7l" podStartSLOduration=65.787754989 podStartE2EDuration="1m15.539012486s" totalImagesPullingTime="9.751257497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:31.537679038 +0000 UTC m=+76.023674312" watchObservedRunningTime="2026-09-10 02:50:31.539012486 +0000 UTC m=+76.025007809" Sep 10 02:50:31.587214 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.587161 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hz9mf" podStartSLOduration=33.793485476 podStartE2EDuration="42.58714678s" totalImagesPullingTime="8.793661304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:31.56133573 +0000 UTC m=+76.047331004" watchObservedRunningTime="2026-09-10 02:50:31.58714678 +0000 UTC m=+76.073142076" Sep 10 02:50:31.587421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.587283 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dff96694-kc2xb" podStartSLOduration=2.179324015 podStartE2EDuration="10.587277055s" totalImagesPullingTime="8.40795304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:31.586665604 +0000 UTC m=+76.072660882" watchObservedRunningTime="2026-09-10 02:50:31.587277055 +0000 UTC m=+76.073272329" Sep 10 02:50:31.606968 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.606917 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f986685-dhptv" podStartSLOduration=2.26655979 podStartE2EDuration="10.606904094s" totalImagesPullingTime="8.340344304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:31.606436245 +0000 UTC m=+76.092431518" watchObservedRunningTime="2026-09-10 02:50:31.606904094 +0000 UTC m=+76.092899359" Sep 10 02:50:31.628334 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.628208 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-wzq6t" podStartSLOduration=2.288558424 podStartE2EDuration="10.62819321s" totalImagesPullingTime="8.339634786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:31.627031359 +0000 UTC m=+76.113026635" watchObservedRunningTime="2026-09-10 02:50:31.62819321 +0000 UTC m=+76.114188485" Sep 10 02:50:31.854622 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:31.854588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:32.085646 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:32.085619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:32.513782 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:32.513636 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf4dp" event={"ID":"0c78b7ec-2446-4f36-baa4-0a0b13324fb4","Type":"ContainerStarted","Data":"212254da2f081ec01e77f6bbe318d25ad45d5ada749ba78741d9ef4a9200537a"} Sep 10 02:50:33.040910 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:33.040874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:33.520279 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:33.520192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" event={"ID":"f9ac7615-b6a5-495d-bee5-9218bfbb6202","Type":"ContainerStarted","Data":"78f5edbd95217edce3625e7428c4511c3d23dcd924372174765388f26b471699"} Sep 10 02:50:33.520279 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:33.520271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" event={"ID":"f9ac7615-b6a5-495d-bee5-9218bfbb6202","Type":"ContainerStarted","Data":"fabe776165651a0c0924b401b31233cdce9ddf55ea5f4619c829d3f132a96ed0"} Sep 10 02:50:33.541013 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:33.540954 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-mp7lj" podStartSLOduration=5.2419565200000005 podStartE2EDuration="6.540936136s" totalImagesPullingTime="1.298979616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:33.539746596 +0000 UTC m=+78.025741871" watchObservedRunningTime="2026-09-10 02:50:33.540936136 +0000 UTC m=+78.026931411" Sep 10 02:50:34.528271 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:34.528217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf4dp" event={"ID":"0c78b7ec-2446-4f36-baa4-0a0b13324fb4","Type":"ContainerStarted","Data":"6fc558680cc92fea0961296700dfe927ef2dabd1caa6a3c678225a5f74065cd5"} Sep 10 02:50:34.550365 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:34.550310 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lf4dp" podStartSLOduration=35.521916035 podStartE2EDuration="37.550292855s" totalImagesPullingTime="2.02837682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:49:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:34.549258761 +0000 UTC m=+79.035254034" watchObservedRunningTime="2026-09-10 02:50:34.550292855 +0000 UTC m=+79.036288128" Sep 10 02:50:34.953653 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:34.953614 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.169967 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.169931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.294594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.294566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.460057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.460018 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4z5pg"] Sep 10 02:50:35.463305 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.463280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.463442 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.463340 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-599nn"] Sep 10 02:50:35.466503 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.466484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.467425 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.467400 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 02:50:35.467539 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.467523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 02:50:35.467885 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.467756 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 02:50:35.467885 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.467820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xskv2\"" Sep 10 02:50:35.471821 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.471799 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 02:50:35.472172 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.472144 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 02:50:35.472285 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.472175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 02:50:35.472435 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.472415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dlffc\"" Sep 10 02:50:35.473422 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.473399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.493753 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.493728 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-599nn"] Sep 10 02:50:35.533477 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb7c7776-3d90-4223-9c54-69ea5b694392-metrics-client-ca\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533477 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81661d94-ead3-4f8f-9630-e08126de5c00-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81661d94-ead3-4f8f-9630-e08126de5c00-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-textfile\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-wtmp\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-accelerators-collector-config\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-sys\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf925\" (UniqueName: \"kubernetes.io/projected/81661d94-ead3-4f8f-9630-e08126de5c00-kube-api-access-zf925\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-root\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnct\" (UniqueName: \"kubernetes.io/projected/fb7c7776-3d90-4223-9c54-69ea5b694392-kube-api-access-8pnct\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-tls\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.533912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.533786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.604468 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.604375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.634451 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.634598 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf925\" (UniqueName: \"kubernetes.io/projected/81661d94-ead3-4f8f-9630-e08126de5c00-kube-api-access-zf925\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.634598 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-root\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.634598 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.634598 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnct\" (UniqueName: \"kubernetes.io/projected/fb7c7776-3d90-4223-9c54-69ea5b694392-kube-api-access-8pnct\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.634806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-root\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.634806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-tls\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.634806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.634806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.634806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb7c7776-3d90-4223-9c54-69ea5b694392-metrics-client-ca\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.634806 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81661d94-ead3-4f8f-9630-e08126de5c00-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.635112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81661d94-ead3-4f8f-9630-e08126de5c00-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.635112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-textfile\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-wtmp\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-accelerators-collector-config\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.634969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-sys\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-sys\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-wtmp\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.635594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635414 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-textfile\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.635594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81661d94-ead3-4f8f-9630-e08126de5c00-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.635594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81661d94-ead3-4f8f-9630-e08126de5c00-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.635996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635979 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-accelerators-collector-config\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.636049 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.635998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb7c7776-3d90-4223-9c54-69ea5b694392-metrics-client-ca\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.637721 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.637686 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.637837 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.637749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.637837 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.637773 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb7c7776-3d90-4223-9c54-69ea5b694392-node-exporter-tls\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.638060 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.638041 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81661d94-ead3-4f8f-9630-e08126de5c00-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.643029 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.642996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf925\" (UniqueName: \"kubernetes.io/projected/81661d94-ead3-4f8f-9630-e08126de5c00-kube-api-access-zf925\") pod \"kube-state-metrics-74cb57df7-599nn\" (UID: \"81661d94-ead3-4f8f-9630-e08126de5c00\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.643456 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.643435 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnct\" (UniqueName: \"kubernetes.io/projected/fb7c7776-3d90-4223-9c54-69ea5b694392-kube-api-access-8pnct\") pod \"node-exporter-4z5pg\" (UID: \"fb7c7776-3d90-4223-9c54-69ea5b694392\") " pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.688396 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.688369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.773062 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.773019 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4z5pg" Sep 10 02:50:35.778962 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.778937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" Sep 10 02:50:35.783931 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:35.783901 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7c7776_3d90_4223_9c54_69ea5b694392.slice/crio-c5b1c640fbd7a719e084b59add4ac9ea0273b4902e9837bac064f25c69599e7b WatchSource:0}: Error finding container c5b1c640fbd7a719e084b59add4ac9ea0273b4902e9837bac064f25c69599e7b: Status 404 returned error can't find the container with id c5b1c640fbd7a719e084b59add4ac9ea0273b4902e9837bac064f25c69599e7b Sep 10 02:50:35.842150 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.842063 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:35.938092 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:35.938008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.087099 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.087064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-599nn"] Sep 10 02:50:36.090512 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:36.090485 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81661d94_ead3_4f8f_9630_e08126de5c00.slice/crio-81ca7e364fb6b68ec33dc81a3c834c1b4852e86d7d0f1a564b0d40168fa25be6 WatchSource:0}: Error finding container 81ca7e364fb6b68ec33dc81a3c834c1b4852e86d7d0f1a564b0d40168fa25be6: Status 404 returned error can't find the container with id 81ca7e364fb6b68ec33dc81a3c834c1b4852e86d7d0f1a564b0d40168fa25be6 Sep 10 02:50:36.221714 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.221631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.300686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.300643 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.309532 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.309504 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:50:36.314695 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.314674 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.317658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.317640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 02:50:36.317912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.317897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 02:50:36.317972 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.317896 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 02:50:36.318159 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.318143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 02:50:36.318259 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.318143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 02:50:36.318259 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.318184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 02:50:36.318448 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.318436 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 02:50:36.320399 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.320382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 02:50:36.320513 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.320497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s8gw8\"" Sep 10 02:50:36.324182 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.324165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 02:50:36.336535 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.336510 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:50:36.425523 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.425492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.441512 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.441724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.441724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.441724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.441724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.441724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.441724 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.442001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.442001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.442001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8v7\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-kube-api-access-zb8v7\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.442001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-config-out\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.442001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.442001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.441895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-web-config\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.538000 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.537965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4z5pg" event={"ID":"fb7c7776-3d90-4223-9c54-69ea5b694392","Type":"ContainerStarted","Data":"c5b1c640fbd7a719e084b59add4ac9ea0273b4902e9837bac064f25c69599e7b"} Sep 10 02:50:36.539823 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.539791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" event={"ID":"81661d94-ead3-4f8f-9630-e08126de5c00","Type":"ContainerStarted","Data":"81ca7e364fb6b68ec33dc81a3c834c1b4852e86d7d0f1a564b0d40168fa25be6"} Sep 10 02:50:36.543338 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543338 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543519 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543786 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543786 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8v7\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-kube-api-access-zb8v7\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543786 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-config-out\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543786 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.543786 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-web-config\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.544006 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.543939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.545298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.544800 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.545298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.545193 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.545480 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:36.545355 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 10 02:50:36.545480 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:50:36.545416 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls podName:0d968579-9266-4fef-981c-e161b1677946 nodeName:}" failed. No retries permitted until 2026-09-10 02:50:37.045397183 +0000 UTC m=+81.531392446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0d968579-9266-4fef-981c-e161b1677946") : secret "alertmanager-main-tls" not found Sep 10 02:50:36.546751 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.546726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.546863 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.546794 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.547203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.547155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-web-config\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.547311 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.547258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.547754 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.547730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.548006 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.547987 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-config-out\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.548298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.548278 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.549695 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.549677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.553100 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.553082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8v7\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-kube-api-access-zb8v7\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:36.624690 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.624651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.724932 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.724846 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.825433 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.825339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:36.931076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:36.931005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:37.028685 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.028648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:37.048887 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.048856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:37.051595 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.051571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:37.225277 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.225177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:50:37.533005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.532970 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:50:37.544934 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.544896 2578 generic.go:356] "Generic (PLEG): container finished" podID="fb7c7776-3d90-4223-9c54-69ea5b694392" containerID="217839e59cc52d1311acaa1c32211b2ea10bc2e457f641aeaed50cb1fcbfb809" exitCode=0 Sep 10 02:50:37.545349 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:37.544962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4z5pg" event={"ID":"fb7c7776-3d90-4223-9c54-69ea5b694392","Type":"ContainerDied","Data":"217839e59cc52d1311acaa1c32211b2ea10bc2e457f641aeaed50cb1fcbfb809"} Sep 10 02:50:37.656383 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:37.656353 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d968579_9266_4fef_981c_e161b1677946.slice/crio-940b4cbc1f30b43c4c68f113a41a086c6663ce33d6c5537eb76f3e6ee7eb1c2a WatchSource:0}: Error finding container 940b4cbc1f30b43c4c68f113a41a086c6663ce33d6c5537eb76f3e6ee7eb1c2a: Status 404 returned error can't find the container with id 940b4cbc1f30b43c4c68f113a41a086c6663ce33d6c5537eb76f3e6ee7eb1c2a Sep 10 02:50:38.231056 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.230963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:38.404104 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.404070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:38.481711 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.481624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:38.550954 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.550918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4z5pg" event={"ID":"fb7c7776-3d90-4223-9c54-69ea5b694392","Type":"ContainerStarted","Data":"4857aa974a5ac471dc4f47280c73faced297569052d1598f7026290aa29b5b7b"} Sep 10 02:50:38.551419 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.550982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4z5pg" event={"ID":"fb7c7776-3d90-4223-9c54-69ea5b694392","Type":"ContainerStarted","Data":"06a6c81e6386ca5996e665c0bdf64ba99667bf8cb84bc15b9099ffc05d4d1bb4"} Sep 10 02:50:38.553133 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.553106 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" event={"ID":"81661d94-ead3-4f8f-9630-e08126de5c00","Type":"ContainerStarted","Data":"5c8cfd6ea36b9ab2ca076b2bccf4f6c9599a1cfdecdf5581548b42cc690682f4"} Sep 10 02:50:38.553255 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.553160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" event={"ID":"81661d94-ead3-4f8f-9630-e08126de5c00","Type":"ContainerStarted","Data":"92d42dfa48500fef3361733a764f880f19344780af7db871d6d5364dfab07d78"} Sep 10 02:50:38.553255 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.553196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" event={"ID":"81661d94-ead3-4f8f-9630-e08126de5c00","Type":"ContainerStarted","Data":"a46b635f7118a1f32e0f9365ade63a52905e42e777bfaea5b59d8f12a5c9ba9f"} Sep 10 02:50:38.554286 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.554262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"940b4cbc1f30b43c4c68f113a41a086c6663ce33d6c5537eb76f3e6ee7eb1c2a"} Sep 10 02:50:38.573825 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.573682 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4z5pg" podStartSLOduration=2.460339996 podStartE2EDuration="3.573663791s" totalImagesPullingTime="1.040923754s" totalInitContainerRuntime="72.400041ms" isStatefulPod=true podCreationTimestamp="2026-09-10 02:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:38.573024511 +0000 UTC m=+83.059019787" watchObservedRunningTime="2026-09-10 02:50:38.573663791 +0000 UTC m=+83.059659066" Sep 10 02:50:38.593904 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:38.593863 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-599nn" podStartSLOduration=1.982659211 podStartE2EDuration="3.593844503s" totalImagesPullingTime="1.611185292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:38.592328646 +0000 UTC m=+83.078323919" watchObservedRunningTime="2026-09-10 02:50:38.593844503 +0000 UTC m=+83.079839778" Sep 10 02:50:39.560005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.559969 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="c6a6587d75717728978dc941165c2f00327e5057b945e125d361d2d3176a367e" exitCode=0 Sep 10 02:50:39.560463 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.560062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"c6a6587d75717728978dc941165c2f00327e5057b945e125d361d2d3176a367e"} Sep 10 02:50:39.915873 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.915780 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:39.916088 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.916066 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-666bf79894-5rmdh"] Sep 10 02:50:39.919264 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.919243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.921885 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.921824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4pm7n\"" Sep 10 02:50:39.922255 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.922214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 02:50:39.922912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.922884 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 02:50:39.922912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.922900 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 02:50:39.923035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.922900 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 02:50:39.923035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.923024 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fh7m2lsbsaeu9\"" Sep 10 02:50:39.931930 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.931909 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-666bf79894-5rmdh"] Sep 10 02:50:39.972718 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b506cdd2-57b0-4ae0-a786-ad38312ee44f-metrics-server-audit-profiles\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.972849 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-secret-metrics-server-tls\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.972849 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-secret-metrics-server-client-certs\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.972849 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b506cdd2-57b0-4ae0-a786-ad38312ee44f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.972849 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8pdr\" (UniqueName: \"kubernetes.io/projected/b506cdd2-57b0-4ae0-a786-ad38312ee44f-kube-api-access-r8pdr\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.972849 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b506cdd2-57b0-4ae0-a786-ad38312ee44f-audit-log\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:39.972849 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:39.972844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-client-ca-bundle\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073206 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-secret-metrics-server-client-certs\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073206 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b506cdd2-57b0-4ae0-a786-ad38312ee44f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073465 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8pdr\" (UniqueName: \"kubernetes.io/projected/b506cdd2-57b0-4ae0-a786-ad38312ee44f-kube-api-access-r8pdr\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073465 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b506cdd2-57b0-4ae0-a786-ad38312ee44f-audit-log\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073465 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-client-ca-bundle\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073465 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b506cdd2-57b0-4ae0-a786-ad38312ee44f-metrics-server-audit-profiles\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073465 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-secret-metrics-server-tls\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.073782 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.073761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b506cdd2-57b0-4ae0-a786-ad38312ee44f-audit-log\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.074168 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.074086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b506cdd2-57b0-4ae0-a786-ad38312ee44f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.074509 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.074490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b506cdd2-57b0-4ae0-a786-ad38312ee44f-metrics-server-audit-profiles\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.076024 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.075998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-secret-metrics-server-tls\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.076410 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.076389 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-client-ca-bundle\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.076463 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.076447 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b506cdd2-57b0-4ae0-a786-ad38312ee44f-secret-metrics-server-client-certs\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.086103 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.086083 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8pdr\" (UniqueName: \"kubernetes.io/projected/b506cdd2-57b0-4ae0-a786-ad38312ee44f-kube-api-access-r8pdr\") pod \"metrics-server-666bf79894-5rmdh\" (UID: \"b506cdd2-57b0-4ae0-a786-ad38312ee44f\") " pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.102331 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.102300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:40.228451 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.228365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:50:40.347242 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.347195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:40.517366 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.517294 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-666bf79894-5rmdh"] Sep 10 02:50:40.519902 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:40.519872 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb506cdd2_57b0_4ae0_a786_ad38312ee44f.slice/crio-21dfd0ab9c1dc2cc8b894511d9c9d78d10e6fae6c27a0c04e9fe8355bc4a973b WatchSource:0}: Error finding container 21dfd0ab9c1dc2cc8b894511d9c9d78d10e6fae6c27a0c04e9fe8355bc4a973b: Status 404 returned error can't find the container with id 21dfd0ab9c1dc2cc8b894511d9c9d78d10e6fae6c27a0c04e9fe8355bc4a973b Sep 10 02:50:40.565961 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:40.565928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" event={"ID":"b506cdd2-57b0-4ae0-a786-ad38312ee44f","Type":"ContainerStarted","Data":"21dfd0ab9c1dc2cc8b894511d9c9d78d10e6fae6c27a0c04e9fe8355bc4a973b"} Sep 10 02:50:41.516044 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:41.516018 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hz9mf" Sep 10 02:50:41.578241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:41.578005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"487806899ab6630a41883a53863e0d4a9ee0792ac3103d1ae82f8b68b461cd3a"} Sep 10 02:50:41.578241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:41.578086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"85c8b74c592fe08c7a193c47bb1aa651cc517897c7bec765b344d92734538db1"} Sep 10 02:50:41.578241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:41.578133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"8393ca42479aa594378a255624aff6159c9b3e5600e46ed659eeff02e8ef2244"} Sep 10 02:50:41.578241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:41.578170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"0e1e3e997f74f91348d8255c370706ec17d090a508dabaf41d69e0d00e83a15e"} Sep 10 02:50:41.642511 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:41.642476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:42.442699 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:42.442671 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:42.585678 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:42.585646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"8aa247aa86601173355b1e323ce5823564d35fb9abb8ac91f241a366f597c9df"} Sep 10 02:50:43.593206 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:43.593167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerStarted","Data":"7d7e688dc19d84256661292d1e84dcf6183f3cec50dd2464d86c3e5becd4d281"} Sep 10 02:50:43.594753 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:43.594729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" event={"ID":"b506cdd2-57b0-4ae0-a786-ad38312ee44f","Type":"ContainerStarted","Data":"2437bff77580af073ed459d9c13e3a10ca6a1bbcb1deccbb835ed5c85f33ee80"} Sep 10 02:50:43.635011 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:43.634947 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5192610760000003 podStartE2EDuration="7.634926163s" totalImagesPullingTime="4.098700873s" totalInitContainerRuntime="16.964214ms" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:43.631547999 +0000 UTC m=+88.117543274" watchObservedRunningTime="2026-09-10 02:50:43.634926163 +0000 UTC m=+88.120921436" Sep 10 02:50:43.661713 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:43.661655 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" podStartSLOduration=2.628988048 podStartE2EDuration="4.661632662s" totalImagesPullingTime="2.032644614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:43.660543638 +0000 UTC m=+88.146538938" watchObservedRunningTime="2026-09-10 02:50:43.661632662 +0000 UTC m=+88.147627937" Sep 10 02:50:44.240810 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:44.240775 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:44.308659 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:44.308629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:45.197699 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.197665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:45.299532 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.299486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:45.756437 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.756403 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5858fdb7-sc4tm"] Sep 10 02:50:45.760653 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.760637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.763995 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.763976 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 02:50:45.764238 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.764202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 02:50:45.764352 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.764332 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 02:50:45.765385 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.765360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xd2ng\"" Sep 10 02:50:45.765499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.765385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 02:50:45.765499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.765369 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 02:50:45.765499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.765404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 02:50:45.765499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.765394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 02:50:45.772304 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.772285 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5858fdb7-sc4tm"] Sep 10 02:50:45.821675 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.821648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-console-config\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.821771 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.821681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-serving-cert\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.821771 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.821703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7rh2\" (UniqueName: \"kubernetes.io/projected/da960814-69fe-4955-9eca-98eed494c058-kube-api-access-h7rh2\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.821852 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.821776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-oauth-serving-cert\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.821852 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.821802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-oauth-config\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.821852 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.821835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-service-ca\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.922367 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.922336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-oauth-serving-cert\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.922367 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.922378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-oauth-config\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.922589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.922426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-service-ca\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.922589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.922477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-console-config\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.922589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.922505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-serving-cert\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.922589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.922535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7rh2\" (UniqueName: \"kubernetes.io/projected/da960814-69fe-4955-9eca-98eed494c058-kube-api-access-h7rh2\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.923198 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.923166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-service-ca\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.923364 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.923166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-console-config\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.923506 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.923487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-oauth-serving-cert\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.924997 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.924974 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-oauth-config\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.925113 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.924984 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-serving-cert\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:45.931625 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:45.931603 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7rh2\" (UniqueName: \"kubernetes.io/projected/da960814-69fe-4955-9eca-98eed494c058-kube-api-access-h7rh2\") pod \"console-7d5858fdb7-sc4tm\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:46.069694 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:46.069656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:46.094280 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:46.094249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:46.194426 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:46.194391 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:46.343660 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:46.343531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5858fdb7-sc4tm"] Sep 10 02:50:46.606262 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:46.606162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5858fdb7-sc4tm" event={"ID":"da960814-69fe-4955-9eca-98eed494c058","Type":"ContainerStarted","Data":"0ed44cd89e7ebebf32ddeb604f1c27d4b2809731b12d6ccf7a2f285a5e937799"} Sep 10 02:50:47.464197 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.464105 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" podUID="82687ebb-40cc-456c-b570-5dc4ed836c1a" containerName="registry" containerID="cri-o://002d93255772b315487e4d701ccbd0e18aa5504cde34a39c6a7c979a2b8b00ed" gracePeriod=30 Sep 10 02:50:47.619496 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.619398 2578 generic.go:356] "Generic (PLEG): container finished" podID="82687ebb-40cc-456c-b570-5dc4ed836c1a" containerID="002d93255772b315487e4d701ccbd0e18aa5504cde34a39c6a7c979a2b8b00ed" exitCode=0 Sep 10 02:50:47.619496 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.619465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" event={"ID":"82687ebb-40cc-456c-b570-5dc4ed836c1a","Type":"ContainerDied","Data":"002d93255772b315487e4d701ccbd0e18aa5504cde34a39c6a7c979a2b8b00ed"} Sep 10 02:50:47.726308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.725945 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:47.844069 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844029 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82687ebb-40cc-456c-b570-5dc4ed836c1a-ca-trust-extracted\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844267 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844084 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844267 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844114 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-installation-pull-secrets\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844267 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844155 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-image-registry-private-configuration\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844267 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844187 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-trusted-ca\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844267 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jbwg\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-kube-api-access-8jbwg\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844550 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844277 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-bound-sa-token\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.844550 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844311 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-certificates\") pod \"82687ebb-40cc-456c-b570-5dc4ed836c1a\" (UID: \"82687ebb-40cc-456c-b570-5dc4ed836c1a\") " Sep 10 02:50:47.845016 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.844988 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:50:47.845699 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.845655 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:50:47.847569 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.847524 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:50:47.848299 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.847645 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:50:47.848299 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.847785 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:50:47.848299 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.848010 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-kube-api-access-8jbwg" (OuterVolumeSpecName: "kube-api-access-8jbwg") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "kube-api-access-8jbwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:50:47.849791 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.849756 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:50:47.856855 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.856822 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82687ebb-40cc-456c-b570-5dc4ed836c1a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82687ebb-40cc-456c-b570-5dc4ed836c1a" (UID: "82687ebb-40cc-456c-b570-5dc4ed836c1a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:50:47.945859 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945816 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jbwg\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-kube-api-access-8jbwg\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.945859 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945856 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-bound-sa-token\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.946102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945873 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-certificates\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.946102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945887 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82687ebb-40cc-456c-b570-5dc4ed836c1a-ca-trust-extracted\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.946102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945900 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82687ebb-40cc-456c-b570-5dc4ed836c1a-registry-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.946102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945916 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-installation-pull-secrets\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.946102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945933 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82687ebb-40cc-456c-b570-5dc4ed836c1a-image-registry-private-configuration\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:47.946102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:47.945948 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82687ebb-40cc-456c-b570-5dc4ed836c1a-trusted-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:50:48.625633 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:48.625597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" event={"ID":"82687ebb-40cc-456c-b570-5dc4ed836c1a","Type":"ContainerDied","Data":"26e16aec0f35d3e4650795f07fdab38f565fd6c7a0691ebe21dcf872b4682f79"} Sep 10 02:50:48.626193 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:48.625638 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d844c895b-dxprc" Sep 10 02:50:48.626193 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:48.625660 2578 scope.go:117] "RemoveContainer" containerID="002d93255772b315487e4d701ccbd0e18aa5504cde34a39c6a7c979a2b8b00ed" Sep 10 02:50:48.646385 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:48.646349 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d844c895b-dxprc"] Sep 10 02:50:48.650499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:48.650443 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d844c895b-dxprc"] Sep 10 02:50:49.714834 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:49.714798 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:49.816092 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:49.816053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:49.897989 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:49.897904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:50.041703 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:50.041662 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82687ebb-40cc-456c-b570-5dc4ed836c1a" path="/var/lib/kubelet/pods/82687ebb-40cc-456c-b570-5dc4ed836c1a/volumes" Sep 10 02:50:50.635766 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:50.635732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5858fdb7-sc4tm" event={"ID":"da960814-69fe-4955-9eca-98eed494c058","Type":"ContainerStarted","Data":"5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0"} Sep 10 02:50:50.657005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:50.656946 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d5858fdb7-sc4tm" podStartSLOduration=2.390322978 podStartE2EDuration="5.656928478s" totalImagesPullingTime="3.2666055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:50.656430908 +0000 UTC m=+95.142426182" watchObservedRunningTime="2026-09-10 02:50:50.656928478 +0000 UTC m=+95.142923752" Sep 10 02:50:50.864437 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:50.864409 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:50.956088 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:50.956010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:52.636038 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:52.635998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:52.820788 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:52.820756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:52.920830 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:52.920743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:53.152554 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:53.152523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:53.224546 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:53.224442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:54.785844 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.785813 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d4b4fb9-rdsxt"] Sep 10 02:50:54.824684 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.824510 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82687ebb-40cc-456c-b570-5dc4ed836c1a" containerName="registry" Sep 10 02:50:54.824684 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.824684 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82687ebb-40cc-456c-b570-5dc4ed836c1a" containerName="registry" Sep 10 02:50:54.824903 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.824780 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82687ebb-40cc-456c-b570-5dc4ed836c1a" containerName="registry" Sep 10 02:50:54.860934 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.860905 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4b4fb9-rdsxt"] Sep 10 02:50:54.861064 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.860999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:54.869831 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:54.869811 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 02:50:55.006479 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qtv\" (UniqueName: \"kubernetes.io/projected/48964009-7b88-4f18-ab5b-65cebf1630ee-kube-api-access-n6qtv\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.006644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-serving-cert\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.006644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-service-ca\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.006644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-console-config\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.006748 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-oauth-config\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.006748 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-oauth-serving-cert\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.006748 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.006744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-trusted-ca-bundle\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107492 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-oauth-config\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107492 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-oauth-serving-cert\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107729 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-trusted-ca-bundle\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107729 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qtv\" (UniqueName: \"kubernetes.io/projected/48964009-7b88-4f18-ab5b-65cebf1630ee-kube-api-access-n6qtv\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107729 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-serving-cert\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107729 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-service-ca\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.107729 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.107668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-console-config\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.108409 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.108378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-oauth-serving-cert\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.108532 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.108446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-trusted-ca-bundle\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.108532 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.108445 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-service-ca\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.108609 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.108571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-console-config\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.110111 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.110088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-oauth-config\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.110248 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.110206 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-serving-cert\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.116422 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.116404 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qtv\" (UniqueName: \"kubernetes.io/projected/48964009-7b88-4f18-ab5b-65cebf1630ee-kube-api-access-n6qtv\") pod \"console-86d4b4fb9-rdsxt\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.170401 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.170364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:50:55.475203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.475133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4b4fb9-rdsxt"] Sep 10 02:50:55.478320 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:50:55.478292 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48964009_7b88_4f18_ab5b_65cebf1630ee.slice/crio-e36390ed0318e6197daa390ad452315281e952356d4ae64cb5162b7aef486e42 WatchSource:0}: Error finding container e36390ed0318e6197daa390ad452315281e952356d4ae64cb5162b7aef486e42: Status 404 returned error can't find the container with id e36390ed0318e6197daa390ad452315281e952356d4ae64cb5162b7aef486e42 Sep 10 02:50:55.656975 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.656939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b4fb9-rdsxt" event={"ID":"48964009-7b88-4f18-ab5b-65cebf1630ee","Type":"ContainerStarted","Data":"c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc"} Sep 10 02:50:55.657133 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.657003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b4fb9-rdsxt" event={"ID":"48964009-7b88-4f18-ab5b-65cebf1630ee","Type":"ContainerStarted","Data":"e36390ed0318e6197daa390ad452315281e952356d4ae64cb5162b7aef486e42"} Sep 10 02:50:55.682277 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:55.681936 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d4b4fb9-rdsxt" podStartSLOduration=1.681915419 podStartE2EDuration="1.681915419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:50:55.679620835 +0000 UTC m=+100.165616109" watchObservedRunningTime="2026-09-10 02:50:55.681915419 +0000 UTC m=+100.167910694" Sep 10 02:50:56.069957 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:56.069923 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:56.070386 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:56.069975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:56.074858 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:56.074836 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:56.664789 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:56.664763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:50:58.997655 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:58.997616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:59.064803 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:59.064773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:50:59.994944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:50:59.994906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:00.061435 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:00.061395 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:00.229305 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:00.229274 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:51:00.229445 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:00.229335 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:51:02.241488 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:02.241456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:02.310267 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:02.310215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:02.516177 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:02.516108 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lt6v2" Sep 10 02:51:05.171114 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.171075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:51:05.171582 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.171140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:51:05.175650 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.175626 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:51:05.348035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.348002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:05.448469 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.448361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:05.703289 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.703201 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:51:05.759696 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.759653 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5858fdb7-sc4tm"] Sep 10 02:51:05.890270 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.890198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:05.951361 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:05.951312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:06.230042 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:06.230004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:06.294528 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:06.294497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:12.060696 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:12.060661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:12.166901 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:12.166862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:14.615568 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:14.615526 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:14.816668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:14.816631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:20.234539 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:20.234501 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:51:20.238273 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:20.238253 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-666bf79894-5rmdh" Sep 10 02:51:27.063515 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:27.063472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:27.134117 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:27.134080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:30.779639 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:30.779590 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d5858fdb7-sc4tm" podUID="da960814-69fe-4955-9eca-98eed494c058" containerName="console" containerID="cri-o://5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0" gracePeriod=15 Sep 10 02:51:31.013340 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.013315 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:51:31.100008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.099931 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7rh2\" (UniqueName: \"kubernetes.io/projected/da960814-69fe-4955-9eca-98eed494c058-kube-api-access-h7rh2\") pod \"da960814-69fe-4955-9eca-98eed494c058\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " Sep 10 02:51:31.100008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.099966 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-service-ca\") pod \"da960814-69fe-4955-9eca-98eed494c058\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " Sep 10 02:51:31.100008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100002 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-console-config\") pod \"da960814-69fe-4955-9eca-98eed494c058\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " Sep 10 02:51:31.100306 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100030 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-oauth-serving-cert\") pod \"da960814-69fe-4955-9eca-98eed494c058\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " Sep 10 02:51:31.100306 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100048 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-serving-cert\") pod \"da960814-69fe-4955-9eca-98eed494c058\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " Sep 10 02:51:31.100306 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100090 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-oauth-config\") pod \"da960814-69fe-4955-9eca-98eed494c058\" (UID: \"da960814-69fe-4955-9eca-98eed494c058\") " Sep 10 02:51:31.100454 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100431 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-service-ca" (OuterVolumeSpecName: "service-ca") pod "da960814-69fe-4955-9eca-98eed494c058" (UID: "da960814-69fe-4955-9eca-98eed494c058"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:51:31.100533 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100508 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-console-config" (OuterVolumeSpecName: "console-config") pod "da960814-69fe-4955-9eca-98eed494c058" (UID: "da960814-69fe-4955-9eca-98eed494c058"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:51:31.100575 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.100533 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da960814-69fe-4955-9eca-98eed494c058" (UID: "da960814-69fe-4955-9eca-98eed494c058"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:51:31.102458 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.102423 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da960814-69fe-4955-9eca-98eed494c058" (UID: "da960814-69fe-4955-9eca-98eed494c058"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:31.102458 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.102445 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da960814-69fe-4955-9eca-98eed494c058" (UID: "da960814-69fe-4955-9eca-98eed494c058"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:31.102596 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.102488 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da960814-69fe-4955-9eca-98eed494c058-kube-api-access-h7rh2" (OuterVolumeSpecName: "kube-api-access-h7rh2") pod "da960814-69fe-4955-9eca-98eed494c058" (UID: "da960814-69fe-4955-9eca-98eed494c058"). InnerVolumeSpecName "kube-api-access-h7rh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:51:31.201537 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.201505 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7rh2\" (UniqueName: \"kubernetes.io/projected/da960814-69fe-4955-9eca-98eed494c058-kube-api-access-h7rh2\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:31.201537 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.201532 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-service-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:31.201537 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.201541 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-console-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:31.201730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.201549 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da960814-69fe-4955-9eca-98eed494c058-oauth-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:31.201730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.201558 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:31.201730 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.201567 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da960814-69fe-4955-9eca-98eed494c058-console-oauth-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:31.797197 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.797160 2578 generic.go:356] "Generic (PLEG): container finished" podID="da960814-69fe-4955-9eca-98eed494c058" containerID="5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0" exitCode=0 Sep 10 02:51:31.797668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.797205 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5858fdb7-sc4tm" Sep 10 02:51:31.797668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.797246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5858fdb7-sc4tm" event={"ID":"da960814-69fe-4955-9eca-98eed494c058","Type":"ContainerDied","Data":"5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0"} Sep 10 02:51:31.797668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.797297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5858fdb7-sc4tm" event={"ID":"da960814-69fe-4955-9eca-98eed494c058","Type":"ContainerDied","Data":"0ed44cd89e7ebebf32ddeb604f1c27d4b2809731b12d6ccf7a2f285a5e937799"} Sep 10 02:51:31.797668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.797316 2578 scope.go:117] "RemoveContainer" containerID="5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0" Sep 10 02:51:31.806518 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.806502 2578 scope.go:117] "RemoveContainer" containerID="5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0" Sep 10 02:51:31.806785 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:51:31.806764 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0\": container with ID starting with 5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0 not found: ID does not exist" containerID="5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0" Sep 10 02:51:31.806837 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.806797 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0"} err="failed to get container status \"5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0\": rpc error: code = NotFound desc = could not find container \"5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0\": container with ID starting with 5aba4a36813349f5d8564f94393c7d1e919d11dc20e6fdc15bcb0f8601de73c0 not found: ID does not exist" Sep 10 02:51:31.820954 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.820933 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5858fdb7-sc4tm"] Sep 10 02:51:31.829067 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:31.829042 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d5858fdb7-sc4tm"] Sep 10 02:51:32.041798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:32.041762 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da960814-69fe-4955-9eca-98eed494c058" path="/var/lib/kubelet/pods/da960814-69fe-4955-9eca-98eed494c058/volumes" Sep 10 02:51:47.826417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:47.826374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:51.422951 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:51.422910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:51.488956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:51.488922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:53.506584 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.506549 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558c774858-n7gb2"] Sep 10 02:51:53.507058 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.506811 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da960814-69fe-4955-9eca-98eed494c058" containerName="console" Sep 10 02:51:53.507058 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.506823 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="da960814-69fe-4955-9eca-98eed494c058" containerName="console" Sep 10 02:51:53.507058 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.506881 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="da960814-69fe-4955-9eca-98eed494c058" containerName="console" Sep 10 02:51:53.513811 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.513791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.522309 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.522284 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558c774858-n7gb2"] Sep 10 02:51:53.574538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.574505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:53.676553 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.676518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:53.685068 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4r2\" (UniqueName: \"kubernetes.io/projected/6a107aad-f13f-4526-97f6-6c52e183d8bf-kube-api-access-rd4r2\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.685148 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-oauth-serving-cert\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.685148 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-service-ca\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.685261 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-trusted-ca-bundle\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.685261 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-serving-cert\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.685370 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-oauth-config\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.685370 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.685341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-config\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.742352 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.742316 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:53.786405 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4r2\" (UniqueName: \"kubernetes.io/projected/6a107aad-f13f-4526-97f6-6c52e183d8bf-kube-api-access-rd4r2\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.786538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-oauth-serving-cert\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.786538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-service-ca\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.786538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-trusted-ca-bundle\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.786538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-serving-cert\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.786538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-oauth-config\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.786790 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.786555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-config\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.787289 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.787262 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-oauth-serving-cert\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.787394 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.787297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-service-ca\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.787394 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.787302 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-config\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.787485 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.787457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-trusted-ca-bundle\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.789046 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.789020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-serving-cert\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.789158 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.789140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-oauth-config\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.795865 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.795842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4r2\" (UniqueName: \"kubernetes.io/projected/6a107aad-f13f-4526-97f6-6c52e183d8bf-kube-api-access-rd4r2\") pod \"console-558c774858-n7gb2\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:53.824183 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:53.824157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:51:54.095123 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:54.095097 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558c774858-n7gb2"] Sep 10 02:51:54.097332 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:51:54.097306 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a107aad_f13f_4526_97f6_6c52e183d8bf.slice/crio-d749e23325fefd078e9aa085d0a10ce4844205ee141051e016f78856fd7c27a8 WatchSource:0}: Error finding container d749e23325fefd078e9aa085d0a10ce4844205ee141051e016f78856fd7c27a8: Status 404 returned error can't find the container with id d749e23325fefd078e9aa085d0a10ce4844205ee141051e016f78856fd7c27a8 Sep 10 02:51:54.314002 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:54.313965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:54.394604 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:54.394512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:54.889927 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:54.889896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c774858-n7gb2" event={"ID":"6a107aad-f13f-4526-97f6-6c52e183d8bf","Type":"ContainerStarted","Data":"dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779"} Sep 10 02:51:54.890301 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:54.889943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c774858-n7gb2" event={"ID":"6a107aad-f13f-4526-97f6-6c52e183d8bf","Type":"ContainerStarted","Data":"d749e23325fefd078e9aa085d0a10ce4844205ee141051e016f78856fd7c27a8"} Sep 10 02:51:54.911197 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:54.911149 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558c774858-n7gb2" podStartSLOduration=1.9111295240000001 podStartE2EDuration="1.911129524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:51:54.911054086 +0000 UTC m=+159.397049360" watchObservedRunningTime="2026-09-10 02:51:54.911129524 +0000 UTC m=+159.397124800" Sep 10 02:51:55.714057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714021 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:51:55.714350 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714325 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="alertmanager" containerID="cri-o://0e1e3e997f74f91348d8255c370706ec17d090a508dabaf41d69e0d00e83a15e" gracePeriod=120 Sep 10 02:51:55.714415 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714376 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-metric" containerID="cri-o://8aa247aa86601173355b1e323ce5823564d35fb9abb8ac91f241a366f597c9df" gracePeriod=120 Sep 10 02:51:55.714473 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714406 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-web" containerID="cri-o://85c8b74c592fe08c7a193c47bb1aa651cc517897c7bec765b344d92734538db1" gracePeriod=120 Sep 10 02:51:55.714473 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714422 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy" containerID="cri-o://487806899ab6630a41883a53863e0d4a9ee0792ac3103d1ae82f8b68b461cd3a" gracePeriod=120 Sep 10 02:51:55.714473 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714429 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="config-reloader" containerID="cri-o://8393ca42479aa594378a255624aff6159c9b3e5600e46ed659eeff02e8ef2244" gracePeriod=120 Sep 10 02:51:55.714616 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.714510 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="prom-label-proxy" containerID="cri-o://7d7e688dc19d84256661292d1e84dcf6183f3cec50dd2464d86c3e5becd4d281" gracePeriod=120 Sep 10 02:51:55.899530 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899502 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="7d7e688dc19d84256661292d1e84dcf6183f3cec50dd2464d86c3e5becd4d281" exitCode=0 Sep 10 02:51:55.899530 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899525 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="8aa247aa86601173355b1e323ce5823564d35fb9abb8ac91f241a366f597c9df" exitCode=0 Sep 10 02:51:55.899530 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899531 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="487806899ab6630a41883a53863e0d4a9ee0792ac3103d1ae82f8b68b461cd3a" exitCode=0 Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899539 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="8393ca42479aa594378a255624aff6159c9b3e5600e46ed659eeff02e8ef2244" exitCode=0 Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899544 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="0e1e3e997f74f91348d8255c370706ec17d090a508dabaf41d69e0d00e83a15e" exitCode=0 Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"7d7e688dc19d84256661292d1e84dcf6183f3cec50dd2464d86c3e5becd4d281"} Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"8aa247aa86601173355b1e323ce5823564d35fb9abb8ac91f241a366f597c9df"} Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"487806899ab6630a41883a53863e0d4a9ee0792ac3103d1ae82f8b68b461cd3a"} Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"8393ca42479aa594378a255624aff6159c9b3e5600e46ed659eeff02e8ef2244"} Sep 10 02:51:55.899923 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:55.899706 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"0e1e3e997f74f91348d8255c370706ec17d090a508dabaf41d69e0d00e83a15e"} Sep 10 02:51:56.907850 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:56.907819 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d968579-9266-4fef-981c-e161b1677946" containerID="85c8b74c592fe08c7a193c47bb1aa651cc517897c7bec765b344d92734538db1" exitCode=0 Sep 10 02:51:56.908187 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:56.907888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"85c8b74c592fe08c7a193c47bb1aa651cc517897c7bec765b344d92734538db1"} Sep 10 02:51:56.950979 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:56.950957 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:57.013112 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013074 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-web\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013139 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-cluster-tls-config\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013181 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-config-out\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013211 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb8v7\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-kube-api-access-zb8v7\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013261 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-tls-assets\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013294 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013334 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-alertmanager-trusted-ca-bundle\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013369 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-web-config\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013398 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-alertmanager-main-db\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013423 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-metrics-client-ca\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013457 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-config-volume\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.013589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.013522 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy\") pod \"0d968579-9266-4fef-981c-e161b1677946\" (UID: \"0d968579-9266-4fef-981c-e161b1677946\") " Sep 10 02:51:57.015069 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.014384 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:51:57.015069 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.014631 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:51:57.015069 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.015019 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:51:57.016857 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.016812 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.017149 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.017050 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.017149 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.017060 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-kube-api-access-zb8v7" (OuterVolumeSpecName: "kube-api-access-zb8v7") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "kube-api-access-zb8v7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:51:57.017149 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.017109 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-config-out" (OuterVolumeSpecName: "config-out") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:51:57.017917 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.017878 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.018685 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.018650 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.019380 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.019354 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-config-volume" (OuterVolumeSpecName: "config-volume") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.019380 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.019367 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:51:57.021480 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.021452 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.030063 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.030039 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-web-config" (OuterVolumeSpecName: "web-config") pod "0d968579-9266-4fef-981c-e161b1677946" (UID: "0d968579-9266-4fef-981c-e161b1677946"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:51:57.114377 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114338 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114377 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114368 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-cluster-tls-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114377 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114379 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-config-out\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114377 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114387 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb8v7\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-kube-api-access-zb8v7\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114396 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d968579-9266-4fef-981c-e161b1677946-tls-assets\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114405 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-main-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114413 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114421 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-web-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114429 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d968579-9266-4fef-981c-e161b1677946-alertmanager-main-db\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114437 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d968579-9266-4fef-981c-e161b1677946-metrics-client-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114445 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-config-volume\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114454 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.114623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.114464 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d968579-9266-4fef-981c-e161b1677946-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:51:57.914945 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.914910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d968579-9266-4fef-981c-e161b1677946","Type":"ContainerDied","Data":"940b4cbc1f30b43c4c68f113a41a086c6663ce33d6c5537eb76f3e6ee7eb1c2a"} Sep 10 02:51:57.914945 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.914941 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:57.915417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.914984 2578 scope.go:117] "RemoveContainer" containerID="7d7e688dc19d84256661292d1e84dcf6183f3cec50dd2464d86c3e5becd4d281" Sep 10 02:51:57.922466 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.922446 2578 scope.go:117] "RemoveContainer" containerID="8aa247aa86601173355b1e323ce5823564d35fb9abb8ac91f241a366f597c9df" Sep 10 02:51:57.929843 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.929827 2578 scope.go:117] "RemoveContainer" containerID="487806899ab6630a41883a53863e0d4a9ee0792ac3103d1ae82f8b68b461cd3a" Sep 10 02:51:57.936132 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.936116 2578 scope.go:117] "RemoveContainer" containerID="85c8b74c592fe08c7a193c47bb1aa651cc517897c7bec765b344d92734538db1" Sep 10 02:51:57.940110 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.940089 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:51:57.943327 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.943288 2578 scope.go:117] "RemoveContainer" containerID="8393ca42479aa594378a255624aff6159c9b3e5600e46ed659eeff02e8ef2244" Sep 10 02:51:57.947434 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.947411 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:51:57.951157 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.951138 2578 scope.go:117] "RemoveContainer" containerID="0e1e3e997f74f91348d8255c370706ec17d090a508dabaf41d69e0d00e83a15e" Sep 10 02:51:57.958057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.958036 2578 scope.go:117] "RemoveContainer" containerID="c6a6587d75717728978dc941165c2f00327e5057b945e125d361d2d3176a367e" Sep 10 02:51:57.979589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979562 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:51:57.979827 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979816 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979829 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979837 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="prom-label-proxy" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979842 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="prom-label-proxy" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979850 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-metric" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979855 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-metric" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979863 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="alertmanager" Sep 10 02:51:57.979869 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979868 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="alertmanager" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979874 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-web" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979879 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-web" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979897 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="init-config-reloader" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979902 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="init-config-reloader" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979907 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="config-reloader" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979912 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="config-reloader" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979951 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-web" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979959 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy-metric" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979964 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="kube-rbac-proxy" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979968 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="prom-label-proxy" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979976 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="alertmanager" Sep 10 02:51:57.980076 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.979982 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d968579-9266-4fef-981c-e161b1677946" containerName="config-reloader" Sep 10 02:51:57.983871 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.983851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:57.987135 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987088 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 02:51:57.987310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 02:51:57.987310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987186 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 02:51:57.987310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987197 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 02:51:57.987310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 02:51:57.987310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 02:51:57.987310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987155 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 02:51:57.987570 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987088 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 02:51:57.987570 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.987410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s8gw8\"" Sep 10 02:51:57.993602 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:57.993585 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 02:51:58.002339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.002317 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:51:58.019492 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-config-out\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019611 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019611 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-web-config\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019611 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9ztw\" (UniqueName: \"kubernetes.io/projected/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-kube-api-access-d9ztw\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019952 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019952 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019952 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.019952 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.020069 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.019959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.041660 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.041601 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d968579-9266-4fef-981c-e161b1677946" path="/var/lib/kubelet/pods/0d968579-9266-4fef-981c-e161b1677946/volumes" Sep 10 02:51:58.120974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.120931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.120974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.120973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121209 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121409 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-config-out\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121409 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121409 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-web-config\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121569 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121569 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9ztw\" (UniqueName: \"kubernetes.io/projected/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-kube-api-access-d9ztw\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121569 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121507 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121569 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.121801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.121612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.122465 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.122442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.124089 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.124060 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-config-out\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.124642 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.124409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.124642 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.124482 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.124818 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.124802 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.124940 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.124916 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.125000 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.124933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.125074 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.125055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-web-config\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.125451 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.125431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.125672 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.125655 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.126506 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.126487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.135621 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.135599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9ztw\" (UniqueName: \"kubernetes.io/projected/6629fc92-2085-4158-8cb3-3ef1cbb77b5f-kube-api-access-d9ztw\") pod \"alertmanager-main-0\" (UID: \"6629fc92-2085-4158-8cb3-3ef1cbb77b5f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.295279 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.295179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 02:51:58.588570 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.588541 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 02:51:58.590785 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:51:58.590753 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6629fc92_2085_4158_8cb3_3ef1cbb77b5f.slice/crio-bdc5687a029889fd3e3fd44d4624c4134fa3ee9b04c6d42749a44aad2af7ca71 WatchSource:0}: Error finding container bdc5687a029889fd3e3fd44d4624c4134fa3ee9b04c6d42749a44aad2af7ca71: Status 404 returned error can't find the container with id bdc5687a029889fd3e3fd44d4624c4134fa3ee9b04c6d42749a44aad2af7ca71 Sep 10 02:51:58.920050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.919969 2578 generic.go:356] "Generic (PLEG): container finished" podID="6629fc92-2085-4158-8cb3-3ef1cbb77b5f" containerID="3e8deff26f89fe73a939cb3a93f5a78650d5cce78e452a0539fa539f6210b72b" exitCode=0 Sep 10 02:51:58.920484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.920064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerDied","Data":"3e8deff26f89fe73a939cb3a93f5a78650d5cce78e452a0539fa539f6210b72b"} Sep 10 02:51:58.920484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:58.920151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"bdc5687a029889fd3e3fd44d4624c4134fa3ee9b04c6d42749a44aad2af7ca71"} Sep 10 02:51:59.504375 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.504262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:51:59.927966 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.927929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"e8173f246e5690628afc9ec19922f93b57911c56bd042a7735d55de397254328"} Sep 10 02:51:59.928342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.928025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"b7c476c08a76c928bb536c5e7fd87987e57937e006cc7f7fb18cb53b788459a2"} Sep 10 02:51:59.928342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.928073 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"1202c606796aadeac084dd832c6e30a6c6802ce9fae29fdaef2b6cc8af4242be"} Sep 10 02:51:59.928342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.928097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"018bd7db2d20b1f11656e7c5653daed4cc8e615d0f46fb925723fa743ada00aa"} Sep 10 02:51:59.928342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.928120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"212df054b92be02d95beaac67adc925887ed9ff9db26a8c82455db4f322eceba"} Sep 10 02:51:59.928342 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.928142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6629fc92-2085-4158-8cb3-3ef1cbb77b5f","Type":"ContainerStarted","Data":"08639d5d270371d5ad786a184ff21dc6fd850835b154de16fd12bf1fc86b58b5"} Sep 10 02:51:59.974912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:51:59.974851 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.959077797 podStartE2EDuration="2.974831046s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.753249ms" isStatefulPod=false podCreationTimestamp="2026-09-10 02:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:51:59.973207495 +0000 UTC m=+164.459202768" watchObservedRunningTime="2026-09-10 02:51:59.974831046 +0000 UTC m=+164.460826321" Sep 10 02:52:03.441460 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:03.441414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:03.541671 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:03.541638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:03.824839 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:03.824806 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:52:03.825007 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:03.824878 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:52:03.829691 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:03.829669 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:52:03.946291 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:03.946265 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:52:04.004703 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:04.004673 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4b4fb9-rdsxt"] Sep 10 02:52:04.139349 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:04.139252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:04.238984 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:04.238945 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:04.313165 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:04.313127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:12.103152 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:12.103067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:12.203856 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:12.203812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:12.264113 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:12.264084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:29.028996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.028951 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d4b4fb9-rdsxt" podUID="48964009-7b88-4f18-ab5b-65cebf1630ee" containerName="console" containerID="cri-o://c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc" gracePeriod=15 Sep 10 02:52:29.268568 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.268545 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:52:29.374337 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374310 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-service-ca\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374337 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374339 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-console-config\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374567 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374385 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-oauth-config\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374567 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374405 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6qtv\" (UniqueName: \"kubernetes.io/projected/48964009-7b88-4f18-ab5b-65cebf1630ee-kube-api-access-n6qtv\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374567 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374427 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-trusted-ca-bundle\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374567 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374456 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-oauth-serving-cert\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374823 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374582 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-serving-cert\") pod \"48964009-7b88-4f18-ab5b-65cebf1630ee\" (UID: \"48964009-7b88-4f18-ab5b-65cebf1630ee\") " Sep 10 02:52:29.374823 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374772 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:52:29.374823 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374792 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-console-config" (OuterVolumeSpecName: "console-config") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:52:29.374964 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.374843 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:52:29.375101 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.375074 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:52:29.377184 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.377153 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:52:29.381514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.381476 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48964009-7b88-4f18-ab5b-65cebf1630ee-kube-api-access-n6qtv" (OuterVolumeSpecName: "kube-api-access-n6qtv") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "kube-api-access-n6qtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:52:29.381514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.381505 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48964009-7b88-4f18-ab5b-65cebf1630ee" (UID: "48964009-7b88-4f18-ab5b-65cebf1630ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:52:29.475298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475266 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:29.475298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475294 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-service-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:29.475298 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475304 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-console-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:29.475536 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475313 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48964009-7b88-4f18-ab5b-65cebf1630ee-console-oauth-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:29.475536 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475321 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6qtv\" (UniqueName: \"kubernetes.io/projected/48964009-7b88-4f18-ab5b-65cebf1630ee-kube-api-access-n6qtv\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:29.475536 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475330 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-trusted-ca-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:29.475536 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:29.475338 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48964009-7b88-4f18-ab5b-65cebf1630ee-oauth-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:52:30.038749 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.038714 2578 generic.go:356] "Generic (PLEG): container finished" podID="48964009-7b88-4f18-ab5b-65cebf1630ee" containerID="c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc" exitCode=0 Sep 10 02:52:30.039168 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.038814 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b4fb9-rdsxt" Sep 10 02:52:30.040704 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.040683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b4fb9-rdsxt" event={"ID":"48964009-7b88-4f18-ab5b-65cebf1630ee","Type":"ContainerDied","Data":"c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc"} Sep 10 02:52:30.040765 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.040721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b4fb9-rdsxt" event={"ID":"48964009-7b88-4f18-ab5b-65cebf1630ee","Type":"ContainerDied","Data":"e36390ed0318e6197daa390ad452315281e952356d4ae64cb5162b7aef486e42"} Sep 10 02:52:30.040765 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.040746 2578 scope.go:117] "RemoveContainer" containerID="c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc" Sep 10 02:52:30.050389 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.050368 2578 scope.go:117] "RemoveContainer" containerID="c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc" Sep 10 02:52:30.050681 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:52:30.050656 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc\": container with ID starting with c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc not found: ID does not exist" containerID="c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc" Sep 10 02:52:30.050768 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.050691 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc"} err="failed to get container status \"c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc\": rpc error: code = NotFound desc = could not find container \"c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc\": container with ID starting with c188e2c974b73f921e61400249cf9463e4146eda8c1a867ea69b836e16f362dc not found: ID does not exist" Sep 10 02:52:30.065867 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.065837 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4b4fb9-rdsxt"] Sep 10 02:52:30.070399 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:30.070377 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d4b4fb9-rdsxt"] Sep 10 02:52:32.041423 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:32.041393 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48964009-7b88-4f18-ab5b-65cebf1630ee" path="/var/lib/kubelet/pods/48964009-7b88-4f18-ab5b-65cebf1630ee/volumes" Sep 10 02:52:58.755655 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:58.755618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:58.846344 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:58.846302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:59.557930 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.557898 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29"] Sep 10 02:52:59.558164 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.558153 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48964009-7b88-4f18-ab5b-65cebf1630ee" containerName="console" Sep 10 02:52:59.558206 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.558166 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="48964009-7b88-4f18-ab5b-65cebf1630ee" containerName="console" Sep 10 02:52:59.558265 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.558238 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="48964009-7b88-4f18-ab5b-65cebf1630ee" containerName="console" Sep 10 02:52:59.561398 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.561379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.564751 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.564731 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z47v6\"" Sep 10 02:52:59.566052 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.566030 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:52:59.567006 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.566987 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:52:59.571645 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.571624 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29"] Sep 10 02:52:59.590090 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.590064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:52:59.613251 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.613212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgmtd\" (UniqueName: \"kubernetes.io/projected/a405f132-4b18-49ef-a776-cd8495cacb7c-kube-api-access-dgmtd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.613417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.613278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.613417 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.613307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.714592 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.714562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.714732 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.714604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.714732 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.714647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgmtd\" (UniqueName: \"kubernetes.io/projected/a405f132-4b18-49ef-a776-cd8495cacb7c-kube-api-access-dgmtd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.715000 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.714979 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.715060 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.715002 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.724016 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.723988 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgmtd\" (UniqueName: \"kubernetes.io/projected/a405f132-4b18-49ef-a776-cd8495cacb7c-kube-api-access-dgmtd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:52:59.871050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:52:59.870968 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:53:00.147116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:00.147046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29"] Sep 10 02:53:00.149950 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:00.149924 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda405f132_4b18_49ef_a776_cd8495cacb7c.slice/crio-7e8f51081c16e5735fe8de4f945a619b45aff905f23daa22c8ac9480fa336ef9 WatchSource:0}: Error finding container 7e8f51081c16e5735fe8de4f945a619b45aff905f23daa22c8ac9480fa336ef9: Status 404 returned error can't find the container with id 7e8f51081c16e5735fe8de4f945a619b45aff905f23daa22c8ac9480fa336ef9 Sep 10 02:53:01.147962 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:01.147924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" event={"ID":"a405f132-4b18-49ef-a776-cd8495cacb7c","Type":"ContainerStarted","Data":"7e8f51081c16e5735fe8de4f945a619b45aff905f23daa22c8ac9480fa336ef9"} Sep 10 02:53:07.172087 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:07.172049 2578 generic.go:356] "Generic (PLEG): container finished" podID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerID="f5ab1439a0e0f55d639e28ff4132f07047ba5fc4a4e5d4bd70ac996e115d012e" exitCode=0 Sep 10 02:53:07.172489 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:07.172146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" event={"ID":"a405f132-4b18-49ef-a776-cd8495cacb7c","Type":"ContainerDied","Data":"f5ab1439a0e0f55d639e28ff4132f07047ba5fc4a4e5d4bd70ac996e115d012e"} Sep 10 02:53:10.185661 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:10.185629 2578 generic.go:356] "Generic (PLEG): container finished" podID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerID="12da5f98bc1d24b539df9c0db6fd6286e387c84850f020b5d08b9619ca0fc053" exitCode=0 Sep 10 02:53:10.186134 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:10.185714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" event={"ID":"a405f132-4b18-49ef-a776-cd8495cacb7c","Type":"ContainerDied","Data":"12da5f98bc1d24b539df9c0db6fd6286e387c84850f020b5d08b9619ca0fc053"} Sep 10 02:53:17.214867 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:17.214825 2578 generic.go:356] "Generic (PLEG): container finished" podID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerID="9bfb759d716cb220b8cf3e3c33fc524579273a65d5e4b02367f9622a4f4b5451" exitCode=0 Sep 10 02:53:17.215261 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:17.214898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" event={"ID":"a405f132-4b18-49ef-a776-cd8495cacb7c","Type":"ContainerDied","Data":"9bfb759d716cb220b8cf3e3c33fc524579273a65d5e4b02367f9622a4f4b5451"} Sep 10 02:53:18.342662 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.342633 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:53:18.479778 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.479684 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-bundle\") pod \"a405f132-4b18-49ef-a776-cd8495cacb7c\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " Sep 10 02:53:18.479918 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.479785 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgmtd\" (UniqueName: \"kubernetes.io/projected/a405f132-4b18-49ef-a776-cd8495cacb7c-kube-api-access-dgmtd\") pod \"a405f132-4b18-49ef-a776-cd8495cacb7c\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " Sep 10 02:53:18.479918 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.479827 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-util\") pod \"a405f132-4b18-49ef-a776-cd8495cacb7c\" (UID: \"a405f132-4b18-49ef-a776-cd8495cacb7c\") " Sep 10 02:53:18.480399 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.480361 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-bundle" (OuterVolumeSpecName: "bundle") pod "a405f132-4b18-49ef-a776-cd8495cacb7c" (UID: "a405f132-4b18-49ef-a776-cd8495cacb7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:53:18.482086 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.482063 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a405f132-4b18-49ef-a776-cd8495cacb7c-kube-api-access-dgmtd" (OuterVolumeSpecName: "kube-api-access-dgmtd") pod "a405f132-4b18-49ef-a776-cd8495cacb7c" (UID: "a405f132-4b18-49ef-a776-cd8495cacb7c"). InnerVolumeSpecName "kube-api-access-dgmtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:53:18.484766 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.484745 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-util" (OuterVolumeSpecName: "util") pod "a405f132-4b18-49ef-a776-cd8495cacb7c" (UID: "a405f132-4b18-49ef-a776-cd8495cacb7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:53:18.580595 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.580564 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:18.580595 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.580595 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgmtd\" (UniqueName: \"kubernetes.io/projected/a405f132-4b18-49ef-a776-cd8495cacb7c-kube-api-access-dgmtd\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:18.580765 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:18.580606 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a405f132-4b18-49ef-a776-cd8495cacb7c-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:19.224937 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:19.224908 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" Sep 10 02:53:19.225103 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:19.224909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vxt29" event={"ID":"a405f132-4b18-49ef-a776-cd8495cacb7c","Type":"ContainerDied","Data":"7e8f51081c16e5735fe8de4f945a619b45aff905f23daa22c8ac9480fa336ef9"} Sep 10 02:53:19.225103 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:19.225033 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e8f51081c16e5735fe8de4f945a619b45aff905f23daa22c8ac9480fa336ef9" Sep 10 02:53:20.569035 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:20.568996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:21.379206 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:21.379164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:22.506071 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506033 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8"] Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506314 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="pull" Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506326 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="pull" Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506334 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="extract" Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506340 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="extract" Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506354 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="util" Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506358 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="util" Sep 10 02:53:22.506484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.506399 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a405f132-4b18-49ef-a776-cd8495cacb7c" containerName="extract" Sep 10 02:53:22.509081 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.509064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.511596 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.511571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 02:53:22.511716 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.511574 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:53:22.511716 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.511631 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rvn2q\"" Sep 10 02:53:22.520963 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.520940 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8"] Sep 10 02:53:22.615109 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.615071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tj9z\" (UniqueName: \"kubernetes.io/projected/3c8a13d3-726c-4b7c-94f5-abeaf9470893-kube-api-access-7tj9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-582h8\" (UID: \"3c8a13d3-726c-4b7c-94f5-abeaf9470893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.615284 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.615117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c8a13d3-726c-4b7c-94f5-abeaf9470893-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-582h8\" (UID: \"3c8a13d3-726c-4b7c-94f5-abeaf9470893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.716421 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.716378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tj9z\" (UniqueName: \"kubernetes.io/projected/3c8a13d3-726c-4b7c-94f5-abeaf9470893-kube-api-access-7tj9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-582h8\" (UID: \"3c8a13d3-726c-4b7c-94f5-abeaf9470893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.716562 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.716437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c8a13d3-726c-4b7c-94f5-abeaf9470893-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-582h8\" (UID: \"3c8a13d3-726c-4b7c-94f5-abeaf9470893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.716794 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.716776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c8a13d3-726c-4b7c-94f5-abeaf9470893-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-582h8\" (UID: \"3c8a13d3-726c-4b7c-94f5-abeaf9470893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.725748 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.725717 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tj9z\" (UniqueName: \"kubernetes.io/projected/3c8a13d3-726c-4b7c-94f5-abeaf9470893-kube-api-access-7tj9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-582h8\" (UID: \"3c8a13d3-726c-4b7c-94f5-abeaf9470893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:22.818741 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:22.818712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" Sep 10 02:53:23.103894 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:23.103868 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8"] Sep 10 02:53:23.106517 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:23.106492 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8a13d3_726c_4b7c_94f5_abeaf9470893.slice/crio-be006e67148a11467ca7dfff55dba918b6bc77e60d83d8005c11ee6b441526d9 WatchSource:0}: Error finding container be006e67148a11467ca7dfff55dba918b6bc77e60d83d8005c11ee6b441526d9: Status 404 returned error can't find the container with id be006e67148a11467ca7dfff55dba918b6bc77e60d83d8005c11ee6b441526d9 Sep 10 02:53:23.239895 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:23.239864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" event={"ID":"3c8a13d3-726c-4b7c-94f5-abeaf9470893","Type":"ContainerStarted","Data":"be006e67148a11467ca7dfff55dba918b6bc77e60d83d8005c11ee6b441526d9"} Sep 10 02:53:24.174737 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:24.174698 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:24.275378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:24.275348 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:26.253739 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.253700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" event={"ID":"3c8a13d3-726c-4b7c-94f5-abeaf9470893","Type":"ContainerStarted","Data":"d84707d47ffe722cbb6e76305059f9b3e3d2a11a212884be6caffb99ee9ff7d1"} Sep 10 02:53:26.276380 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.276329 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-582h8" podStartSLOduration=1.6290209789999999 podStartE2EDuration="4.276311364s" totalImagesPullingTime="2.647290385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:53:26.274422651 +0000 UTC m=+250.760417924" watchObservedRunningTime="2026-09-10 02:53:26.276311364 +0000 UTC m=+250.762306637" Sep 10 02:53:26.533013 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.532985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:26.690102 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.690052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:26.837965 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.837885 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:26.878105 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.878071 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4cjvn"] Sep 10 02:53:26.904204 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.904180 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4cjvn"] Sep 10 02:53:26.904360 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.904284 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:26.907003 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.906979 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 02:53:26.907117 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.907031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wrwhp\"" Sep 10 02:53:26.908045 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:26.908006 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 02:53:27.052558 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.052517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c419e31-56d8-47ec-82b0-fa96dfff1e5c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4cjvn\" (UID: \"3c419e31-56d8-47ec-82b0-fa96dfff1e5c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.052739 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.052642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rj4\" (UniqueName: \"kubernetes.io/projected/3c419e31-56d8-47ec-82b0-fa96dfff1e5c-kube-api-access-82rj4\") pod \"cert-manager-webhook-6486ffd997-4cjvn\" (UID: \"3c419e31-56d8-47ec-82b0-fa96dfff1e5c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.066183 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.066155 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5"] Sep 10 02:53:27.088236 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.088161 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5"] Sep 10 02:53:27.088353 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.088274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.091018 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.090994 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:53:27.091193 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.091175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z47v6\"" Sep 10 02:53:27.091284 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.091264 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:53:27.154028 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.153995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rj4\" (UniqueName: \"kubernetes.io/projected/3c419e31-56d8-47ec-82b0-fa96dfff1e5c-kube-api-access-82rj4\") pod \"cert-manager-webhook-6486ffd997-4cjvn\" (UID: \"3c419e31-56d8-47ec-82b0-fa96dfff1e5c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.154176 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.154072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c419e31-56d8-47ec-82b0-fa96dfff1e5c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4cjvn\" (UID: \"3c419e31-56d8-47ec-82b0-fa96dfff1e5c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.164597 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.164572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c419e31-56d8-47ec-82b0-fa96dfff1e5c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4cjvn\" (UID: \"3c419e31-56d8-47ec-82b0-fa96dfff1e5c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.164768 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.164750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rj4\" (UniqueName: \"kubernetes.io/projected/3c419e31-56d8-47ec-82b0-fa96dfff1e5c-kube-api-access-82rj4\") pod \"cert-manager-webhook-6486ffd997-4cjvn\" (UID: \"3c419e31-56d8-47ec-82b0-fa96dfff1e5c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.212618 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.212590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:27.254937 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.254904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.255349 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.254992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.255349 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.255048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqj7q\" (UniqueName: \"kubernetes.io/projected/7cba4710-99aa-4397-8d61-c5b9248fc439-kube-api-access-sqj7q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.356271 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.356194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqj7q\" (UniqueName: \"kubernetes.io/projected/7cba4710-99aa-4397-8d61-c5b9248fc439-kube-api-access-sqj7q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.356409 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.356281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.356409 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.356318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.356658 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.356637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.356703 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.356691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.370022 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.369997 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqj7q\" (UniqueName: \"kubernetes.io/projected/7cba4710-99aa-4397-8d61-c5b9248fc439-kube-api-access-sqj7q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.397042 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.397005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:27.505099 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.505067 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4cjvn"] Sep 10 02:53:27.507839 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:27.507813 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c419e31_56d8_47ec_82b0_fa96dfff1e5c.slice/crio-ffa36ed728416aaa7fce65655db5e017560f4fe90575471cdb59a0b8a1a208af WatchSource:0}: Error finding container ffa36ed728416aaa7fce65655db5e017560f4fe90575471cdb59a0b8a1a208af: Status 404 returned error can't find the container with id ffa36ed728416aaa7fce65655db5e017560f4fe90575471cdb59a0b8a1a208af Sep 10 02:53:27.699131 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:27.699082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5"] Sep 10 02:53:27.701655 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:27.701633 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cba4710_99aa_4397_8d61_c5b9248fc439.slice/crio-882ff31026c99ca24772fd1c5ecf286ad8e5acd8ede941d8a694c755cfc7774e WatchSource:0}: Error finding container 882ff31026c99ca24772fd1c5ecf286ad8e5acd8ede941d8a694c755cfc7774e: Status 404 returned error can't find the container with id 882ff31026c99ca24772fd1c5ecf286ad8e5acd8ede941d8a694c755cfc7774e Sep 10 02:53:28.263788 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:28.263745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" event={"ID":"3c419e31-56d8-47ec-82b0-fa96dfff1e5c","Type":"ContainerStarted","Data":"ffa36ed728416aaa7fce65655db5e017560f4fe90575471cdb59a0b8a1a208af"} Sep 10 02:53:28.265589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:28.265558 2578 generic.go:356] "Generic (PLEG): container finished" podID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerID="47510f6042108f2dc3d1829bea8d8b5dff452c29d6ecea17f2515faaf82fac1b" exitCode=0 Sep 10 02:53:28.265727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:28.265621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" event={"ID":"7cba4710-99aa-4397-8d61-c5b9248fc439","Type":"ContainerDied","Data":"47510f6042108f2dc3d1829bea8d8b5dff452c29d6ecea17f2515faaf82fac1b"} Sep 10 02:53:28.265727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:28.265663 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" event={"ID":"7cba4710-99aa-4397-8d61-c5b9248fc439","Type":"ContainerStarted","Data":"882ff31026c99ca24772fd1c5ecf286ad8e5acd8ede941d8a694c755cfc7774e"} Sep 10 02:53:28.878538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:28.878496 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:29.057050 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:29.056956 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:31.162262 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.162214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:31.263185 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.263079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:31.282326 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.282282 2578 generic.go:356] "Generic (PLEG): container finished" podID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerID="84a2ebab4fa7405a00582c311ec72fa4dcc24a312fd045966e13e392bead47b4" exitCode=0 Sep 10 02:53:31.282541 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.282351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" event={"ID":"7cba4710-99aa-4397-8d61-c5b9248fc439","Type":"ContainerDied","Data":"84a2ebab4fa7405a00582c311ec72fa4dcc24a312fd045966e13e392bead47b4"} Sep 10 02:53:31.284135 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.284113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" event={"ID":"3c419e31-56d8-47ec-82b0-fa96dfff1e5c","Type":"ContainerStarted","Data":"2a2927ba5292251827fb28971eaae89b5031e5799a8f0109d66c87487cec7582"} Sep 10 02:53:31.284280 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.284260 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:31.319780 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:31.319721 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" podStartSLOduration=1.838437183 podStartE2EDuration="5.319700056s" totalImagesPullingTime="3.481262873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:53:31.318416469 +0000 UTC m=+255.804411741" watchObservedRunningTime="2026-09-10 02:53:31.319700056 +0000 UTC m=+255.805695333" Sep 10 02:53:32.291193 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:32.291156 2578 generic.go:356] "Generic (PLEG): container finished" podID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerID="630a1af07fa55ce04de3cf8612b9fa5c8c4f53b2203ccaa0a8c53dbc85c0b36c" exitCode=0 Sep 10 02:53:32.291589 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:32.291251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" event={"ID":"7cba4710-99aa-4397-8d61-c5b9248fc439","Type":"ContainerDied","Data":"630a1af07fa55ce04de3cf8612b9fa5c8c4f53b2203ccaa0a8c53dbc85c0b36c"} Sep 10 02:53:33.417126 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.417101 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:33.436644 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.436613 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl"] Sep 10 02:53:33.437039 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437017 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="pull" Sep 10 02:53:33.437084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437043 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="pull" Sep 10 02:53:33.437084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437073 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="util" Sep 10 02:53:33.437084 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437082 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="util" Sep 10 02:53:33.437247 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437096 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="extract" Sep 10 02:53:33.437247 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437105 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="extract" Sep 10 02:53:33.437247 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.437211 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cba4710-99aa-4397-8d61-c5b9248fc439" containerName="extract" Sep 10 02:53:33.439557 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.439532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.442326 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.442305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xjvhs\"" Sep 10 02:53:33.448447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.448425 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl"] Sep 10 02:53:33.608560 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.608476 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqj7q\" (UniqueName: \"kubernetes.io/projected/7cba4710-99aa-4397-8d61-c5b9248fc439-kube-api-access-sqj7q\") pod \"7cba4710-99aa-4397-8d61-c5b9248fc439\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " Sep 10 02:53:33.608560 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.608515 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-util\") pod \"7cba4710-99aa-4397-8d61-c5b9248fc439\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " Sep 10 02:53:33.608560 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.608540 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-bundle\") pod \"7cba4710-99aa-4397-8d61-c5b9248fc439\" (UID: \"7cba4710-99aa-4397-8d61-c5b9248fc439\") " Sep 10 02:53:33.608827 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.608659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcbnh\" (UniqueName: \"kubernetes.io/projected/c9563c82-0dc2-4af5-a96a-d43752d91bd2-kube-api-access-bcbnh\") pod \"cert-manager-cainjector-559cdd8c87-c8rzl\" (UID: \"c9563c82-0dc2-4af5-a96a-d43752d91bd2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.608827 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.608690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9563c82-0dc2-4af5-a96a-d43752d91bd2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c8rzl\" (UID: \"c9563c82-0dc2-4af5-a96a-d43752d91bd2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.608938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.608915 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-bundle" (OuterVolumeSpecName: "bundle") pod "7cba4710-99aa-4397-8d61-c5b9248fc439" (UID: "7cba4710-99aa-4397-8d61-c5b9248fc439"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:53:33.610735 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.610705 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cba4710-99aa-4397-8d61-c5b9248fc439-kube-api-access-sqj7q" (OuterVolumeSpecName: "kube-api-access-sqj7q") pod "7cba4710-99aa-4397-8d61-c5b9248fc439" (UID: "7cba4710-99aa-4397-8d61-c5b9248fc439"). InnerVolumeSpecName "kube-api-access-sqj7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:53:33.613126 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.613100 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-util" (OuterVolumeSpecName: "util") pod "7cba4710-99aa-4397-8d61-c5b9248fc439" (UID: "7cba4710-99aa-4397-8d61-c5b9248fc439"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:53:33.709757 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.709704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcbnh\" (UniqueName: \"kubernetes.io/projected/c9563c82-0dc2-4af5-a96a-d43752d91bd2-kube-api-access-bcbnh\") pod \"cert-manager-cainjector-559cdd8c87-c8rzl\" (UID: \"c9563c82-0dc2-4af5-a96a-d43752d91bd2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.709943 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.709775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9563c82-0dc2-4af5-a96a-d43752d91bd2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c8rzl\" (UID: \"c9563c82-0dc2-4af5-a96a-d43752d91bd2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.709943 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.709872 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqj7q\" (UniqueName: \"kubernetes.io/projected/7cba4710-99aa-4397-8d61-c5b9248fc439-kube-api-access-sqj7q\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:33.709943 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.709888 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:33.709943 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.709901 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cba4710-99aa-4397-8d61-c5b9248fc439-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:33.718203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.718172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcbnh\" (UniqueName: \"kubernetes.io/projected/c9563c82-0dc2-4af5-a96a-d43752d91bd2-kube-api-access-bcbnh\") pod \"cert-manager-cainjector-559cdd8c87-c8rzl\" (UID: \"c9563c82-0dc2-4af5-a96a-d43752d91bd2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.718203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.718192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9563c82-0dc2-4af5-a96a-d43752d91bd2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c8rzl\" (UID: \"c9563c82-0dc2-4af5-a96a-d43752d91bd2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:33.750538 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:33.750513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" Sep 10 02:53:34.018343 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.018320 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl"] Sep 10 02:53:34.020551 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:34.020516 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9563c82_0dc2_4af5_a96a_d43752d91bd2.slice/crio-03f8cc37ad42e0a71d5c5e85a4985856c9e4e56036bceb7e9c080b1da6d120a7 WatchSource:0}: Error finding container 03f8cc37ad42e0a71d5c5e85a4985856c9e4e56036bceb7e9c080b1da6d120a7: Status 404 returned error can't find the container with id 03f8cc37ad42e0a71d5c5e85a4985856c9e4e56036bceb7e9c080b1da6d120a7 Sep 10 02:53:34.307406 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.307375 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" Sep 10 02:53:34.307591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.307392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrss5" event={"ID":"7cba4710-99aa-4397-8d61-c5b9248fc439","Type":"ContainerDied","Data":"882ff31026c99ca24772fd1c5ecf286ad8e5acd8ede941d8a694c755cfc7774e"} Sep 10 02:53:34.307591 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.307480 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="882ff31026c99ca24772fd1c5ecf286ad8e5acd8ede941d8a694c755cfc7774e" Sep 10 02:53:34.309648 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.309621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" event={"ID":"c9563c82-0dc2-4af5-a96a-d43752d91bd2","Type":"ContainerStarted","Data":"6c113d029fb9aa907a998abdf363c3140014c378da8d0c26cfad074e29474407"} Sep 10 02:53:34.309778 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.309660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" event={"ID":"c9563c82-0dc2-4af5-a96a-d43752d91bd2","Type":"ContainerStarted","Data":"03f8cc37ad42e0a71d5c5e85a4985856c9e4e56036bceb7e9c080b1da6d120a7"} Sep 10 02:53:34.326172 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:34.326130 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c8rzl" podStartSLOduration=1.326116894 podStartE2EDuration="1.326116894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:53:34.325288242 +0000 UTC m=+258.811283516" watchObservedRunningTime="2026-09-10 02:53:34.326116894 +0000 UTC m=+258.812112168" Sep 10 02:53:35.059348 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:35.059303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:35.118345 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:35.118314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:36.657701 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:36.657673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:37.293183 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:37.293156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4cjvn" Sep 10 02:53:42.784978 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:42.784937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:42.896202 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:42.896165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:44.798931 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.798892 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw"] Sep 10 02:53:44.803271 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.803214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:44.805718 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.805692 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 02:53:44.806705 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.806682 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:53:44.806705 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.806697 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-schkw\"" Sep 10 02:53:44.812451 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.812428 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw"] Sep 10 02:53:44.888998 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.888970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8f3d126-6fed-4a3d-9c25-8fcf7ad125af-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rbcfw\" (UID: \"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:44.889168 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.889039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwz5l\" (UniqueName: \"kubernetes.io/projected/d8f3d126-6fed-4a3d-9c25-8fcf7ad125af-kube-api-access-xwz5l\") pod \"openshift-lws-operator-fd8ccff4c-rbcfw\" (UID: \"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:44.990309 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.990273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8f3d126-6fed-4a3d-9c25-8fcf7ad125af-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rbcfw\" (UID: \"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:44.990452 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.990374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwz5l\" (UniqueName: \"kubernetes.io/projected/d8f3d126-6fed-4a3d-9c25-8fcf7ad125af-kube-api-access-xwz5l\") pod \"openshift-lws-operator-fd8ccff4c-rbcfw\" (UID: \"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:44.990726 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.990706 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8f3d126-6fed-4a3d-9c25-8fcf7ad125af-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rbcfw\" (UID: \"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:44.998738 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:44.998705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwz5l\" (UniqueName: \"kubernetes.io/projected/d8f3d126-6fed-4a3d-9c25-8fcf7ad125af-kube-api-access-xwz5l\") pod \"openshift-lws-operator-fd8ccff4c-rbcfw\" (UID: \"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:45.113493 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:45.113399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" Sep 10 02:53:45.381725 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:45.381695 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw"] Sep 10 02:53:45.383735 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:45.383705 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8f3d126_6fed_4a3d_9c25_8fcf7ad125af.slice/crio-7c5892d7e4a1cea98abcb2d34c8eed097478d158809b6c04d62ab73bb62642bd WatchSource:0}: Error finding container 7c5892d7e4a1cea98abcb2d34c8eed097478d158809b6c04d62ab73bb62642bd: Status 404 returned error can't find the container with id 7c5892d7e4a1cea98abcb2d34c8eed097478d158809b6c04d62ab73bb62642bd Sep 10 02:53:46.361287 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:46.361249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" event={"ID":"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af","Type":"ContainerStarted","Data":"7c5892d7e4a1cea98abcb2d34c8eed097478d158809b6c04d62ab73bb62642bd"} Sep 10 02:53:48.373174 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:48.373140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" event={"ID":"d8f3d126-6fed-4a3d-9c25-8fcf7ad125af","Type":"ContainerStarted","Data":"adfb31e26e7eb56effad0a519203116ae55b8165511d6d1a5ece4d2dfd1dc020"} Sep 10 02:53:48.400370 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:48.400322 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbcfw" podStartSLOduration=2.399367716 podStartE2EDuration="4.400306052s" totalImagesPullingTime="2.000938336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:53:48.399086527 +0000 UTC m=+272.885081802" watchObservedRunningTime="2026-09-10 02:53:48.400306052 +0000 UTC m=+272.886301326" Sep 10 02:53:49.188617 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:49.188579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:49.290593 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:49.290553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:51.302483 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:51.302453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:53:52.584784 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.584748 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth"] Sep 10 02:53:52.587264 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.587244 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.589928 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.589902 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:53:52.590679 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.590664 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:53:52.590732 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.590679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z47v6\"" Sep 10 02:53:52.595798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.595769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth"] Sep 10 02:53:52.657668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.657634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.657668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.657670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.657882 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.657691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9s84\" (UniqueName: \"kubernetes.io/projected/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-kube-api-access-b9s84\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.758626 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.758585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.758811 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.758629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.758811 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.758661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9s84\" (UniqueName: \"kubernetes.io/projected/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-kube-api-access-b9s84\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.758986 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.758962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.759045 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.758996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.767671 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.767652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9s84\" (UniqueName: \"kubernetes.io/projected/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-kube-api-access-b9s84\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:52.896611 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:52.896531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:53.166037 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:53.165958 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth"] Sep 10 02:53:53.169673 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:53:53.169644 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4944b24_f0c8_4bf7_a55a_1c06757f87b4.slice/crio-4266a3c2a56da8e280b60b2abaa0271691f57d6398ce275cbbb4a23523331e4d WatchSource:0}: Error finding container 4266a3c2a56da8e280b60b2abaa0271691f57d6398ce275cbbb4a23523331e4d: Status 404 returned error can't find the container with id 4266a3c2a56da8e280b60b2abaa0271691f57d6398ce275cbbb4a23523331e4d Sep 10 02:53:53.395005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:53.394969 2578 generic.go:356] "Generic (PLEG): container finished" podID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerID="c30a9b41776794b9c1c6399bdc86e90fc4c3471d4f9269417ee764f384e25534" exitCode=0 Sep 10 02:53:53.395188 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:53.395061 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" event={"ID":"d4944b24-f0c8-4bf7-a55a-1c06757f87b4","Type":"ContainerDied","Data":"c30a9b41776794b9c1c6399bdc86e90fc4c3471d4f9269417ee764f384e25534"} Sep 10 02:53:53.395188 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:53.395114 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" event={"ID":"d4944b24-f0c8-4bf7-a55a-1c06757f87b4","Type":"ContainerStarted","Data":"4266a3c2a56da8e280b60b2abaa0271691f57d6398ce275cbbb4a23523331e4d"} Sep 10 02:53:54.400766 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:54.400734 2578 generic.go:356] "Generic (PLEG): container finished" podID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerID="98feafc54dc363b240d674187f68b842e19e038fea396001563ea096a2e32b8a" exitCode=0 Sep 10 02:53:54.401197 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:54.400777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" event={"ID":"d4944b24-f0c8-4bf7-a55a-1c06757f87b4","Type":"ContainerDied","Data":"98feafc54dc363b240d674187f68b842e19e038fea396001563ea096a2e32b8a"} Sep 10 02:53:55.407699 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:55.407662 2578 generic.go:356] "Generic (PLEG): container finished" podID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerID="c18cca8c7dc41047aac922e4971ab1d4b636d341e580a490718582d887f8e237" exitCode=0 Sep 10 02:53:55.408120 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:55.407736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" event={"ID":"d4944b24-f0c8-4bf7-a55a-1c06757f87b4","Type":"ContainerDied","Data":"c18cca8c7dc41047aac922e4971ab1d4b636d341e580a490718582d887f8e237"} Sep 10 02:53:56.530835 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.530811 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:56.591077 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.591047 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-util\") pod \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " Sep 10 02:53:56.591203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.591100 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9s84\" (UniqueName: \"kubernetes.io/projected/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-kube-api-access-b9s84\") pod \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " Sep 10 02:53:56.591203 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.591120 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-bundle\") pod \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\" (UID: \"d4944b24-f0c8-4bf7-a55a-1c06757f87b4\") " Sep 10 02:53:56.591933 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.591829 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-bundle" (OuterVolumeSpecName: "bundle") pod "d4944b24-f0c8-4bf7-a55a-1c06757f87b4" (UID: "d4944b24-f0c8-4bf7-a55a-1c06757f87b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:53:56.593400 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.593372 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-kube-api-access-b9s84" (OuterVolumeSpecName: "kube-api-access-b9s84") pod "d4944b24-f0c8-4bf7-a55a-1c06757f87b4" (UID: "d4944b24-f0c8-4bf7-a55a-1c06757f87b4"). InnerVolumeSpecName "kube-api-access-b9s84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:53:56.596620 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.596603 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-util" (OuterVolumeSpecName: "util") pod "d4944b24-f0c8-4bf7-a55a-1c06757f87b4" (UID: "d4944b24-f0c8-4bf7-a55a-1c06757f87b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:53:56.692096 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.692012 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:56.692096 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.692043 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9s84\" (UniqueName: \"kubernetes.io/projected/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-kube-api-access-b9s84\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:56.692096 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:56.692053 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4944b24-f0c8-4bf7-a55a-1c06757f87b4-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:53:57.417938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:57.417904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" event={"ID":"d4944b24-f0c8-4bf7-a55a-1c06757f87b4","Type":"ContainerDied","Data":"4266a3c2a56da8e280b60b2abaa0271691f57d6398ce275cbbb4a23523331e4d"} Sep 10 02:53:57.417938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:57.417924 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnvwth" Sep 10 02:53:57.418130 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:53:57.417956 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4266a3c2a56da8e280b60b2abaa0271691f57d6398ce275cbbb4a23523331e4d" Sep 10 02:54:01.573902 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.573861 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:01.663286 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663246 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl"] Sep 10 02:54:01.663609 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663591 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="extract" Sep 10 02:54:01.663691 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663613 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="extract" Sep 10 02:54:01.663691 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663651 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="util" Sep 10 02:54:01.663691 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663660 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="util" Sep 10 02:54:01.663691 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663677 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="pull" Sep 10 02:54:01.663691 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663686 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="pull" Sep 10 02:54:01.663912 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.663760 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4944b24-f0c8-4bf7-a55a-1c06757f87b4" containerName="extract" Sep 10 02:54:01.667318 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.667297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.670447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.670425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 02:54:01.671879 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.671863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t6jkp\"" Sep 10 02:54:01.671961 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.671944 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 02:54:01.674650 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.674626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 02:54:01.684305 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.684283 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl"] Sep 10 02:54:01.713301 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.713243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:01.736800 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.736772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-manager-config\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.736944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.736810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-cert\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.736944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.736832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnj9c\" (UniqueName: \"kubernetes.io/projected/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-kube-api-access-hnj9c\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.737075 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.736965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-metrics-cert\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.838583 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.838496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-manager-config\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.839606 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.839583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-cert\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.840173 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.840153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnj9c\" (UniqueName: \"kubernetes.io/projected/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-kube-api-access-hnj9c\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.840678 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.839500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-manager-config\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.840764 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.840655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-metrics-cert\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.843504 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.843464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-cert\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.843609 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.843580 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-metrics-cert\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.849772 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.849749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnj9c\" (UniqueName: \"kubernetes.io/projected/4b0c61cc-86f1-4c9c-81a4-617ee2c422f4-kube-api-access-hnj9c\") pod \"lws-controller-manager-79bc984b7c-9l2rl\" (UID: \"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4\") " pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:01.976723 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:01.976686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:02.250919 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.250888 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl"] Sep 10 02:54:02.252645 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:54:02.252617 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0c61cc_86f1_4c9c_81a4_617ee2c422f4.slice/crio-7aeae68ac32040abe12c5c79b7582e9e70829a4062e346faf2b855905c79072e WatchSource:0}: Error finding container 7aeae68ac32040abe12c5c79b7582e9e70829a4062e346faf2b855905c79072e: Status 404 returned error can't find the container with id 7aeae68ac32040abe12c5c79b7582e9e70829a4062e346faf2b855905c79072e Sep 10 02:54:02.441816 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.441783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" event={"ID":"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4","Type":"ContainerStarted","Data":"7aeae68ac32040abe12c5c79b7582e9e70829a4062e346faf2b855905c79072e"} Sep 10 02:54:02.612908 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.612867 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln"] Sep 10 02:54:02.659742 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.659705 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln"] Sep 10 02:54:02.659888 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.659830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.662812 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.662787 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:54:02.662938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.662789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:54:02.663708 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.663688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z47v6\"" Sep 10 02:54:02.751491 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.751458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.751491 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.751500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.751740 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.751573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptq7f\" (UniqueName: \"kubernetes.io/projected/1faeff25-1449-4d35-ae82-e8e6b540d4e2-kube-api-access-ptq7f\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.852973 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.852934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.853150 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.852979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.853150 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.853032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptq7f\" (UniqueName: \"kubernetes.io/projected/1faeff25-1449-4d35-ae82-e8e6b540d4e2-kube-api-access-ptq7f\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.853426 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.853405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.853478 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.853415 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.861847 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.861827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptq7f\" (UniqueName: \"kubernetes.io/projected/1faeff25-1449-4d35-ae82-e8e6b540d4e2-kube-api-access-ptq7f\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:02.969976 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:02.969887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:03.265164 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:03.265078 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln"] Sep 10 02:54:03.268724 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:54:03.268687 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1faeff25_1449_4d35_ae82_e8e6b540d4e2.slice/crio-9591caed2fd36ae9ecc3dc68ffa3ce199cf5ec1c086ccbecbf6413167d85d992 WatchSource:0}: Error finding container 9591caed2fd36ae9ecc3dc68ffa3ce199cf5ec1c086ccbecbf6413167d85d992: Status 404 returned error can't find the container with id 9591caed2fd36ae9ecc3dc68ffa3ce199cf5ec1c086ccbecbf6413167d85d992 Sep 10 02:54:03.450579 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:03.450545 2578 generic.go:356] "Generic (PLEG): container finished" podID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerID="727f7492eaad65e8f3b05a5b0d5235dfe337593e777b1b05e34f8185ced9fe2d" exitCode=0 Sep 10 02:54:03.450727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:03.450652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" event={"ID":"1faeff25-1449-4d35-ae82-e8e6b540d4e2","Type":"ContainerDied","Data":"727f7492eaad65e8f3b05a5b0d5235dfe337593e777b1b05e34f8185ced9fe2d"} Sep 10 02:54:03.450727 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:03.450696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" event={"ID":"1faeff25-1449-4d35-ae82-e8e6b540d4e2","Type":"ContainerStarted","Data":"9591caed2fd36ae9ecc3dc68ffa3ce199cf5ec1c086ccbecbf6413167d85d992"} Sep 10 02:54:03.694721 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:03.694686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:03.792938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:03.792881 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:04.304186 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.304148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:04.457376 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.457341 2578 generic.go:356] "Generic (PLEG): container finished" podID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerID="74c999b2f4e5c77623fe6564aec15d9135dbb7c8bb880bf390117c0d377d7c1d" exitCode=0 Sep 10 02:54:04.457549 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.457427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" event={"ID":"1faeff25-1449-4d35-ae82-e8e6b540d4e2","Type":"ContainerDied","Data":"74c999b2f4e5c77623fe6564aec15d9135dbb7c8bb880bf390117c0d377d7c1d"} Sep 10 02:54:04.459116 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.459091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" event={"ID":"4b0c61cc-86f1-4c9c-81a4-617ee2c422f4","Type":"ContainerStarted","Data":"7fffa2f820cdfd0c97641285c43573e6fc2536f1de72a62045a6a40a780d98f4"} Sep 10 02:54:04.459188 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.459152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:04.506316 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.504024 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" podStartSLOduration=1.884857515 podStartE2EDuration="3.504005009s" totalImagesPullingTime="1.619147494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:04.503773548 +0000 UTC m=+288.989768822" watchObservedRunningTime="2026-09-10 02:54:04.504005009 +0000 UTC m=+288.990000284" Sep 10 02:54:04.584985 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.584893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:04.695427 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.695385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:04.708483 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.708453 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm"] Sep 10 02:54:04.710721 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.710700 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.713982 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.713949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7zgks\"" Sep 10 02:54:04.714139 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.714009 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 02:54:04.714139 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.714011 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 02:54:04.714139 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.714093 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 02:54:04.714388 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.714193 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 02:54:04.728169 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.728144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm"] Sep 10 02:54:04.769105 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.769070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/118594c3-b695-4a8a-8dff-23db14db33ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.769105 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.769108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85rhb\" (UniqueName: \"kubernetes.io/projected/118594c3-b695-4a8a-8dff-23db14db33ef-kube-api-access-85rhb\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.769347 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.769186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/118594c3-b695-4a8a-8dff-23db14db33ef-manifests\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.769347 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.769278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/118594c3-b695-4a8a-8dff-23db14db33ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.769347 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.769306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/118594c3-b695-4a8a-8dff-23db14db33ef-tmp\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.852011 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.851918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:04.869981 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.869950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/118594c3-b695-4a8a-8dff-23db14db33ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.870120 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.869989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85rhb\" (UniqueName: \"kubernetes.io/projected/118594c3-b695-4a8a-8dff-23db14db33ef-kube-api-access-85rhb\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.870120 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.870028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/118594c3-b695-4a8a-8dff-23db14db33ef-manifests\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.870120 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.870098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/118594c3-b695-4a8a-8dff-23db14db33ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.870308 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.870132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/118594c3-b695-4a8a-8dff-23db14db33ef-tmp\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.870588 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.870554 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/118594c3-b695-4a8a-8dff-23db14db33ef-manifests\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.872839 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.872814 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/118594c3-b695-4a8a-8dff-23db14db33ef-tmp\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.872944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.872855 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/118594c3-b695-4a8a-8dff-23db14db33ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.872985 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.872955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/118594c3-b695-4a8a-8dff-23db14db33ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.881180 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.881157 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85rhb\" (UniqueName: \"kubernetes.io/projected/118594c3-b695-4a8a-8dff-23db14db33ef-kube-api-access-85rhb\") pod \"opendatahub-operator-controller-manager-78f567c59b-7c9gm\" (UID: \"118594c3-b695-4a8a-8dff-23db14db33ef\") " pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:04.949117 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:04.949074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:05.021273 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.021211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:05.072479 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.072329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:05.163642 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.163547 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:05.261217 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.260467 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:05.304024 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.303983 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm"] Sep 10 02:54:05.305507 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:54:05.305482 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118594c3_b695_4a8a_8dff_23db14db33ef.slice/crio-bbcc0472382d6f08b67b2b8eba22abcb10448e9956a72f02b29832b68fdba817 WatchSource:0}: Error finding container bbcc0472382d6f08b67b2b8eba22abcb10448e9956a72f02b29832b68fdba817: Status 404 returned error can't find the container with id bbcc0472382d6f08b67b2b8eba22abcb10448e9956a72f02b29832b68fdba817 Sep 10 02:54:05.360173 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.360141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:05.466996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.466913 2578 generic.go:356] "Generic (PLEG): container finished" podID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerID="71cad730840595a7ea99d96c448448863f39f3df7882f41e20b96b7625f79563" exitCode=0 Sep 10 02:54:05.466996 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.466984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" event={"ID":"1faeff25-1449-4d35-ae82-e8e6b540d4e2","Type":"ContainerDied","Data":"71cad730840595a7ea99d96c448448863f39f3df7882f41e20b96b7625f79563"} Sep 10 02:54:05.468378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:05.468347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" event={"ID":"118594c3-b695-4a8a-8dff-23db14db33ef","Type":"ContainerStarted","Data":"bbcc0472382d6f08b67b2b8eba22abcb10448e9956a72f02b29832b68fdba817"} Sep 10 02:54:06.625775 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.625746 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:06.685938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.685907 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptq7f\" (UniqueName: \"kubernetes.io/projected/1faeff25-1449-4d35-ae82-e8e6b540d4e2-kube-api-access-ptq7f\") pod \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " Sep 10 02:54:06.686122 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.685976 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-bundle\") pod \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " Sep 10 02:54:06.686122 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.686010 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-util\") pod \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\" (UID: \"1faeff25-1449-4d35-ae82-e8e6b540d4e2\") " Sep 10 02:54:06.687030 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.686994 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-bundle" (OuterVolumeSpecName: "bundle") pod "1faeff25-1449-4d35-ae82-e8e6b540d4e2" (UID: "1faeff25-1449-4d35-ae82-e8e6b540d4e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:54:06.688863 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.688825 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1faeff25-1449-4d35-ae82-e8e6b540d4e2-kube-api-access-ptq7f" (OuterVolumeSpecName: "kube-api-access-ptq7f") pod "1faeff25-1449-4d35-ae82-e8e6b540d4e2" (UID: "1faeff25-1449-4d35-ae82-e8e6b540d4e2"). InnerVolumeSpecName "kube-api-access-ptq7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:54:06.693509 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.693475 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-util" (OuterVolumeSpecName: "util") pod "1faeff25-1449-4d35-ae82-e8e6b540d4e2" (UID: "1faeff25-1449-4d35-ae82-e8e6b540d4e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:54:06.787726 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.787689 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptq7f\" (UniqueName: \"kubernetes.io/projected/1faeff25-1449-4d35-ae82-e8e6b540d4e2-kube-api-access-ptq7f\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:54:06.787726 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.787721 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:54:06.787726 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:06.787731 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1faeff25-1449-4d35-ae82-e8e6b540d4e2-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:54:07.481801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:07.481765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" event={"ID":"1faeff25-1449-4d35-ae82-e8e6b540d4e2","Type":"ContainerDied","Data":"9591caed2fd36ae9ecc3dc68ffa3ce199cf5ec1c086ccbecbf6413167d85d992"} Sep 10 02:54:07.481801 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:07.481788 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b042cln" Sep 10 02:54:07.482009 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:07.481815 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9591caed2fd36ae9ecc3dc68ffa3ce199cf5ec1c086ccbecbf6413167d85d992" Sep 10 02:54:08.488452 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:08.488412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" event={"ID":"118594c3-b695-4a8a-8dff-23db14db33ef","Type":"ContainerStarted","Data":"d8e05933406522cd12756e74f956c965f6e5d9159937a4f45bcd4fb160f08f0b"} Sep 10 02:54:10.499402 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:10.499367 2578 generic.go:356] "Generic (PLEG): container finished" podID="118594c3-b695-4a8a-8dff-23db14db33ef" containerID="d8e05933406522cd12756e74f956c965f6e5d9159937a4f45bcd4fb160f08f0b" exitCode=0 Sep 10 02:54:10.499763 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:10.499437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" event={"ID":"118594c3-b695-4a8a-8dff-23db14db33ef","Type":"ContainerDied","Data":"d8e05933406522cd12756e74f956c965f6e5d9159937a4f45bcd4fb160f08f0b"} Sep 10 02:54:11.505855 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:11.505822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" event={"ID":"118594c3-b695-4a8a-8dff-23db14db33ef","Type":"ContainerStarted","Data":"9415ac95f1d916e0030973f5fe25108115fc3e7491d26ac44de918678f34afe5"} Sep 10 02:54:11.506251 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:11.506036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:11.528745 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:11.528683 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" podStartSLOduration=3.06700738 podStartE2EDuration="7.528667989s" totalImagesPullingTime="3.406434668s" totalInitContainerRuntime="1.055225941s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:11.526434169 +0000 UTC m=+296.012429479" watchObservedRunningTime="2026-09-10 02:54:11.528667989 +0000 UTC m=+296.014663263" Sep 10 02:54:15.373236 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:15.373197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:15.470669 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:15.470631 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79bc984b7c-9l2rl" Sep 10 02:54:15.473638 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:15.473604 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:15.927552 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:15.927532 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 02:54:22.514925 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:22.514892 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78f567c59b-7c9gm" Sep 10 02:54:24.047499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:24.047460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:25.538640 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:25.538582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:34.820373 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.820328 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:34.887815 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.887778 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-846bd484f-crh4z"] Sep 10 02:54:34.888321 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888303 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="extract" Sep 10 02:54:34.888371 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888327 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="extract" Sep 10 02:54:34.888371 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888349 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="pull" Sep 10 02:54:34.888371 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888358 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="pull" Sep 10 02:54:34.888466 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888393 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="util" Sep 10 02:54:34.888466 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888403 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="util" Sep 10 02:54:34.888533 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.888488 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1faeff25-1449-4d35-ae82-e8e6b540d4e2" containerName="extract" Sep 10 02:54:34.894157 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.894130 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:34.898581 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.898565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 02:54:34.899739 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.899721 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 02:54:34.899739 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.899728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jcvfd\"" Sep 10 02:54:34.899914 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.899730 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 02:54:34.899914 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.899733 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 02:54:34.908428 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.908409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-846bd484f-crh4z"] Sep 10 02:54:34.934110 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.934030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tls-certs\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:34.934290 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.934125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tmp\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:34.934290 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:34.934181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zbp\" (UniqueName: \"kubernetes.io/projected/8ba32461-1b69-4d00-8361-77fb8a14e3f3-kube-api-access-87zbp\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.025502 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.025462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:35.035496 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.035464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zbp\" (UniqueName: \"kubernetes.io/projected/8ba32461-1b69-4d00-8361-77fb8a14e3f3-kube-api-access-87zbp\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.035892 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.035554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tls-certs\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.035892 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.035606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tmp\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.035892 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:54:35.035692 2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 10 02:54:35.035892 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:54:35.035760 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tls-certs podName:8ba32461-1b69-4d00-8361-77fb8a14e3f3 nodeName:}" failed. No retries permitted until 2026-09-10 02:54:35.535741707 +0000 UTC m=+320.021736976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tls-certs") pod "kube-auth-proxy-846bd484f-crh4z" (UID: "8ba32461-1b69-4d00-8361-77fb8a14e3f3") : secret "kube-auth-proxy-tls" not found Sep 10 02:54:35.038292 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.038270 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tmp\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.047677 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.047657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zbp\" (UniqueName: \"kubernetes.io/projected/8ba32461-1b69-4d00-8361-77fb8a14e3f3-kube-api-access-87zbp\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.122930 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.122843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:35.223412 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.223361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:35.540968 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.540935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tls-certs\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.543515 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.543481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba32461-1b69-4d00-8361-77fb8a14e3f3-tls-certs\") pod \"kube-auth-proxy-846bd484f-crh4z\" (UID: \"8ba32461-1b69-4d00-8361-77fb8a14e3f3\") " pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:35.731079 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.731027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:35.804514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:35.804430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" Sep 10 02:54:36.026737 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.026669 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:36.081141 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.081106 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-846bd484f-crh4z"] Sep 10 02:54:36.082946 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:54:36.082919 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba32461_1b69_4d00_8361_77fb8a14e3f3.slice/crio-10f220e4e1afcec55fb30900f005292309c75117c930094ee845c003c43e71b8 WatchSource:0}: Error finding container 10f220e4e1afcec55fb30900f005292309c75117c930094ee845c003c43e71b8: Status 404 returned error can't find the container with id 10f220e4e1afcec55fb30900f005292309c75117c930094ee845c003c43e71b8 Sep 10 02:54:36.084836 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.084816 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:54:36.121145 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.121113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:36.221598 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.221566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:36.629698 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.629621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" event={"ID":"8ba32461-1b69-4d00-8361-77fb8a14e3f3","Type":"ContainerStarted","Data":"10f220e4e1afcec55fb30900f005292309c75117c930094ee845c003c43e71b8"} Sep 10 02:54:36.937134 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:36.937038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:39.645174 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:39.645142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" event={"ID":"8ba32461-1b69-4d00-8361-77fb8a14e3f3","Type":"ContainerStarted","Data":"867a9d49212e0fc8234adcf83eda37987cde31979a1e6cb40553bffd769b1402"} Sep 10 02:54:39.663268 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:39.663204 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-846bd484f-crh4z" podStartSLOduration=3.134943662 podStartE2EDuration="5.663188035s" totalImagesPullingTime="2.528244373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:54:39.661418951 +0000 UTC m=+324.147414227" watchObservedRunningTime="2026-09-10 02:54:39.663188035 +0000 UTC m=+324.149183309" Sep 10 02:54:43.157617 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:43.157578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:43.293741 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:43.293697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:43.425982 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:43.425898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:43.659456 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:43.659418 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:43.868673 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:43.868637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:46.455690 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:46.455655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:46.568516 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:46.568482 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:46.654499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:46.654463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:47.071032 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:47.070998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:47.755401 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:47.755363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:47.856687 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:47.856644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:54:47.923864 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:54:47.923828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:36.126700 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:36.126613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:36.225355 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:36.225320 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:39.812110 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.812074 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d"] Sep 10 02:55:39.815351 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.815334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.817885 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.817867 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 02:55:39.819008 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.818986 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 02:55:39.819124 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.819011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z47v6\"" Sep 10 02:55:39.824321 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.824295 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d"] Sep 10 02:55:39.867837 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.867805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.867999 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.867859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.867999 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.867898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dkbm\" (UniqueName: \"kubernetes.io/projected/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-kube-api-access-8dkbm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.901989 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.901952 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq"] Sep 10 02:55:39.905361 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.905344 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:39.912800 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.912777 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq"] Sep 10 02:55:39.968936 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.968905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.969098 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.968940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:39.969098 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.968991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dkbm\" (UniqueName: \"kubernetes.io/projected/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-kube-api-access-8dkbm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.969098 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.969026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.969098 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.969052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:39.969098 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.969082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg67v\" (UniqueName: \"kubernetes.io/projected/16fafae0-91f3-4ae0-95ca-f14ad6bef136-kube-api-access-sg67v\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:39.969393 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.969316 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.969393 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.969347 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:39.977078 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:39.977039 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dkbm\" (UniqueName: \"kubernetes.io/projected/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-kube-api-access-8dkbm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:40.007944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.007916 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng"] Sep 10 02:55:40.013447 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.013415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.019110 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.019080 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng"] Sep 10 02:55:40.069629 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.069556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.069629 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.069609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.069860 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.069632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwzng\" (UniqueName: \"kubernetes.io/projected/905d47db-280f-4ce1-b790-7c53f4e921ba-kube-api-access-qwzng\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.069922 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.069890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.069981 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.069934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg67v\" (UniqueName: \"kubernetes.io/projected/16fafae0-91f3-4ae0-95ca-f14ad6bef136-kube-api-access-sg67v\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.070039 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.069998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.070039 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.070008 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.070271 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.070253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.078582 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.078559 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg67v\" (UniqueName: \"kubernetes.io/projected/16fafae0-91f3-4ae0-95ca-f14ad6bef136-kube-api-access-sg67v\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.106275 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.106250 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l"] Sep 10 02:55:40.109918 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.109899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.116780 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.116757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l"] Sep 10 02:55:40.124798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.124780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:40.170630 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.170593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.170803 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.170645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffsfd\" (UniqueName: \"kubernetes.io/projected/1f84da90-7324-43ff-9da9-fa5f396a95fd-kube-api-access-ffsfd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.170803 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.170692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.170803 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.170728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.170803 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.170756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwzng\" (UniqueName: \"kubernetes.io/projected/905d47db-280f-4ce1-b790-7c53f4e921ba-kube-api-access-qwzng\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.170803 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.170790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.171468 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.171040 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.171468 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.171113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.182908 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.182853 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwzng\" (UniqueName: \"kubernetes.io/projected/905d47db-280f-4ce1-b790-7c53f4e921ba-kube-api-access-qwzng\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.214562 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.214529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:40.271866 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.271832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffsfd\" (UniqueName: \"kubernetes.io/projected/1f84da90-7324-43ff-9da9-fa5f396a95fd-kube-api-access-ffsfd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.271985 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.271903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.271985 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.271945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.272456 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.272432 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.273080 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.273025 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.282764 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.282743 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffsfd\" (UniqueName: \"kubernetes.io/projected/1f84da90-7324-43ff-9da9-fa5f396a95fd-kube-api-access-ffsfd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.325241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.325156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:40.395704 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.395680 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d"] Sep 10 02:55:40.398510 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:55:40.398475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc50ec6_83cb_4bbb_b22b_835aa4d16605.slice/crio-6abfb01d9a7b891a2b3bf59a52b5781a93e7456756a38137f5e97722a0d5a4a2 WatchSource:0}: Error finding container 6abfb01d9a7b891a2b3bf59a52b5781a93e7456756a38137f5e97722a0d5a4a2: Status 404 returned error can't find the container with id 6abfb01d9a7b891a2b3bf59a52b5781a93e7456756a38137f5e97722a0d5a4a2 Sep 10 02:55:40.419941 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.419912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:40.496579 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.496551 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq"] Sep 10 02:55:40.498078 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:55:40.498052 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fafae0_91f3_4ae0_95ca_f14ad6bef136.slice/crio-4643e21c3da6783fd33f187ea76002bec7f3750836daaea1373fd3b56ae7728d WatchSource:0}: Error finding container 4643e21c3da6783fd33f187ea76002bec7f3750836daaea1373fd3b56ae7728d: Status 404 returned error can't find the container with id 4643e21c3da6783fd33f187ea76002bec7f3750836daaea1373fd3b56ae7728d Sep 10 02:55:40.599247 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.599191 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng"] Sep 10 02:55:40.602432 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:55:40.602407 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905d47db_280f_4ce1_b790_7c53f4e921ba.slice/crio-1a08c8cc8f2fd00d72643e48e8b9de12bd04531988282e728229b6850246826f WatchSource:0}: Error finding container 1a08c8cc8f2fd00d72643e48e8b9de12bd04531988282e728229b6850246826f: Status 404 returned error can't find the container with id 1a08c8cc8f2fd00d72643e48e8b9de12bd04531988282e728229b6850246826f Sep 10 02:55:40.692672 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.692643 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l"] Sep 10 02:55:40.701191 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:55:40.701159 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f84da90_7324_43ff_9da9_fa5f396a95fd.slice/crio-74b7c9ff3f14abdbcab2d06c14c3f9eb7c887d2f2ffc40aaa8ce5c7ba9153f67 WatchSource:0}: Error finding container 74b7c9ff3f14abdbcab2d06c14c3f9eb7c887d2f2ffc40aaa8ce5c7ba9153f67: Status 404 returned error can't find the container with id 74b7c9ff3f14abdbcab2d06c14c3f9eb7c887d2f2ffc40aaa8ce5c7ba9153f67 Sep 10 02:55:40.933172 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.933084 2578 generic.go:356] "Generic (PLEG): container finished" podID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerID="5fe147a0b71cd12335589bcdab2643fb54e624e9d48c815a21e54b8f5a651583" exitCode=0 Sep 10 02:55:40.933593 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.933172 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" event={"ID":"8cc50ec6-83cb-4bbb-b22b-835aa4d16605","Type":"ContainerDied","Data":"5fe147a0b71cd12335589bcdab2643fb54e624e9d48c815a21e54b8f5a651583"} Sep 10 02:55:40.933593 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.933252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" event={"ID":"8cc50ec6-83cb-4bbb-b22b-835aa4d16605","Type":"ContainerStarted","Data":"6abfb01d9a7b891a2b3bf59a52b5781a93e7456756a38137f5e97722a0d5a4a2"} Sep 10 02:55:40.934829 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.934811 2578 generic.go:356] "Generic (PLEG): container finished" podID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerID="0e49b8fd2ba4d8d276a68ff556b265904544382b0288a48af31253a239665494" exitCode=0 Sep 10 02:55:40.934909 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.934863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" event={"ID":"905d47db-280f-4ce1-b790-7c53f4e921ba","Type":"ContainerDied","Data":"0e49b8fd2ba4d8d276a68ff556b265904544382b0288a48af31253a239665494"} Sep 10 02:55:40.934953 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.934914 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" event={"ID":"905d47db-280f-4ce1-b790-7c53f4e921ba","Type":"ContainerStarted","Data":"1a08c8cc8f2fd00d72643e48e8b9de12bd04531988282e728229b6850246826f"} Sep 10 02:55:40.936988 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.936965 2578 generic.go:356] "Generic (PLEG): container finished" podID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerID="2a8b3a4b6df275cb45df13806d844146efaaffae753b688e5cbc867064ef2bf9" exitCode=0 Sep 10 02:55:40.937099 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.937053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" event={"ID":"1f84da90-7324-43ff-9da9-fa5f396a95fd","Type":"ContainerDied","Data":"2a8b3a4b6df275cb45df13806d844146efaaffae753b688e5cbc867064ef2bf9"} Sep 10 02:55:40.937168 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.937102 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" event={"ID":"1f84da90-7324-43ff-9da9-fa5f396a95fd","Type":"ContainerStarted","Data":"74b7c9ff3f14abdbcab2d06c14c3f9eb7c887d2f2ffc40aaa8ce5c7ba9153f67"} Sep 10 02:55:40.938773 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.938754 2578 generic.go:356] "Generic (PLEG): container finished" podID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerID="f5f8ada77481dea50ae83fbd4588e7ab0eca956181f80fdda55ea6e7bb3d2304" exitCode=0 Sep 10 02:55:40.938845 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.938779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" event={"ID":"16fafae0-91f3-4ae0-95ca-f14ad6bef136","Type":"ContainerDied","Data":"f5f8ada77481dea50ae83fbd4588e7ab0eca956181f80fdda55ea6e7bb3d2304"} Sep 10 02:55:40.938845 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:40.938801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" event={"ID":"16fafae0-91f3-4ae0-95ca-f14ad6bef136","Type":"ContainerStarted","Data":"4643e21c3da6783fd33f187ea76002bec7f3750836daaea1373fd3b56ae7728d"} Sep 10 02:55:42.950663 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.950622 2578 generic.go:356] "Generic (PLEG): container finished" podID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerID="1a98f13c8f8bbd5afaba5be611956bf897944502179861511d2748522efba7bc" exitCode=0 Sep 10 02:55:42.951065 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.950712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" event={"ID":"905d47db-280f-4ce1-b790-7c53f4e921ba","Type":"ContainerDied","Data":"1a98f13c8f8bbd5afaba5be611956bf897944502179861511d2748522efba7bc"} Sep 10 02:55:42.952709 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.952685 2578 generic.go:356] "Generic (PLEG): container finished" podID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerID="7025e3b5a6a41be0c3e48e7508fbe633c10b083bb0b16d615e3093c6c15411f5" exitCode=0 Sep 10 02:55:42.952807 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.952770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" event={"ID":"1f84da90-7324-43ff-9da9-fa5f396a95fd","Type":"ContainerDied","Data":"7025e3b5a6a41be0c3e48e7508fbe633c10b083bb0b16d615e3093c6c15411f5"} Sep 10 02:55:42.954675 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.954654 2578 generic.go:356] "Generic (PLEG): container finished" podID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerID="7305c84d6e618aa1ed091c3684cf63b98925b7318b49c166dc1a285e3c80206e" exitCode=0 Sep 10 02:55:42.954779 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.954738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" event={"ID":"16fafae0-91f3-4ae0-95ca-f14ad6bef136","Type":"ContainerDied","Data":"7305c84d6e618aa1ed091c3684cf63b98925b7318b49c166dc1a285e3c80206e"} Sep 10 02:55:42.956692 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.956669 2578 generic.go:356] "Generic (PLEG): container finished" podID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerID="e60ec176a797ed9b9721a92fd8ecb7ae42cc5895d8e2922893cb4fba48ef5e29" exitCode=0 Sep 10 02:55:42.956768 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:42.956751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" event={"ID":"8cc50ec6-83cb-4bbb-b22b-835aa4d16605","Type":"ContainerDied","Data":"e60ec176a797ed9b9721a92fd8ecb7ae42cc5895d8e2922893cb4fba48ef5e29"} Sep 10 02:55:43.963731 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.963692 2578 generic.go:356] "Generic (PLEG): container finished" podID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerID="a0c10270f424bf0dc798a44a73ea6875612131a60eb4708f5cff5cf797483971" exitCode=0 Sep 10 02:55:43.964158 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.963770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" event={"ID":"1f84da90-7324-43ff-9da9-fa5f396a95fd","Type":"ContainerDied","Data":"a0c10270f424bf0dc798a44a73ea6875612131a60eb4708f5cff5cf797483971"} Sep 10 02:55:43.969431 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.969401 2578 generic.go:356] "Generic (PLEG): container finished" podID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerID="f6fb5674d606f2ee8694cafa5c3a323ab199d95ec1ec53221d3a5f9d4ff79fbc" exitCode=0 Sep 10 02:55:43.969566 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.969434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" event={"ID":"16fafae0-91f3-4ae0-95ca-f14ad6bef136","Type":"ContainerDied","Data":"f6fb5674d606f2ee8694cafa5c3a323ab199d95ec1ec53221d3a5f9d4ff79fbc"} Sep 10 02:55:43.971546 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.971526 2578 generic.go:356] "Generic (PLEG): container finished" podID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerID="e8b9f2f8a4ef1fad0470f86c3e6b8aa8a18019873919c9a919887b4d4bdac4f0" exitCode=0 Sep 10 02:55:43.971636 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.971612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" event={"ID":"8cc50ec6-83cb-4bbb-b22b-835aa4d16605","Type":"ContainerDied","Data":"e8b9f2f8a4ef1fad0470f86c3e6b8aa8a18019873919c9a919887b4d4bdac4f0"} Sep 10 02:55:43.973616 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.973596 2578 generic.go:356] "Generic (PLEG): container finished" podID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerID="2c585a9c0d1a2416f468581610b36bdb0662dbad7e9305deca2688c94d9a0cf7" exitCode=0 Sep 10 02:55:43.973701 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:43.973635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" event={"ID":"905d47db-280f-4ce1-b790-7c53f4e921ba","Type":"ContainerDied","Data":"2c585a9c0d1a2416f468581610b36bdb0662dbad7e9305deca2688c94d9a0cf7"} Sep 10 02:55:45.112906 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.112876 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:45.157857 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.157832 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:45.202982 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.202953 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:45.204928 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.204911 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:45.215199 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215176 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-bundle\") pod \"905d47db-280f-4ce1-b790-7c53f4e921ba\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " Sep 10 02:55:45.215338 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215267 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-bundle\") pod \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " Sep 10 02:55:45.215338 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215328 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg67v\" (UniqueName: \"kubernetes.io/projected/16fafae0-91f3-4ae0-95ca-f14ad6bef136-kube-api-access-sg67v\") pod \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " Sep 10 02:55:45.215446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215358 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-util\") pod \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\" (UID: \"16fafae0-91f3-4ae0-95ca-f14ad6bef136\") " Sep 10 02:55:45.215446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215413 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwzng\" (UniqueName: \"kubernetes.io/projected/905d47db-280f-4ce1-b790-7c53f4e921ba-kube-api-access-qwzng\") pod \"905d47db-280f-4ce1-b790-7c53f4e921ba\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " Sep 10 02:55:45.215446 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215439 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-util\") pod \"905d47db-280f-4ce1-b790-7c53f4e921ba\" (UID: \"905d47db-280f-4ce1-b790-7c53f4e921ba\") " Sep 10 02:55:45.215856 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215825 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-bundle" (OuterVolumeSpecName: "bundle") pod "905d47db-280f-4ce1-b790-7c53f4e921ba" (UID: "905d47db-280f-4ce1-b790-7c53f4e921ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.215856 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.215842 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-bundle" (OuterVolumeSpecName: "bundle") pod "16fafae0-91f3-4ae0-95ca-f14ad6bef136" (UID: "16fafae0-91f3-4ae0-95ca-f14ad6bef136"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.217581 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.217549 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16fafae0-91f3-4ae0-95ca-f14ad6bef136-kube-api-access-sg67v" (OuterVolumeSpecName: "kube-api-access-sg67v") pod "16fafae0-91f3-4ae0-95ca-f14ad6bef136" (UID: "16fafae0-91f3-4ae0-95ca-f14ad6bef136"). InnerVolumeSpecName "kube-api-access-sg67v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:55:45.218005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.217982 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905d47db-280f-4ce1-b790-7c53f4e921ba-kube-api-access-qwzng" (OuterVolumeSpecName: "kube-api-access-qwzng") pod "905d47db-280f-4ce1-b790-7c53f4e921ba" (UID: "905d47db-280f-4ce1-b790-7c53f4e921ba"). InnerVolumeSpecName "kube-api-access-qwzng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:55:45.222114 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.222089 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-util" (OuterVolumeSpecName: "util") pod "16fafae0-91f3-4ae0-95ca-f14ad6bef136" (UID: "16fafae0-91f3-4ae0-95ca-f14ad6bef136"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.223177 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.223152 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-util" (OuterVolumeSpecName: "util") pod "905d47db-280f-4ce1-b790-7c53f4e921ba" (UID: "905d47db-280f-4ce1-b790-7c53f4e921ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.316529 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316494 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-bundle\") pod \"1f84da90-7324-43ff-9da9-fa5f396a95fd\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " Sep 10 02:55:45.316686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316544 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-util\") pod \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " Sep 10 02:55:45.316686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316574 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffsfd\" (UniqueName: \"kubernetes.io/projected/1f84da90-7324-43ff-9da9-fa5f396a95fd-kube-api-access-ffsfd\") pod \"1f84da90-7324-43ff-9da9-fa5f396a95fd\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " Sep 10 02:55:45.316686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316602 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-bundle\") pod \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " Sep 10 02:55:45.316686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316620 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dkbm\" (UniqueName: \"kubernetes.io/projected/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-kube-api-access-8dkbm\") pod \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\" (UID: \"8cc50ec6-83cb-4bbb-b22b-835aa4d16605\") " Sep 10 02:55:45.316686 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316660 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-util\") pod \"1f84da90-7324-43ff-9da9-fa5f396a95fd\" (UID: \"1f84da90-7324-43ff-9da9-fa5f396a95fd\") " Sep 10 02:55:45.316956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316894 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwzng\" (UniqueName: \"kubernetes.io/projected/905d47db-280f-4ce1-b790-7c53f4e921ba-kube-api-access-qwzng\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.316956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316912 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.316956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316927 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/905d47db-280f-4ce1-b790-7c53f4e921ba-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.316956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316939 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.316956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316952 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg67v\" (UniqueName: \"kubernetes.io/projected/16fafae0-91f3-4ae0-95ca-f14ad6bef136-kube-api-access-sg67v\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.317192 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.316964 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16fafae0-91f3-4ae0-95ca-f14ad6bef136-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.317272 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.317187 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-bundle" (OuterVolumeSpecName: "bundle") pod "8cc50ec6-83cb-4bbb-b22b-835aa4d16605" (UID: "8cc50ec6-83cb-4bbb-b22b-835aa4d16605"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.317619 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.317593 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-bundle" (OuterVolumeSpecName: "bundle") pod "1f84da90-7324-43ff-9da9-fa5f396a95fd" (UID: "1f84da90-7324-43ff-9da9-fa5f396a95fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.319368 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.319344 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-kube-api-access-8dkbm" (OuterVolumeSpecName: "kube-api-access-8dkbm") pod "8cc50ec6-83cb-4bbb-b22b-835aa4d16605" (UID: "8cc50ec6-83cb-4bbb-b22b-835aa4d16605"). InnerVolumeSpecName "kube-api-access-8dkbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:55:45.319433 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.319371 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f84da90-7324-43ff-9da9-fa5f396a95fd-kube-api-access-ffsfd" (OuterVolumeSpecName: "kube-api-access-ffsfd") pod "1f84da90-7324-43ff-9da9-fa5f396a95fd" (UID: "1f84da90-7324-43ff-9da9-fa5f396a95fd"). InnerVolumeSpecName "kube-api-access-ffsfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:55:45.321930 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.321898 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-util" (OuterVolumeSpecName: "util") pod "1f84da90-7324-43ff-9da9-fa5f396a95fd" (UID: "1f84da90-7324-43ff-9da9-fa5f396a95fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.322779 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.322760 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-util" (OuterVolumeSpecName: "util") pod "8cc50ec6-83cb-4bbb-b22b-835aa4d16605" (UID: "8cc50ec6-83cb-4bbb-b22b-835aa4d16605"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:55:45.418345 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.418314 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dkbm\" (UniqueName: \"kubernetes.io/projected/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-kube-api-access-8dkbm\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.418527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.418355 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.418527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.418366 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f84da90-7324-43ff-9da9-fa5f396a95fd-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.418527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.418374 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.418527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.418382 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffsfd\" (UniqueName: \"kubernetes.io/projected/1f84da90-7324-43ff-9da9-fa5f396a95fd-kube-api-access-ffsfd\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.418527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.418391 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cc50ec6-83cb-4bbb-b22b-835aa4d16605-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:55:45.985258 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.985218 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" Sep 10 02:55:45.985440 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.985217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asp95l" event={"ID":"1f84da90-7324-43ff-9da9-fa5f396a95fd","Type":"ContainerDied","Data":"74b7c9ff3f14abdbcab2d06c14c3f9eb7c887d2f2ffc40aaa8ce5c7ba9153f67"} Sep 10 02:55:45.985440 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.985385 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74b7c9ff3f14abdbcab2d06c14c3f9eb7c887d2f2ffc40aaa8ce5c7ba9153f67" Sep 10 02:55:45.987278 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.987248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" event={"ID":"16fafae0-91f3-4ae0-95ca-f14ad6bef136","Type":"ContainerDied","Data":"4643e21c3da6783fd33f187ea76002bec7f3750836daaea1373fd3b56ae7728d"} Sep 10 02:55:45.987396 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.987297 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4643e21c3da6783fd33f187ea76002bec7f3750836daaea1373fd3b56ae7728d" Sep 10 02:55:45.987396 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.987258 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nr9lq" Sep 10 02:55:45.989316 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.989297 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" Sep 10 02:55:45.989418 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.989333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c59t2d" event={"ID":"8cc50ec6-83cb-4bbb-b22b-835aa4d16605","Type":"ContainerDied","Data":"6abfb01d9a7b891a2b3bf59a52b5781a93e7456756a38137f5e97722a0d5a4a2"} Sep 10 02:55:45.989418 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.989368 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6abfb01d9a7b891a2b3bf59a52b5781a93e7456756a38137f5e97722a0d5a4a2" Sep 10 02:55:45.991322 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.991298 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" event={"ID":"905d47db-280f-4ce1-b790-7c53f4e921ba","Type":"ContainerDied","Data":"1a08c8cc8f2fd00d72643e48e8b9de12bd04531988282e728229b6850246826f"} Sep 10 02:55:45.991410 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.991332 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rng" Sep 10 02:55:45.991410 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:45.991340 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a08c8cc8f2fd00d72643e48e8b9de12bd04531988282e728229b6850246826f" Sep 10 02:55:49.664980 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:49.664946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:50.457255 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:50.457202 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:51.258808 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.258776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:51.543512 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543484 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6866fbddf8-mgbfb"] Sep 10 02:55:51.543812 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543800 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="pull" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543815 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="pull" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543825 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="pull" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543831 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="pull" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543840 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="extract" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543846 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="extract" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543853 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="util" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543859 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="util" Sep 10 02:55:51.543868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543871 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="util" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543876 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="util" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543885 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="pull" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543890 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="pull" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543898 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543903 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543912 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="util" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543916 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="util" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543921 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543927 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543934 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543939 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543951 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="util" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543955 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="util" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543961 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="pull" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.543966 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="pull" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.544014 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="16fafae0-91f3-4ae0-95ca-f14ad6bef136" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.544021 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f84da90-7324-43ff-9da9-fa5f396a95fd" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.544028 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="905d47db-280f-4ce1-b790-7c53f4e921ba" containerName="extract" Sep 10 02:55:51.544093 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.544034 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cc50ec6-83cb-4bbb-b22b-835aa4d16605" containerName="extract" Sep 10 02:55:51.548064 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.548041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.571676 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.571650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6866fbddf8-mgbfb"] Sep 10 02:55:51.630570 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.630533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:51.669822 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.669787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-service-ca\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.669978 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.669836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drp7\" (UniqueName: \"kubernetes.io/projected/8e0a5294-df0f-4ea7-8d9d-e6add0289309-kube-api-access-7drp7\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.669978 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.669926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-trusted-ca-bundle\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.670057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.669978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-oauth-config\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.670057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.669997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-serving-cert\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.670057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.670011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-config\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.670057 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.670048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-oauth-serving-cert\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.724693 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.724657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:51.771378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-serving-cert\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.771378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-config\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.771570 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-oauth-serving-cert\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.771570 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-service-ca\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.771798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drp7\" (UniqueName: \"kubernetes.io/projected/8e0a5294-df0f-4ea7-8d9d-e6add0289309-kube-api-access-7drp7\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.771798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-trusted-ca-bundle\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.771798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.771715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-oauth-config\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.772246 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.772204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-oauth-serving-cert\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.772356 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.772259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-config\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.772442 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.772417 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-service-ca\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.772709 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.772685 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e0a5294-df0f-4ea7-8d9d-e6add0289309-trusted-ca-bundle\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.774005 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.773987 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-serving-cert\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.774123 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.774097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e0a5294-df0f-4ea7-8d9d-e6add0289309-console-oauth-config\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.786908 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.786888 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drp7\" (UniqueName: \"kubernetes.io/projected/8e0a5294-df0f-4ea7-8d9d-e6add0289309-kube-api-access-7drp7\") pod \"console-6866fbddf8-mgbfb\" (UID: \"8e0a5294-df0f-4ea7-8d9d-e6add0289309\") " pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:51.857623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:51.857545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:55:52.135201 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:52.135177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6866fbddf8-mgbfb"] Sep 10 02:55:52.136803 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:55:52.136781 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0a5294_df0f_4ea7_8d9d_e6add0289309.slice/crio-bcfd47c18e09d34ad4cd29ef89f20e5f0498d1b7f338a53c448679270a34ea0c WatchSource:0}: Error finding container bcfd47c18e09d34ad4cd29ef89f20e5f0498d1b7f338a53c448679270a34ea0c: Status 404 returned error can't find the container with id bcfd47c18e09d34ad4cd29ef89f20e5f0498d1b7f338a53c448679270a34ea0c Sep 10 02:55:53.027935 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:53.027898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6866fbddf8-mgbfb" event={"ID":"8e0a5294-df0f-4ea7-8d9d-e6add0289309","Type":"ContainerStarted","Data":"cab50e1b9b2bab3d3d51b02ab3aa5c165cd855df12970bc0c98d65dafc7064ef"} Sep 10 02:55:53.028413 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:53.027946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6866fbddf8-mgbfb" event={"ID":"8e0a5294-df0f-4ea7-8d9d-e6add0289309","Type":"ContainerStarted","Data":"bcfd47c18e09d34ad4cd29ef89f20e5f0498d1b7f338a53c448679270a34ea0c"} Sep 10 02:55:53.046887 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:53.046839 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6866fbddf8-mgbfb" podStartSLOduration=2.046824647 podStartE2EDuration="2.046824647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:55:53.045016304 +0000 UTC m=+397.531011603" watchObservedRunningTime="2026-09-10 02:55:53.046824647 +0000 UTC m=+397.532819914" Sep 10 02:55:53.506131 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:53.506096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:53.606895 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:53.606866 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:54.890240 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:54.890190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:56.708898 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:56.708853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:56.897677 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:56.897649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:58.679549 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:58.679514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:58.903034 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:58.902996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:59.140499 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:59.140468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:55:59.240438 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:55:59.240405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:00.444480 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:00.444446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:01.857976 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:01.857929 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:56:01.858468 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:01.857999 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:56:01.863283 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:01.863255 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:56:02.085841 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.085810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6866fbddf8-mgbfb" Sep 10 02:56:02.139752 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.139650 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558c774858-n7gb2"] Sep 10 02:56:02.164009 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.163973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:02.263547 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.263511 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:02.394663 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.394568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:02.505513 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.505468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:02.595442 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:02.595402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:04.664934 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:04.664902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:04.765648 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:04.765615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:05.064019 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:05.063958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:05.164527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:05.164488 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:05.478932 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:05.478851 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:05.545214 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:05.545179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:11.710860 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:11.710818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:11.809974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:11.809931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:12.356962 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.356927 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6"] Sep 10 02:56:12.360606 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.360580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:12.363327 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.363300 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 02:56:12.363327 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.363318 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 02:56:12.363508 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.363310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-96cq5\"" Sep 10 02:56:12.375389 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.375366 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6"] Sep 10 02:56:12.418207 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.418173 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6"] Sep 10 02:56:12.418801 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:12.418767 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rjgnh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" podUID="99122d4c-bcf1-4586-9662-725e5a5f22c6" Sep 10 02:56:12.428123 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.428100 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6"] Sep 10 02:56:12.441723 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.441696 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2"] Sep 10 02:56:12.445024 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.445002 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.456468 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.456443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjgnh\" (UniqueName: \"kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:12.456576 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.456502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99122d4c-bcf1-4586-9662-725e5a5f22c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:12.468872 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.468846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2"] Sep 10 02:56:12.557740 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.557704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c441afa2-f528-4181-acf8-b1b3ddf0ee64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6pvq2\" (UID: \"c441afa2-f528-4181-acf8-b1b3ddf0ee64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.557916 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.557753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99122d4c-bcf1-4586-9662-725e5a5f22c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:12.557916 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.557843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7d69\" (UniqueName: \"kubernetes.io/projected/c441afa2-f528-4181-acf8-b1b3ddf0ee64-kube-api-access-p7d69\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6pvq2\" (UID: \"c441afa2-f528-4181-acf8-b1b3ddf0ee64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.557916 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.557874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjgnh\" (UniqueName: \"kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:12.558140 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.558120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99122d4c-bcf1-4586-9662-725e5a5f22c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:12.562658 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:12.562636 2578 projected.go:196] Error preparing data for projected volume kube-api-access-rjgnh for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-wdkc6" not found Sep 10 02:56:12.562758 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:12.562694 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh podName:99122d4c-bcf1-4586-9662-725e5a5f22c6 nodeName:}" failed. No retries permitted until 2026-09-10 02:56:13.062679544 +0000 UTC m=+417.548674796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rjgnh" (UniqueName: "kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh") pod "kuadrant-operator-controller-manager-5769f99d9f-wdkc6" (UID: "99122d4c-bcf1-4586-9662-725e5a5f22c6") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-wdkc6" not found Sep 10 02:56:12.658537 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.658457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7d69\" (UniqueName: \"kubernetes.io/projected/c441afa2-f528-4181-acf8-b1b3ddf0ee64-kube-api-access-p7d69\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6pvq2\" (UID: \"c441afa2-f528-4181-acf8-b1b3ddf0ee64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.658670 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.658557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c441afa2-f528-4181-acf8-b1b3ddf0ee64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6pvq2\" (UID: \"c441afa2-f528-4181-acf8-b1b3ddf0ee64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.658947 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.658928 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c441afa2-f528-4181-acf8-b1b3ddf0ee64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6pvq2\" (UID: \"c441afa2-f528-4181-acf8-b1b3ddf0ee64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.678249 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.678200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7d69\" (UniqueName: \"kubernetes.io/projected/c441afa2-f528-4181-acf8-b1b3ddf0ee64-kube-api-access-p7d69\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6pvq2\" (UID: \"c441afa2-f528-4181-acf8-b1b3ddf0ee64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:12.754798 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:12.754763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:13.028202 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.028178 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2"] Sep 10 02:56:13.030809 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:56:13.030779 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc441afa2_f528_4181_acf8_b1b3ddf0ee64.slice/crio-271e7a0dd5bcd99b51ef32fde6b885508522cee448fec9f5f029a75bcb63dc13 WatchSource:0}: Error finding container 271e7a0dd5bcd99b51ef32fde6b885508522cee448fec9f5f029a75bcb63dc13: Status 404 returned error can't find the container with id 271e7a0dd5bcd99b51ef32fde6b885508522cee448fec9f5f029a75bcb63dc13 Sep 10 02:56:13.138402 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.138376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:13.138402 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.138389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" event={"ID":"c441afa2-f528-4181-acf8-b1b3ddf0ee64","Type":"ContainerStarted","Data":"271e7a0dd5bcd99b51ef32fde6b885508522cee448fec9f5f029a75bcb63dc13"} Sep 10 02:56:13.141280 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:13.141253 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" is forbidden: User \"system:node:ip-10-0-134-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-49.ec2.internal' and this object" podUID="99122d4c-bcf1-4586-9662-725e5a5f22c6" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:13.146310 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.146290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:13.150128 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:13.150106 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" is forbidden: User \"system:node:ip-10-0-134-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-49.ec2.internal' and this object" podUID="99122d4c-bcf1-4586-9662-725e5a5f22c6" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:13.162498 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.162477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjgnh\" (UniqueName: \"kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:13.166043 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:13.166027 2578 projected.go:196] Error preparing data for projected volume kube-api-access-rjgnh for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-wdkc6" not found Sep 10 02:56:13.166100 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:13.166091 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh podName:99122d4c-bcf1-4586-9662-725e5a5f22c6 nodeName:}" failed. No retries permitted until 2026-09-10 02:56:14.166076353 +0000 UTC m=+418.652071605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjgnh" (UniqueName: "kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh") pod "kuadrant-operator-controller-manager-5769f99d9f-wdkc6" (UID: "99122d4c-bcf1-4586-9662-725e5a5f22c6") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-wdkc6" not found Sep 10 02:56:13.263810 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.263777 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99122d4c-bcf1-4586-9662-725e5a5f22c6-extensions-socket-volume\") pod \"99122d4c-bcf1-4586-9662-725e5a5f22c6\" (UID: \"99122d4c-bcf1-4586-9662-725e5a5f22c6\") " Sep 10 02:56:13.264000 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.263984 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjgnh\" (UniqueName: \"kubernetes.io/projected/99122d4c-bcf1-4586-9662-725e5a5f22c6-kube-api-access-rjgnh\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:13.264078 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.264062 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99122d4c-bcf1-4586-9662-725e5a5f22c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99122d4c-bcf1-4586-9662-725e5a5f22c6" (UID: "99122d4c-bcf1-4586-9662-725e5a5f22c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:56:13.364805 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:13.364771 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99122d4c-bcf1-4586-9662-725e5a5f22c6-extensions-socket-volume\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:14.043715 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:14.043669 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99122d4c-bcf1-4586-9662-725e5a5f22c6" path="/var/lib/kubelet/pods/99122d4c-bcf1-4586-9662-725e5a5f22c6/volumes" Sep 10 02:56:14.145985 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:14.145942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:14.150927 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:14.150829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:14.151085 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:14.151003 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" is forbidden: User \"system:node:ip-10-0-134-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-49.ec2.internal' and this object" podUID="99122d4c-bcf1-4586-9662-725e5a5f22c6" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:14.256732 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:14.256700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:16.046050 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:16.045996 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-wdkc6\" is forbidden: User \"system:node:ip-10-0-134-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-49.ec2.internal' and this object" podUID="99122d4c-bcf1-4586-9662-725e5a5f22c6" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wdkc6" Sep 10 02:56:17.164408 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:17.164325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" event={"ID":"c441afa2-f528-4181-acf8-b1b3ddf0ee64","Type":"ContainerStarted","Data":"9862caf3960ff2a057c865b07bde464a34ed10dedb6f093e87a63db27a5cacb3"} Sep 10 02:56:17.164747 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:17.164467 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:17.184828 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:17.184773 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" podStartSLOduration=1.396984298 podStartE2EDuration="5.184754985s" totalImagesPullingTime="3.787770687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:17.183083764 +0000 UTC m=+421.669079057" watchObservedRunningTime="2026-09-10 02:56:17.184754985 +0000 UTC m=+421.670750260" Sep 10 02:56:20.684349 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:20.684311 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:20.784123 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:20.784085 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:25.878772 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:25.878732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:25.979181 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:25.979146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:26.285998 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:26.285961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:26.346101 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:26.346053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:26.486938 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:26.486902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:26.545602 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:26.545481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:27.164006 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.163971 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-558c774858-n7gb2" podUID="6a107aad-f13f-4526-97f6-6c52e183d8bf" containerName="console" containerID="cri-o://dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779" gracePeriod=15 Sep 10 02:56:27.405622 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.405594 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:56:27.479870 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.479795 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-trusted-ca-bundle\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480036 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.479869 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-config\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480036 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.479906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd4r2\" (UniqueName: \"kubernetes.io/projected/6a107aad-f13f-4526-97f6-6c52e183d8bf-kube-api-access-rd4r2\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480036 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.479934 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-oauth-config\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480036 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.479972 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-serving-cert\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480036 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.480008 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-service-ca\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.480039 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-oauth-serving-cert\") pod \"6a107aad-f13f-4526-97f6-6c52e183d8bf\" (UID: \"6a107aad-f13f-4526-97f6-6c52e183d8bf\") " Sep 10 02:56:27.480396 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.480295 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:56:27.480453 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.480407 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-config" (OuterVolumeSpecName: "console-config") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:56:27.480453 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.480438 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:56:27.480698 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.480663 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:56:27.482345 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.482321 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:56:27.482449 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.482365 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a107aad-f13f-4526-97f6-6c52e183d8bf-kube-api-access-rd4r2" (OuterVolumeSpecName: "kube-api-access-rd4r2") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "kube-api-access-rd4r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:56:27.482449 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.482389 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a107aad-f13f-4526-97f6-6c52e183d8bf" (UID: "6a107aad-f13f-4526-97f6-6c52e183d8bf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:56:27.581673 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581629 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:27.581673 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581664 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-service-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:27.581673 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581677 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-oauth-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:27.581900 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581689 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-trusted-ca-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:27.581900 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581701 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:27.581900 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581712 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd4r2\" (UniqueName: \"kubernetes.io/projected/6a107aad-f13f-4526-97f6-6c52e183d8bf-kube-api-access-rd4r2\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:27.581900 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:27.581722 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a107aad-f13f-4526-97f6-6c52e183d8bf-console-oauth-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:28.172199 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.172166 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6pvq2" Sep 10 02:56:28.230153 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.230122 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a107aad-f13f-4526-97f6-6c52e183d8bf" containerID="dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779" exitCode=0 Sep 10 02:56:28.230339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.230154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c774858-n7gb2" event={"ID":"6a107aad-f13f-4526-97f6-6c52e183d8bf","Type":"ContainerDied","Data":"dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779"} Sep 10 02:56:28.230339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.230206 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558c774858-n7gb2" event={"ID":"6a107aad-f13f-4526-97f6-6c52e183d8bf","Type":"ContainerDied","Data":"d749e23325fefd078e9aa085d0a10ce4844205ee141051e016f78856fd7c27a8"} Sep 10 02:56:28.230339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.230210 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558c774858-n7gb2" Sep 10 02:56:28.230339 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.230254 2578 scope.go:117] "RemoveContainer" containerID="dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779" Sep 10 02:56:28.239776 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.239754 2578 scope.go:117] "RemoveContainer" containerID="dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779" Sep 10 02:56:28.240102 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:28.240077 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779\": container with ID starting with dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779 not found: ID does not exist" containerID="dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779" Sep 10 02:56:28.240211 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.240115 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779"} err="failed to get container status \"dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779\": rpc error: code = NotFound desc = could not find container \"dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779\": container with ID starting with dd7a241d4ac681c6a7ba38c51c0fabd1f94b6caa9dbd9bab0e3657307f3fb779 not found: ID does not exist" Sep 10 02:56:28.253167 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.253139 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558c774858-n7gb2"] Sep 10 02:56:28.263543 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:28.263518 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-558c774858-n7gb2"] Sep 10 02:56:30.041946 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:30.041917 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a107aad-f13f-4526-97f6-6c52e183d8bf" path="/var/lib/kubelet/pods/6a107aad-f13f-4526-97f6-6c52e183d8bf/volumes" Sep 10 02:56:33.491078 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:33.491038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:33.601762 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:33.601724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:35.945542 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:35.945503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:36.048020 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:36.047988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:42.491029 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:42.490912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:42.590453 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:42.590396 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:44.561944 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:44.561908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:44.866540 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:44.866443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:49.507129 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:49.506557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:49.619210 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:49.619165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:49.718474 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:49.718440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:50.419769 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.419734 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2m6nw"] Sep 10 02:56:50.420079 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.420067 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a107aad-f13f-4526-97f6-6c52e183d8bf" containerName="console" Sep 10 02:56:50.420129 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.420081 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a107aad-f13f-4526-97f6-6c52e183d8bf" containerName="console" Sep 10 02:56:50.420164 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.420140 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a107aad-f13f-4526-97f6-6c52e183d8bf" containerName="console" Sep 10 02:56:50.423782 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.423761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:50.426300 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.426275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v9vxt\"" Sep 10 02:56:50.427537 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.427517 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2m6nw"] Sep 10 02:56:50.456236 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.456195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:50.556799 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.556765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:56:50.578364 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.578337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfmf\" (UniqueName: \"kubernetes.io/projected/14942703-e2af-4a5c-b002-90b9b5b59fb1-kube-api-access-qvfmf\") pod \"authorino-7bcfd8f9cd-2m6nw\" (UID: \"14942703-e2af-4a5c-b002-90b9b5b59fb1\") " pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:50.679757 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.679661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfmf\" (UniqueName: \"kubernetes.io/projected/14942703-e2af-4a5c-b002-90b9b5b59fb1-kube-api-access-qvfmf\") pod \"authorino-7bcfd8f9cd-2m6nw\" (UID: \"14942703-e2af-4a5c-b002-90b9b5b59fb1\") " pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:50.688812 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.688786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfmf\" (UniqueName: \"kubernetes.io/projected/14942703-e2af-4a5c-b002-90b9b5b59fb1-kube-api-access-qvfmf\") pod \"authorino-7bcfd8f9cd-2m6nw\" (UID: \"14942703-e2af-4a5c-b002-90b9b5b59fb1\") " pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:50.733720 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:50.733662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:51.002134 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:51.002110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2m6nw"] Sep 10 02:56:51.004077 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:56:51.004048 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14942703_e2af_4a5c_b002_90b9b5b59fb1.slice/crio-6c3bfff438c02f15b0b2028c9a60ff9200f6501360561773c2cc6520edf45a12 WatchSource:0}: Error finding container 6c3bfff438c02f15b0b2028c9a60ff9200f6501360561773c2cc6520edf45a12: Status 404 returned error can't find the container with id 6c3bfff438c02f15b0b2028c9a60ff9200f6501360561773c2cc6520edf45a12 Sep 10 02:56:51.347364 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:51.347330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" event={"ID":"14942703-e2af-4a5c-b002-90b9b5b59fb1","Type":"ContainerStarted","Data":"6c3bfff438c02f15b0b2028c9a60ff9200f6501360561773c2cc6520edf45a12"} Sep 10 02:56:53.359139 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:53.359104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" event={"ID":"14942703-e2af-4a5c-b002-90b9b5b59fb1","Type":"ContainerStarted","Data":"318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af"} Sep 10 02:56:53.376416 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:53.376339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" podStartSLOduration=1.365056843 podStartE2EDuration="3.376315833s" totalImagesPullingTime="2.01125899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:56:53.373508806 +0000 UTC m=+457.859504081" watchObservedRunningTime="2026-09-10 02:56:53.376315833 +0000 UTC m=+457.862311109" Sep 10 02:56:53.601520 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:53.601487 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2m6nw"] Sep 10 02:56:55.369117 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:55.369077 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" podUID="14942703-e2af-4a5c-b002-90b9b5b59fb1" containerName="authorino" containerID="cri-o://318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af" gracePeriod=30 Sep 10 02:56:55.614411 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:55.614388 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:55.729621 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:55.729531 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvfmf\" (UniqueName: \"kubernetes.io/projected/14942703-e2af-4a5c-b002-90b9b5b59fb1-kube-api-access-qvfmf\") pod \"14942703-e2af-4a5c-b002-90b9b5b59fb1\" (UID: \"14942703-e2af-4a5c-b002-90b9b5b59fb1\") " Sep 10 02:56:55.731802 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:55.731780 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14942703-e2af-4a5c-b002-90b9b5b59fb1-kube-api-access-qvfmf" (OuterVolumeSpecName: "kube-api-access-qvfmf") pod "14942703-e2af-4a5c-b002-90b9b5b59fb1" (UID: "14942703-e2af-4a5c-b002-90b9b5b59fb1"). InnerVolumeSpecName "kube-api-access-qvfmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:56:55.831154 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:55.831118 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvfmf\" (UniqueName: \"kubernetes.io/projected/14942703-e2af-4a5c-b002-90b9b5b59fb1-kube-api-access-qvfmf\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:56:56.374956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.374871 2578 generic.go:356] "Generic (PLEG): container finished" podID="14942703-e2af-4a5c-b002-90b9b5b59fb1" containerID="318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af" exitCode=0 Sep 10 02:56:56.374956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.374913 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" Sep 10 02:56:56.374956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.374948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" event={"ID":"14942703-e2af-4a5c-b002-90b9b5b59fb1","Type":"ContainerDied","Data":"318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af"} Sep 10 02:56:56.375477 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.374986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-2m6nw" event={"ID":"14942703-e2af-4a5c-b002-90b9b5b59fb1","Type":"ContainerDied","Data":"6c3bfff438c02f15b0b2028c9a60ff9200f6501360561773c2cc6520edf45a12"} Sep 10 02:56:56.375477 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.375004 2578 scope.go:117] "RemoveContainer" containerID="318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af" Sep 10 02:56:56.383767 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.383748 2578 scope.go:117] "RemoveContainer" containerID="318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af" Sep 10 02:56:56.384030 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:56:56.384010 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af\": container with ID starting with 318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af not found: ID does not exist" containerID="318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af" Sep 10 02:56:56.384083 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.384039 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af"} err="failed to get container status \"318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af\": rpc error: code = NotFound desc = could not find container \"318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af\": container with ID starting with 318cb7331c03d04b9923fe13a5dbd41013cd4880650355b0d51455dbffea78af not found: ID does not exist" Sep 10 02:56:56.394309 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.394280 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2m6nw"] Sep 10 02:56:56.397714 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:56.397694 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-2m6nw"] Sep 10 02:56:58.042395 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:56:58.042358 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14942703-e2af-4a5c-b002-90b9b5b59fb1" path="/var/lib/kubelet/pods/14942703-e2af-4a5c-b002-90b9b5b59fb1/volumes" Sep 10 02:57:00.517862 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:00.517795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:05.643760 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:05.643724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:05.752690 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:05.752648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:06.102641 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:06.102605 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:18.326505 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.326449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:18.426668 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.426635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:18.562274 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.562240 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-v6dqb"] Sep 10 02:57:18.562567 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.562555 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14942703-e2af-4a5c-b002-90b9b5b59fb1" containerName="authorino" Sep 10 02:57:18.562610 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.562568 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="14942703-e2af-4a5c-b002-90b9b5b59fb1" containerName="authorino" Sep 10 02:57:18.562648 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.562629 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="14942703-e2af-4a5c-b002-90b9b5b59fb1" containerName="authorino" Sep 10 02:57:18.567045 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.567025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:18.570048 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.570022 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v9vxt\"" Sep 10 02:57:18.571525 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.571503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-v6dqb"] Sep 10 02:57:18.605378 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.605317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zfxn\" (UniqueName: \"kubernetes.io/projected/7e2c5066-a1fa-4003-be9b-988e7084c90c-kube-api-access-4zfxn\") pod \"authorino-557f876f69-v6dqb\" (UID: \"7e2c5066-a1fa-4003-be9b-988e7084c90c\") " pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:18.691985 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.691955 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-v6dqb"] Sep 10 02:57:18.692203 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:57:18.692185 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4zfxn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-v6dqb" podUID="7e2c5066-a1fa-4003-be9b-988e7084c90c" Sep 10 02:57:18.706125 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.706094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zfxn\" (UniqueName: \"kubernetes.io/projected/7e2c5066-a1fa-4003-be9b-988e7084c90c-kube-api-access-4zfxn\") pod \"authorino-557f876f69-v6dqb\" (UID: \"7e2c5066-a1fa-4003-be9b-988e7084c90c\") " pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:18.717088 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.717051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zfxn\" (UniqueName: \"kubernetes.io/projected/7e2c5066-a1fa-4003-be9b-988e7084c90c-kube-api-access-4zfxn\") pod \"authorino-557f876f69-v6dqb\" (UID: \"7e2c5066-a1fa-4003-be9b-988e7084c90c\") " pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:18.814190 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.814157 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d4644ffc5-hmf8j"] Sep 10 02:57:18.817500 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.817479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:18.819830 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.819810 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 02:57:18.824463 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.824437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4644ffc5-hmf8j"] Sep 10 02:57:18.907251 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.907142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdm5\" (UniqueName: \"kubernetes.io/projected/076d28ee-e46a-40b1-b3f9-361889cfdec5-kube-api-access-6pdm5\") pod \"authorino-7d4644ffc5-hmf8j\" (UID: \"076d28ee-e46a-40b1-b3f9-361889cfdec5\") " pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:18.907251 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:18.907185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076d28ee-e46a-40b1-b3f9-361889cfdec5-tls-cert\") pod \"authorino-7d4644ffc5-hmf8j\" (UID: \"076d28ee-e46a-40b1-b3f9-361889cfdec5\") " pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:19.008594 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.008558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdm5\" (UniqueName: \"kubernetes.io/projected/076d28ee-e46a-40b1-b3f9-361889cfdec5-kube-api-access-6pdm5\") pod \"authorino-7d4644ffc5-hmf8j\" (UID: \"076d28ee-e46a-40b1-b3f9-361889cfdec5\") " pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:19.008751 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.008598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076d28ee-e46a-40b1-b3f9-361889cfdec5-tls-cert\") pod \"authorino-7d4644ffc5-hmf8j\" (UID: \"076d28ee-e46a-40b1-b3f9-361889cfdec5\") " pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:19.011361 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.011338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076d28ee-e46a-40b1-b3f9-361889cfdec5-tls-cert\") pod \"authorino-7d4644ffc5-hmf8j\" (UID: \"076d28ee-e46a-40b1-b3f9-361889cfdec5\") " pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:19.017536 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.017506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdm5\" (UniqueName: \"kubernetes.io/projected/076d28ee-e46a-40b1-b3f9-361889cfdec5-kube-api-access-6pdm5\") pod \"authorino-7d4644ffc5-hmf8j\" (UID: \"076d28ee-e46a-40b1-b3f9-361889cfdec5\") " pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:19.127613 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.127581 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" Sep 10 02:57:19.397581 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.397546 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4644ffc5-hmf8j"] Sep 10 02:57:19.399404 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:57:19.399369 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076d28ee_e46a_40b1_b3f9_361889cfdec5.slice/crio-45d1b31b1b593e710ceef897837c70283948283a4486e070fb53d07a33264078 WatchSource:0}: Error finding container 45d1b31b1b593e710ceef897837c70283948283a4486e070fb53d07a33264078: Status 404 returned error can't find the container with id 45d1b31b1b593e710ceef897837c70283948283a4486e070fb53d07a33264078 Sep 10 02:57:19.492281 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.492177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:19.492281 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.492201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" event={"ID":"076d28ee-e46a-40b1-b3f9-361889cfdec5","Type":"ContainerStarted","Data":"45d1b31b1b593e710ceef897837c70283948283a4486e070fb53d07a33264078"} Sep 10 02:57:19.500275 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.500256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:19.613432 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.613399 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zfxn\" (UniqueName: \"kubernetes.io/projected/7e2c5066-a1fa-4003-be9b-988e7084c90c-kube-api-access-4zfxn\") pod \"7e2c5066-a1fa-4003-be9b-988e7084c90c\" (UID: \"7e2c5066-a1fa-4003-be9b-988e7084c90c\") " Sep 10 02:57:19.615526 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.615504 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e2c5066-a1fa-4003-be9b-988e7084c90c-kube-api-access-4zfxn" (OuterVolumeSpecName: "kube-api-access-4zfxn") pod "7e2c5066-a1fa-4003-be9b-988e7084c90c" (UID: "7e2c5066-a1fa-4003-be9b-988e7084c90c"). InnerVolumeSpecName "kube-api-access-4zfxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:57:19.714527 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:19.714488 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zfxn\" (UniqueName: \"kubernetes.io/projected/7e2c5066-a1fa-4003-be9b-988e7084c90c-kube-api-access-4zfxn\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\"" Sep 10 02:57:20.499001 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:20.498970 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-v6dqb" Sep 10 02:57:20.499482 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:20.499002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" event={"ID":"076d28ee-e46a-40b1-b3f9-361889cfdec5","Type":"ContainerStarted","Data":"b515da86b41dd218a532e59315d643bbdd05773b9856af96a9ebd8e2cc97ccb3"} Sep 10 02:57:20.516959 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:20.516911 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d4644ffc5-hmf8j" podStartSLOduration=1.981691318 podStartE2EDuration="2.516896658s" totalImagesPullingTime="535.20534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:57:20.515776592 +0000 UTC m=+485.001771867" watchObservedRunningTime="2026-09-10 02:57:20.516896658 +0000 UTC m=+485.002891932" Sep 10 02:57:20.538105 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:20.538075 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-v6dqb"] Sep 10 02:57:20.547367 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:20.547332 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-v6dqb"] Sep 10 02:57:22.041964 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:22.041930 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e2c5066-a1fa-4003-be9b-988e7084c90c" path="/var/lib/kubelet/pods/7e2c5066-a1fa-4003-be9b-988e7084c90c/volumes" Sep 10 02:57:25.291948 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:25.291910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:25.393242 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:25.393180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:25.455716 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:25.455681 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:25.526910 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:25.526879 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:25.707603 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:25.707506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:28.802427 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:28.802385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:57:28.903241 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:57:28.903189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:00.368956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:00.368910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:00.469026 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:00.468992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:01.783368 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:01.783320 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:01.922355 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:01.922321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:02.039752 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:02.039638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:02.443400 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:02.443299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:02.547484 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:02.547446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:02.638285 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:02.638207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:13.856694 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:13.856586 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:13.956628 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:13.956592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:32.291943 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:32.291899 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:36.467493 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.467460 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-r2t62"] Sep 10 02:58:36.472247 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.472190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.477959 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.477932 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 02:58:36.478127 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.477997 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 02:58:36.478194 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.478134 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c9khk\"" Sep 10 02:58:36.478304 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.478196 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 02:58:36.481382 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.481361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-r2t62"] Sep 10 02:58:36.487792 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.487755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:36.574173 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.574135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.574369 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.574204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.574369 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.574267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v8x9\" (UniqueName: \"kubernetes.io/projected/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-kube-api-access-5v8x9\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.574369 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.574288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.574486 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.574372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.574486 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.574410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675068 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675068 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8x9\" (UniqueName: \"kubernetes.io/projected/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-kube-api-access-5v8x9\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675365 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675365 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675365 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675365 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675639 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675746 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675625 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.675746 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.675672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.677694 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.677672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.677826 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.677805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.684019 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.683996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v8x9\" (UniqueName: \"kubernetes.io/projected/d8e2a4ef-4e21-4e9d-a868-1a9241d9452b-kube-api-access-5v8x9\") pod \"e2e-distinct-simulated-kserve-6685d86975-r2t62\" (UID: \"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:36.786396 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:36.786354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:37.057528 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:37.057501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-r2t62"] Sep 10 02:58:37.059620 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:58:37.059593 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e2a4ef_4e21_4e9d_a868_1a9241d9452b.slice/crio-6d74af6b374c6fada4d5d67f1c24cb11b04d0e5648733f64f7b3d56a2d1553df WatchSource:0}: Error finding container 6d74af6b374c6fada4d5d67f1c24cb11b04d0e5648733f64f7b3d56a2d1553df: Status 404 returned error can't find the container with id 6d74af6b374c6fada4d5d67f1c24cb11b04d0e5648733f64f7b3d56a2d1553df Sep 10 02:58:37.888119 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:37.888081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerStarted","Data":"6d74af6b374c6fada4d5d67f1c24cb11b04d0e5648733f64f7b3d56a2d1553df"} Sep 10 02:58:38.379999 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:38.379953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:38.895467 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:38.895424 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" containerID="b4f2d4d77f5afc94b979e4e767acdf148f19e5dd8e8399c2e45c6a3c115ead3a" exitCode=0 Sep 10 02:58:38.895858 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:38.895497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerDied","Data":"b4f2d4d77f5afc94b979e4e767acdf148f19e5dd8e8399c2e45c6a3c115ead3a"} Sep 10 02:58:38.895858 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:38.895718 2578 scope.go:117] "RemoveContainer" containerID="b4f2d4d77f5afc94b979e4e767acdf148f19e5dd8e8399c2e45c6a3c115ead3a" Sep 10 02:58:39.902521 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:39.902489 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" containerID="f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110" exitCode=0 Sep 10 02:58:39.902956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:39.902544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerDied","Data":"f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110"} Sep 10 02:58:39.902956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:39.902595 2578 scope.go:117] "RemoveContainer" containerID="b4f2d4d77f5afc94b979e4e767acdf148f19e5dd8e8399c2e45c6a3c115ead3a" Sep 10 02:58:39.902956 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:39.902836 2578 scope.go:117] "RemoveContainer" containerID="f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110" Sep 10 02:58:39.903089 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:58:39.903065 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:58:40.909303 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:40.909274 2578 scope.go:117] "RemoveContainer" containerID="f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110" Sep 10 02:58:40.909693 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:58:40.909457 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:58:46.000428 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.000385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:46.055559 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.055521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:46.787368 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.787334 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:46.787514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.787393 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:46.787514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.787413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:46.787514 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.787425 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:58:46.787797 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:46.787784 2578 scope.go:117] "RemoveContainer" containerID="f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110" Sep 10 02:58:46.787959 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:58:46.787940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:58:53.353740 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.353709 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg"] Sep 10 02:58:53.359926 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.359904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.362642 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.362615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 02:58:53.367177 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.367154 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg"] Sep 10 02:58:53.423212 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.423174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e950682a-17f3-4118-99b7-4676e2902d87-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.423443 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.423250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.423443 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.423275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9lnc\" (UniqueName: \"kubernetes.io/projected/e950682a-17f3-4118-99b7-4676e2902d87-kube-api-access-p9lnc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.423443 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.423319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.423443 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.423375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.423443 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.423399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.477398 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.477367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:58:53.524379 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e950682a-17f3-4118-99b7-4676e2902d87-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524566 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524566 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9lnc\" (UniqueName: \"kubernetes.io/projected/e950682a-17f3-4118-99b7-4676e2902d87-kube-api-access-p9lnc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524566 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524735 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524735 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524884 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.524935 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.524915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.525060 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.525043 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.526974 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.526945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e950682a-17f3-4118-99b7-4676e2902d87-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.527135 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.527118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e950682a-17f3-4118-99b7-4676e2902d87-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.532379 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.532355 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9lnc\" (UniqueName: \"kubernetes.io/projected/e950682a-17f3-4118-99b7-4676e2902d87-kube-api-access-p9lnc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4rxlg\" (UID: \"e950682a-17f3-4118-99b7-4676e2902d87\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.671971 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.671878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:58:53.945529 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.945498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg"] Sep 10 02:58:53.946938 ip-10-0-134-49 kubenswrapper[2578]: W0910 02:58:53.946911 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode950682a_17f3_4118_99b7_4676e2902d87.slice/crio-dea2932649b41b587c93478b99bf63cb7c798cf43d13b02436ccda180f31bca1 WatchSource:0}: Error finding container dea2932649b41b587c93478b99bf63cb7c798cf43d13b02436ccda180f31bca1: Status 404 returned error can't find the container with id dea2932649b41b587c93478b99bf63cb7c798cf43d13b02436ccda180f31bca1 Sep 10 02:58:53.978393 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:53.978357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" event={"ID":"e950682a-17f3-4118-99b7-4676e2902d87","Type":"ContainerStarted","Data":"dea2932649b41b587c93478b99bf63cb7c798cf43d13b02436ccda180f31bca1"} Sep 10 02:58:54.986147 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:54.986104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" event={"ID":"e950682a-17f3-4118-99b7-4676e2902d87","Type":"ContainerStarted","Data":"007392323bf066e8c480a23426956ff11a45792d17c03af99dfd12b9314533ed"} Sep 10 02:58:55.006931 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:55.006880 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" podStartSLOduration=1.828146839 podStartE2EDuration="2.006862391s" totalImagesPullingTime="178.715552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:58:55.004892756 +0000 UTC m=+579.490888031" watchObservedRunningTime="2026-09-10 02:58:55.006862391 +0000 UTC m=+579.492857706" Sep 10 02:58:58.037333 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:58.037291 2578 scope.go:117] "RemoveContainer" containerID="f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110" Sep 10 02:58:59.014410 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:59.014376 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" containerID="76e7be9d3e759dc2fda8f45799886fc6174a6eb56355cadae751396df641d074" exitCode=0 Sep 10 02:58:59.014573 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:59.014424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerDied","Data":"76e7be9d3e759dc2fda8f45799886fc6174a6eb56355cadae751396df641d074"} Sep 10 02:58:59.014573 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:59.014472 2578 scope.go:117] "RemoveContainer" containerID="f93865e4809db63b1ed45e80247eba7f69e29f261c8c8f854a821690ece5b110" Sep 10 02:58:59.014814 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:58:59.014796 2578 scope.go:117] "RemoveContainer" containerID="76e7be9d3e759dc2fda8f45799886fc6174a6eb56355cadae751396df641d074" Sep 10 02:58:59.015078 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:58:59.015054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:59:02.507593 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:02.507556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:03.672209 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:03.672161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:59:03.672701 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:03.672254 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:59:03.684982 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:03.684954 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:59:04.056710 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:04.056679 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4rxlg" Sep 10 02:59:06.787448 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:06.787399 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:06.787868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:06.787469 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:06.787868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:06.787486 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:06.787868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:06.787499 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:06.787868 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:06.787852 2578 scope.go:117] "RemoveContainer" containerID="76e7be9d3e759dc2fda8f45799886fc6174a6eb56355cadae751396df641d074" Sep 10 02:59:06.788025 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:59:06.788007 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:59:12.718881 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:12.718836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:12.819766 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:12.819735 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:16.367712 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:16.367673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:16.418872 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:16.418836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:20.037120 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:20.037081 2578 scope.go:117] "RemoveContainer" containerID="76e7be9d3e759dc2fda8f45799886fc6174a6eb56355cadae751396df641d074" Sep 10 02:59:21.140019 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:21.139985 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" exitCode=0 Sep 10 02:59:21.140455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:21.140055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerDied","Data":"e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51"} Sep 10 02:59:21.140455 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:21.140116 2578 scope.go:117] "RemoveContainer" containerID="76e7be9d3e759dc2fda8f45799886fc6174a6eb56355cadae751396df641d074" Sep 10 02:59:21.140543 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:21.140462 2578 scope.go:117] "RemoveContainer" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" Sep 10 02:59:21.140669 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:59:21.140648 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:59:21.701402 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:21.701366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:26.786948 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:26.786910 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:26.789323 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:26.786976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:26.789323 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:26.786993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:26.789323 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:26.787006 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 02:59:26.789323 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:26.787364 2578 scope.go:117] "RemoveContainer" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" Sep 10 02:59:26.789323 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:59:26.787533 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:59:31.191623 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:31.191584 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:36.423405 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:36.423367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 02:59:41.036629 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:41.036552 2578 scope.go:117] "RemoveContainer" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" Sep 10 02:59:41.036990 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:59:41.036718 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 02:59:52.037041 ip-10-0-134-49 kubenswrapper[2578]: I0910 02:59:52.037007 2578 scope.go:117] "RemoveContainer" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" Sep 10 02:59:52.037464 ip-10-0-134-49 kubenswrapper[2578]: E0910 02:59:52.037199 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:00:03.037408 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:03.037376 2578 scope.go:117] "RemoveContainer" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" Sep 10 03:00:03.037787 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:03.037644 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:00:04.358689 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:04.358655 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" exitCode=0 Sep 10 03:00:04.359073 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:04.358735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerDied","Data":"d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5"} Sep 10 03:00:04.359073 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:04.358798 2578 scope.go:117] "RemoveContainer" containerID="e0a7b032a49bb638e6a07eb154649d4fda846a748d26ff62e1bbb1fafde2fd51" Sep 10 03:00:04.359073 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:04.359062 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:00:04.359311 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:00:04.359290 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:00:05.438461 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:05.438420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 03:00:06.787412 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:06.787375 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:00:06.787818 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:06.787460 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:00:06.787818 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:06.787478 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:00:06.787818 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:06.787492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:00:06.787818 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:06.787818 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:00:06.787995 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:00:06.787975 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:00:19.036462 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:19.036429 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:00:19.036918 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:00:19.036613 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:00:33.037314 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:33.037282 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:00:33.037707 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:00:33.037429 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:00:48.036957 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:00:48.036925 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:00:48.037396 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:00:48.037154 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:01:03.037462 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:03.037428 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:01:03.037919 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:01:03.037595 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:01:14.036778 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:14.036698 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:01:14.037259 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:01:14.036876 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:01:29.036687 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:29.036654 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:01:29.795006 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:29.794976 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" exitCode=0 Sep 10 03:01:29.795178 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:29.795050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" event={"ID":"d8e2a4ef-4e21-4e9d-a868-1a9241d9452b","Type":"ContainerDied","Data":"dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6"} Sep 10 03:01:29.795178 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:29.795116 2578 scope.go:117] "RemoveContainer" containerID="d83d30b309ee16f56ace075e1c8cf62ae752e59346e4f4b1fa9ca9c057cbbac5" Sep 10 03:01:29.795511 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:29.795491 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:01:29.795696 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:01:29.795670 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:01:36.787339 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:36.787297 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:01:36.787816 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:36.787403 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:01:36.787816 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:36.787429 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:01:36.787816 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:36.787453 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" Sep 10 03:01:36.787986 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:36.787915 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:01:36.788136 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:01:36.788113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:01:50.037243 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:01:50.037181 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:01:50.037643 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:01:50.037459 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:02:04.042094 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:02:04.042057 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:02:04.042581 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:02:04.042303 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:02:15.037298 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:02:15.037263 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:02:15.037764 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:02:15.037488 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:02:29.036489 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:02:29.036456 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:02:29.036870 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:02:29.036629 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:02:41.037314 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:02:41.037207 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:02:41.037772 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:02:41.037418 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:02:56.039539 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:02:56.039509 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:02:56.039941 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:02:56.039727 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:03:08.042522 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:08.042491 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:03:08.042893 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:03:08.042672 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:03:18.347116 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:18.347085 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d4644ffc5-hmf8j_076d28ee-e46a-40b1-b3f9-361889cfdec5/authorino/0.log" Sep 10 03:03:19.036750 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:19.036711 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:03:19.036977 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:03:19.036954 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:03:24.432239 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:24.432205 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-7c9gm_118594c3-b695-4a8a-8dff-23db14db33ef/copy-manifests/0.log" Sep 10 03:03:24.438423 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:24.438403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-7c9gm_118594c3-b695-4a8a-8dff-23db14db33ef/manager/0.log" Sep 10 03:03:26.096273 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:26.096245 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d4644ffc5-hmf8j_076d28ee-e46a-40b1-b3f9-361889cfdec5/authorino/0.log" Sep 10 03:03:26.578630 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:26.578600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6pvq2_c441afa2-f528-4181-acf8-b1b3ddf0ee64/manager/0.log" Sep 10 03:03:27.582905 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:27.582873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-crh4z_8ba32461-1b69-4d00-8361-77fb8a14e3f3/kube-auth-proxy/0.log" Sep 10 03:03:28.549444 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:28.549410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-r2t62_d8e2a4ef-4e21-4e9d-a868-1a9241d9452b/main/5.log" Sep 10 03:03:28.780305 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:28.780277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4rxlg_e950682a-17f3-4118-99b7-4676e2902d87/main/0.log" Sep 10 03:03:34.037485 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:34.037449 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:03:34.037885 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:03:34.037636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:03:34.566189 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:34.566153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 03:03:34.666455 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:34.666404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" limit=1024 Sep 10 03:03:37.483333 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:37.483303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j8g7l_2eb59efe-5d2f-41ab-b4e4-a548795bbe44/global-pull-secret-syncer/0.log" Sep 10 03:03:37.610158 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:37.610129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6ckhp_dbc44c17-25c5-4ad9-b10a-ca5782438ddf/konnectivity-agent/0.log" Sep 10 03:03:37.707553 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:37.707526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-49.ec2.internal_20f67e3f1462365a445fa83981cf652e/haproxy/0.log" Sep 10 03:03:41.978484 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:41.978455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d4644ffc5-hmf8j_076d28ee-e46a-40b1-b3f9-361889cfdec5/authorino/0.log" Sep 10 03:03:42.138490 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:42.138461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6pvq2_c441afa2-f528-4181-acf8-b1b3ddf0ee64/manager/0.log" Sep 10 03:03:43.580180 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.580146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/alertmanager/0.log" Sep 10 03:03:43.604276 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.604247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/config-reloader/0.log" Sep 10 03:03:43.625443 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.625410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/kube-rbac-proxy-web/0.log" Sep 10 03:03:43.646280 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.646253 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/kube-rbac-proxy/0.log" Sep 10 03:03:43.666883 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.666858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/kube-rbac-proxy-metric/0.log" Sep 10 03:03:43.690777 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.690753 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/prom-label-proxy/0.log" Sep 10 03:03:43.710819 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.710797 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6629fc92-2085-4158-8cb3-3ef1cbb77b5f/init-config-reloader/0.log" Sep 10 03:03:43.780582 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.780547 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-599nn_81661d94-ead3-4f8f-9630-e08126de5c00/kube-state-metrics/0.log" Sep 10 03:03:43.805451 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.805422 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-599nn_81661d94-ead3-4f8f-9630-e08126de5c00/kube-rbac-proxy-main/0.log" Sep 10 03:03:43.824472 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.824451 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-599nn_81661d94-ead3-4f8f-9630-e08126de5c00/kube-rbac-proxy-self/0.log" Sep 10 03:03:43.853433 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.853359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-666bf79894-5rmdh_b506cdd2-57b0-4ae0-a786-ad38312ee44f/metrics-server/0.log" Sep 10 03:03:43.941251 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.937249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4z5pg_fb7c7776-3d90-4223-9c54-69ea5b694392/node-exporter/0.log" Sep 10 03:03:43.958515 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.958490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4z5pg_fb7c7776-3d90-4223-9c54-69ea5b694392/kube-rbac-proxy/0.log" Sep 10 03:03:43.979180 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:43.979153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4z5pg_fb7c7776-3d90-4223-9c54-69ea5b694392/init-textfile/0.log" Sep 10 03:03:44.435593 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:44.435562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-mp7lj_f9ac7615-b6a5-495d-bee5-9218bfbb6202/prometheus-operator/0.log" Sep 10 03:03:44.454878 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:44.454854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-mp7lj_f9ac7615-b6a5-495d-bee5-9218bfbb6202/kube-rbac-proxy/0.log" Sep 10 03:03:46.336560 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:46.336534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-wzq6t_b5ec103c-9f3f-4163-b577-702b97294a29/networking-console-plugin/0.log" Sep 10 03:03:47.573480 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:47.573449 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6866fbddf8-mgbfb_8e0a5294-df0f-4ea7-8d9d-e6add0289309/console/0.log" Sep 10 03:03:48.542044 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.542008 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z"] Sep 10 03:03:48.545484 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.545465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.548047 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.548021 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4lv7\"/\"openshift-service-ca.crt\"" Sep 10 03:03:48.548047 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.548044 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4lv7\"/\"kube-root-ca.crt\"" Sep 10 03:03:48.549098 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.549005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p4lv7\"/\"default-dockercfg-lqv22\"" Sep 10 03:03:48.552028 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.551969 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z"] Sep 10 03:03:48.560823 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.560801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-podres\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.560941 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.560838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-lib-modules\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.560941 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.560855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsngq\" (UniqueName: \"kubernetes.io/projected/81471353-7983-4372-8684-0c270651aab6-kube-api-access-bsngq\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.560941 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.560886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-sys\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.561078 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.560968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-proc\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662166 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-sys\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-proc\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-sys\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-podres\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662314 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-proc\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-lib-modules\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsngq\" (UniqueName: \"kubernetes.io/projected/81471353-7983-4372-8684-0c270651aab6-kube-api-access-bsngq\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-podres\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.662601 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.662543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81471353-7983-4372-8684-0c270651aab6-lib-modules\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.670622 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.670598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsngq\" (UniqueName: \"kubernetes.io/projected/81471353-7983-4372-8684-0c270651aab6-kube-api-access-bsngq\") pod \"perf-node-gather-daemonset-wl44z\" (UID: \"81471353-7983-4372-8684-0c270651aab6\") " pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:48.856170 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:48.856073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:49.037594 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.037566 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:03:49.037766 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:03:49.037724 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:03:49.131717 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.127446 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z"] Sep 10 03:03:49.133969 ip-10-0-134-49 kubenswrapper[2578]: W0910 03:03:49.133923 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81471353_7983_4372_8684_0c270651aab6.slice/crio-df5c1d325b0b29d04de0c3aa46dcb4bc4add879addabc8f91ebb2680177f16dd WatchSource:0}: Error finding container df5c1d325b0b29d04de0c3aa46dcb4bc4add879addabc8f91ebb2680177f16dd: Status 404 returned error can't find the container with id df5c1d325b0b29d04de0c3aa46dcb4bc4add879addabc8f91ebb2680177f16dd Sep 10 03:03:49.502118 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.502025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" event={"ID":"81471353-7983-4372-8684-0c270651aab6","Type":"ContainerStarted","Data":"6b8229228b6706501a7e334797ab63e2e59875499e53923756d0c5120ef57861"} Sep 10 03:03:49.502308 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.502129 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:49.502308 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.502156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" event={"ID":"81471353-7983-4372-8684-0c270651aab6","Type":"ContainerStarted","Data":"df5c1d325b0b29d04de0c3aa46dcb4bc4add879addabc8f91ebb2680177f16dd"} Sep 10 03:03:49.522449 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.522396 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" podStartSLOduration=1.522380827 podStartE2EDuration="1.522380827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:03:49.520187388 +0000 UTC m=+874.006182662" watchObservedRunningTime="2026-09-10 03:03:49.522380827 +0000 UTC m=+874.008376101" Sep 10 03:03:49.548901 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.548871 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hz9mf_3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8/dns/0.log" Sep 10 03:03:49.569815 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.569781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hz9mf_3fbc2bf4-76f2-49f5-a554-2c2e7782c4c8/kube-rbac-proxy/0.log" Sep 10 03:03:49.691349 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:49.691314 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mf2nr_b381fd0c-3486-4e78-8aad-8eccd5d0c551/dns-node-resolver/0.log" Sep 10 03:03:50.242687 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:50.242659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtfl5_29961115-3d62-44e7-9d1c-5b9a19d5207f/node-ca/0.log" Sep 10 03:03:51.316671 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:51.316642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-crh4z_8ba32461-1b69-4d00-8361-77fb8a14e3f3/kube-auth-proxy/0.log" Sep 10 03:03:52.035042 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:52.035016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bvx8c_44f5c1e0-5bad-476a-8613-84ad8ee8f157/serve-healthcheck-canary/0.log" Sep 10 03:03:52.766299 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:52.766274 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lf4dp_0c78b7ec-2446-4f36-baa4-0a0b13324fb4/kube-rbac-proxy/0.log" Sep 10 03:03:52.788553 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:52.788519 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lf4dp_0c78b7ec-2446-4f36-baa4-0a0b13324fb4/exporter/0.log" Sep 10 03:03:52.809898 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:52.809867 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lf4dp_0c78b7ec-2446-4f36-baa4-0a0b13324fb4/extractor/0.log" Sep 10 03:03:55.066235 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:55.066188 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-7c9gm_118594c3-b695-4a8a-8dff-23db14db33ef/manager/0.log" Sep 10 03:03:55.087498 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:55.087474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f567c59b-7c9gm_118594c3-b695-4a8a-8dff-23db14db33ef/copy-manifests/0.log" Sep 10 03:03:55.521339 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:55.521258 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p4lv7/perf-node-gather-daemonset-wl44z" Sep 10 03:03:56.299121 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:56.299091 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79bc984b7c-9l2rl_4b0c61cc-86f1-4c9c-81a4-617ee2c422f4/manager/0.log" Sep 10 03:03:56.347373 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:56.347344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rbcfw_d8f3d126-6fed-4a3d-9c25-8fcf7ad125af/openshift-lws-operator/0.log" Sep 10 03:03:57.999853 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:57.999829 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-crh4z_8ba32461-1b69-4d00-8361-77fb8a14e3f3/kube-auth-proxy/0.log" Sep 10 03:03:59.341478 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:03:59.341451 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-846bd484f-crh4z_8ba32461-1b69-4d00-8361-77fb8a14e3f3/kube-auth-proxy/0.log" Sep 10 03:04:01.036475 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:01.036445 2578 scope.go:117] "RemoveContainer" containerID="dc3a49db35ae4c7e5fa3312ac5ae87d4ddf519c135143e5159379476092725d6" Sep 10 03:04:01.036851 ip-10-0-134-49 kubenswrapper[2578]: E0910 03:04:01.036629 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-r2t62_llm(d8e2a4ef-4e21-4e9d-a868-1a9241d9452b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-r2t62" podUID="d8e2a4ef-4e21-4e9d-a868-1a9241d9452b" Sep 10 03:04:03.372855 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.372823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5fv5c_7f7f0030-f843-43ed-9b45-d0de21dc9898/kube-multus/0.log" Sep 10 03:04:03.712480 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.712404 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/kube-multus-additional-cni-plugins/0.log" Sep 10 03:04:03.733969 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.733944 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/egress-router-binary-copy/0.log" Sep 10 03:04:03.754972 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.754945 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/cni-plugins/0.log" Sep 10 03:04:03.778306 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.778278 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/bond-cni-plugin/0.log" Sep 10 03:04:03.798399 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.798370 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/routeoverride-cni/0.log" Sep 10 03:04:03.819403 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.819380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/whereabouts-cni-bincopy/0.log" Sep 10 03:04:03.839779 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.839757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pqmfg_9a7dbd9b-664e-4bb9-b016-4879b1960508/whereabouts-cni/0.log" Sep 10 03:04:03.987031 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:03.986947 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wsc8g_c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe/network-metrics-daemon/0.log" Sep 10 03:04:04.004420 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.004393 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wsc8g_c58dc4c7-2f61-4946-8e3b-1e6ca4ad75fe/kube-rbac-proxy/0.log" Sep 10 03:04:04.820462 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.820435 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/ovn-controller/0.log" Sep 10 03:04:04.840007 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.839980 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/ovn-acl-logging/0.log" Sep 10 03:04:04.861026 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.860993 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/kube-rbac-proxy-node/0.log" Sep 10 03:04:04.882482 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.882456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 03:04:04.902282 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.902256 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/northd/0.log" Sep 10 03:04:04.923943 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.923918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/nbdb/0.log" Sep 10 03:04:04.944933 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.944908 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/sbdb/0.log" Sep 10 03:04:04.983474 ip-10-0-134-49 kubenswrapper[2578]: I0910 03:04:04.983445 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9chs_747a6e3e-dfb1-4508-9123-c8283943012a/ovnkube-controller/0.log"