Sep 08 03:55:18.559959 ip-10-0-131-231 systemd[1]: Starting Kubernetes Kubelet... Sep 08 03:55:18.997565 ip-10-0-131-231 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 03:55:18.997565 ip-10-0-131-231 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 03:55:18.997565 ip-10-0-131-231 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 03:55:18.997565 ip-10-0-131-231 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 03:55:18.997565 ip-10-0-131-231 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 03:55:18.998675 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:18.998569 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 03:55:19.004075 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004058 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:19.004075 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004075 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004079 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004083 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004085 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004088 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004091 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004095 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004098 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004101 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004104 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004106 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004109 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004112 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004114 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004117 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004121 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004125 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004128 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004135 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:19.004143 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004138 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004141 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004144 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004147 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004151 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004155 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004159 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004162 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004165 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004168 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004171 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004173 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004176 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004179 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004182 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004185 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004187 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004190 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004194 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:19.004597 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004197 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004199 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004202 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004205 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004208 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004211 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004213 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004216 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004218 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004221 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004223 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004226 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004228 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004231 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004233 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004237 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004240 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004242 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004245 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004247 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:19.005108 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004250 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004253 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004256 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004259 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004261 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004264 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004266 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004269 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004271 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004274 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004276 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004279 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004282 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004284 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004287 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004290 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004293 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004296 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004299 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004301 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:19.005606 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004304 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004306 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004309 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004311 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004314 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004316 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004319 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004322 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004324 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004327 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004329 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004332 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004335 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004337 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004340 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004343 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004345 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004348 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004350 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.004354 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:19.006122 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005066 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005073 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005076 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005079 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005081 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005084 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005089 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005091 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005094 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005097 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005100 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005102 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005105 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005108 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005111 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005114 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005117 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005120 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005122 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005126 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:19.006608 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005129 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005132 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005135 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005137 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005140 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005143 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005145 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005148 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005150 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005153 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005156 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005159 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005161 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005164 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005167 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005169 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005172 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005174 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005178 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:19.007116 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005181 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005186 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005189 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005192 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005195 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005198 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005201 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005204 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005206 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005209 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005211 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005214 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005217 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005219 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005222 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005225 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005227 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005230 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005232 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:19.007609 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005235 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005238 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005242 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005245 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005248 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005250 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005253 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005256 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005259 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005262 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005264 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005266 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005269 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005272 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005275 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005277 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005280 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005282 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005285 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:19.008114 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005287 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005290 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005293 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005295 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005298 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005301 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005304 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005308 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005311 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005315 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005318 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005321 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005324 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005326 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005329 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005332 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005335 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005338 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005341 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:19.008575 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005343 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005346 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005349 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005756 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005761 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005764 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005767 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005770 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005774 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005776 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005779 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005781 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005784 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005787 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005792 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005794 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005797 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005800 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005803 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005806 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:19.009067 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005808 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005811 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005814 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005816 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005819 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005822 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005825 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005827 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005830 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005833 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005835 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005838 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005841 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005843 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005846 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005849 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005853 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005856 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005859 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:19.009544 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005862 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005865 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005868 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005870 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005873 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005875 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005878 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005882 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005885 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005887 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005890 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005893 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005897 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005899 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005902 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005904 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005907 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005910 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005912 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005920 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:19.010023 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005925 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005928 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005930 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005935 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005938 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005941 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005944 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005947 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005950 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005952 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005955 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005959 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005962 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005964 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005968 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005971 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005974 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005977 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005980 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:19.010505 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005984 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005987 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005990 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005993 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.005998 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006001 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006004 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006006 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006009 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006011 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006015 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006018 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006021 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006024 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006026 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006029 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006031 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006034 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006037 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006039 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:19.011010 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006042 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006044 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006047 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006049 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006128 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006161 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006168 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006173 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006178 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006181 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006186 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006190 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006195 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006198 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006202 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006205 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006210 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006214 2575 flags.go:64] FLAG: --cgroup-root="" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006217 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006220 2575 flags.go:64] FLAG: --client-ca-file="" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006224 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006227 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006232 2575 flags.go:64] FLAG: --cluster-domain="" Sep 08 03:55:19.011494 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006235 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006238 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006241 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006245 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006248 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006251 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006255 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006258 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006261 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006264 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006267 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006270 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006273 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006278 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006281 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006284 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006287 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006290 2575 flags.go:64] FLAG: --enable-server="true" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006293 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006298 2575 flags.go:64] FLAG: --event-burst="100" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006301 2575 flags.go:64] FLAG: --event-qps="50" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006305 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006308 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006311 2575 flags.go:64] FLAG: --eviction-hard="" Sep 08 03:55:19.012081 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006315 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006319 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006323 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006326 2575 flags.go:64] FLAG: --eviction-soft="" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006329 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006331 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006334 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006337 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006341 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006344 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006347 2575 flags.go:64] FLAG: --feature-gates="" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006351 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006354 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006357 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006360 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006363 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006366 2575 flags.go:64] FLAG: --help="false" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006369 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006372 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006375 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006378 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006381 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006385 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006388 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 03:55:19.012720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006391 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006394 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006397 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006401 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006405 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006409 2575 flags.go:64] FLAG: --kube-reserved="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006412 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006415 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006418 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006422 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006425 2575 flags.go:64] FLAG: --lock-file="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006428 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006431 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006434 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006440 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006443 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006446 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006448 2575 flags.go:64] FLAG: --logging-format="text" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006451 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006455 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006458 2575 flags.go:64] FLAG: --manifest-url="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006461 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006465 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006468 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006472 2575 flags.go:64] FLAG: --max-pods="110" Sep 08 03:55:19.013361 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006475 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006478 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006481 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006484 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006487 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006490 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006493 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006500 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006503 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006506 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006509 2575 flags.go:64] FLAG: --pod-cidr="" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006513 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006520 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006523 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006526 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006529 2575 flags.go:64] FLAG: --port="10250" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006532 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006537 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d6cb39bc92d832ba" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006540 2575 flags.go:64] FLAG: --qos-reserved="" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006543 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006546 2575 flags.go:64] FLAG: --register-node="true" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006549 2575 flags.go:64] FLAG: --register-with-taints="" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006553 2575 flags.go:64] FLAG: --registry-burst="10" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006556 2575 flags.go:64] FLAG: --registry-qps="5" Sep 08 03:55:19.014020 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006559 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006561 2575 flags.go:64] FLAG: --reserved-memory="" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006565 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006569 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006571 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006574 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006577 2575 flags.go:64] FLAG: --runonce="false" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006581 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006584 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006587 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006590 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006593 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006596 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006599 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006602 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006605 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006608 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006610 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006613 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006616 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006621 2575 flags.go:64] FLAG: --system-cgroups="" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006624 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006630 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006633 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006636 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 03:55:19.014676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006642 2575 flags.go:64] FLAG: --tls-min-version="" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006645 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006648 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006651 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006667 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006670 2575 flags.go:64] FLAG: --v="2" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006674 2575 flags.go:64] FLAG: --version="false" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006678 2575 flags.go:64] FLAG: --vmodule="" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006682 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.006686 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006800 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006804 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006807 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006810 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006814 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006817 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006820 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006823 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006825 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006828 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006831 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006833 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:19.015314 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006836 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006838 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006841 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006844 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006846 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006850 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006854 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006856 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006859 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006861 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006866 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006869 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006872 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006874 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006877 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006880 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006882 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006885 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006887 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006890 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:19.015869 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006893 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006895 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006898 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006900 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006903 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006905 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006908 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006910 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006914 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006917 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006920 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006923 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006926 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006928 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006931 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006934 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006936 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006940 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006942 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:19.016369 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006945 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006948 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006951 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006955 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006959 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006963 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006966 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006969 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006972 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006975 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006978 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006980 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006983 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006985 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006988 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006991 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006993 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006996 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.006998 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:19.016892 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007001 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007004 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007007 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007009 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007012 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007015 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007017 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007020 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007022 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007025 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007027 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007032 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007034 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007037 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007040 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007042 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007046 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007049 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007052 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:19.017360 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007055 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007057 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007060 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007062 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007065 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007067 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007070 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007072 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007075 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.007077 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.007755 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.015488 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.015505 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.015525 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 03:55:19.017848 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.015531 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015593 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015598 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015601 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015605 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015608 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015612 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015615 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015618 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015621 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015625 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015629 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015632 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015635 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015639 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015642 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015645 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015648 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015650 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:19.018208 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015667 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015670 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015673 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015676 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015679 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015681 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015684 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015687 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015690 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015692 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015696 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015701 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015705 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015708 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015710 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015713 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015716 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015719 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015722 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015724 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:19.018718 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015727 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015730 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015732 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015735 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015738 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015741 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015743 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015746 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015748 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015751 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015754 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015756 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015759 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015762 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015765 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015767 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015770 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015772 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015776 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:19.019218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015780 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015783 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015786 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015788 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015792 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015796 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015799 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015802 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015805 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015807 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015810 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015813 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015815 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015818 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015821 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015823 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015826 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015829 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015831 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015834 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:19.019791 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015837 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015839 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015842 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015845 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015848 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015850 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015853 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015855 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015859 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015862 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015864 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015867 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015870 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015873 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015876 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015878 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015882 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015884 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015888 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015891 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:19.020334 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015893 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.015896 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.015902 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016019 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016024 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016028 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016031 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016035 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016039 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016041 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016044 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016047 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016049 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016052 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:19.020837 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016054 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016057 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016059 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016062 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016064 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016067 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016070 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016072 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016075 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016077 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016080 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016082 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016085 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016087 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016090 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016093 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016095 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016099 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016101 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016104 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:19.021197 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016107 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016110 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016112 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016115 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016117 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016120 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016123 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016125 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016128 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016131 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016133 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016136 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016138 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016141 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016143 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016146 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016149 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016151 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016154 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:19.021705 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016156 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016161 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016164 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016167 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016169 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016172 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016174 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016177 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016180 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016183 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016185 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016188 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016191 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016193 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016196 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016199 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016201 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016204 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016207 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:19.022191 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016209 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016212 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016214 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016218 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016221 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016224 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016227 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016230 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016233 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016236 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016239 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016241 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016244 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016246 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016249 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016274 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016278 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016281 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016284 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016287 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:19.022701 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016291 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016294 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016297 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016299 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016302 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016305 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016308 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016311 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016313 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:19.016316 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.016320 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.016455 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.018149 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.019210 2575 server.go:1019] "Starting client certificate rotation" Sep 08 03:55:19.023517 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.019309 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 03:55:19.024126 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.019342 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 03:55:19.024126 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.022390 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 03:55:19.027336 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.027306 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 03:55:19.037291 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.037274 2575 log.go:25] "Validated CRI v1 runtime API" Sep 08 03:55:19.041453 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.041437 2575 log.go:25] "Validated CRI v1 image API" Sep 08 03:55:19.043716 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.043698 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 03:55:19.048737 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.048715 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88b7e5e7-8009-4cc8-afc3-46c3b1cdc8a0:/dev/nvme0n1p4 c119bd18-280e-4250-b97a-efe39547a17e:/dev/nvme0n1p3] Sep 08 03:55:19.048815 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.048734 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 03:55:19.054090 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.053970 2575 manager.go:216] Machine: {Timestamp:2026-09-08 03:55:19.05252311 +0000 UTC m=+0.377429249 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100689 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3ab8e1fd34115266ae36a8581625 SystemUUID:ec2d3ab8-e1fd-3411-5266-ae36a8581625 BootID:f734b4ef-f862-42f7-9128-dce2fda82eb2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:cc:21:7a:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:cc:21:7a:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:49:e2:7f:5a:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 03:55:19.054090 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.054081 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 03:55:19.054243 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.054163 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 03:55:19.054823 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.054804 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 03:55:19.057641 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.057617 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 03:55:19.057835 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.057649 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 03:55:19.058681 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.058651 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 03:55:19.058745 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.058688 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 03:55:19.058745 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.058699 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 03:55:19.058745 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.058719 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 03:55:19.060045 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.060033 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 03:55:19.064740 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064726 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 08 03:55:19.064876 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064865 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 03:55:19.064942 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064902 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 08 03:55:19.064942 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064917 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 03:55:19.064942 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064938 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 03:55:19.065058 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064954 2575 kubelet.go:398] "Adding apiserver pod source" Sep 08 03:55:19.065058 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.064967 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 03:55:19.065360 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.065331 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 03:55:19.065360 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.065353 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 03:55:19.069240 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.069221 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 03:55:19.074331 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.074311 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 03:55:19.074414 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.074347 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 03:55:19.075631 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075616 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 03:55:19.075705 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075639 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 03:55:19.075705 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075649 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 03:55:19.075705 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075668 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 03:55:19.075705 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075681 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 03:55:19.075705 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075691 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 03:55:19.075868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075709 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 03:55:19.075868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075715 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 03:55:19.075868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075722 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 03:55:19.075868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075729 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 03:55:19.075868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075741 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 03:55:19.075868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.075746 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 03:55:19.076028 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.075877 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 03:55:19.076028 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.075977 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 03:55:19.076987 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.076974 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 03:55:19.077035 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.076990 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 03:55:19.079413 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.079367 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xt9j" Sep 08 03:55:19.080629 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.080616 2575 server.go:1268] "Started kubelet" Sep 08 03:55:19.080737 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.080711 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 03:55:19.080861 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.080810 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 03:55:19.080963 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.080884 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 03:55:19.081555 ip-10-0-131-231 systemd[1]: Started Kubernetes Kubelet. Sep 08 03:55:19.082853 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.082836 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 08 03:55:19.083512 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.083495 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 03:55:19.086537 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.086299 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xt9j" Sep 08 03:55:19.088041 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.088023 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 03:55:19.088594 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.088575 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 03:55:19.090297 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.090280 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 03:55:19.090990 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.090975 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 03:55:19.091116 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.091095 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.091755 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.091731 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 03:55:19.091871 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.091852 2575 factory.go:55] Registering systemd factory Sep 08 03:55:19.091871 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.091864 2575 factory.go:223] Registration of the systemd container factory successfully Sep 08 03:55:19.092234 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.092143 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 03:55:19.092234 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.092159 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 03:55:19.092370 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.092358 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 08 03:55:19.092545 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.092370 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 08 03:55:19.093769 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.093753 2575 factory.go:153] Registering CRI-O factory Sep 08 03:55:19.093769 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.093769 2575 factory.go:223] Registration of the crio container factory successfully Sep 08 03:55:19.093928 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.093819 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 03:55:19.093928 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.093836 2575 factory.go:103] Registering Raw factory Sep 08 03:55:19.093928 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.093849 2575 manager.go:1196] Started watching for new ooms in manager Sep 08 03:55:19.094212 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.094198 2575 manager.go:349] Starting recovery of all containers Sep 08 03:55:19.102085 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.102060 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:19.105559 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.105536 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-231.ec2.internal\" not found" node="ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.108044 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.108025 2575 manager.go:354] Recovery completed Sep 08 03:55:19.112645 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.112630 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.114675 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.114635 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.114752 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.114695 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.114752 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.114707 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.115288 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.115276 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 03:55:19.115338 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.115287 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 03:55:19.115338 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.115305 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 08 03:55:19.115338 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.115311 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.116064 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.116050 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.116127 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.116079 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.116127 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.116090 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.117398 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.117386 2575 policy_none.go:49] "None policy: Start" Sep 08 03:55:19.117442 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.117401 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 03:55:19.117442 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.117411 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 03:55:19.119390 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.119379 2575 policy_none.go:47] "Start" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154345 2575 manager.go:337] "Starting Device Plugin manager" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.154378 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154391 2575 server.go:87] "Starting device plugin registration server" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154785 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154798 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154901 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154988 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.154998 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.155466 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 03:55:19.169771 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.155513 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.188535 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.188497 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 03:55:19.189735 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.189717 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 03:55:19.189856 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.189762 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 03:55:19.189856 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.189786 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 03:55:19.189856 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.189823 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 03:55:19.191649 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.191628 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:19.255723 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.255592 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.256678 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.256650 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.256774 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.256691 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.256774 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.256701 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.256774 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.256723 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.264777 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.264758 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.264869 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.264785 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-231.ec2.internal\": node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.279555 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.279528 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.290461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.290434 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal"] Sep 08 03:55:19.290564 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.290504 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.291497 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.291480 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.291585 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.291514 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.291585 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.291529 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.293625 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.293608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ec0f30b70bc436a632aa50f292eb2d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"4ec0f30b70bc436a632aa50f292eb2d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.293719 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.293631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec0f30b70bc436a632aa50f292eb2d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"4ec0f30b70bc436a632aa50f292eb2d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.294016 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294002 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.294133 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294106 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.294178 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294135 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.294769 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294748 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.294847 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294778 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.294847 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294789 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.294847 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294753 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.294964 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294848 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.294964 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.294861 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.297144 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.297127 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.297235 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.297149 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:19.297903 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.297888 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:19.297994 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.297909 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:19.297994 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.297925 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:19.331427 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.331403 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-231.ec2.internal\" not found" node="ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.335790 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.335775 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-231.ec2.internal\" not found" node="ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.380004 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.379975 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.393995 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.393971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ec0f30b70bc436a632aa50f292eb2d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"4ec0f30b70bc436a632aa50f292eb2d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.394082 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.394001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec0f30b70bc436a632aa50f292eb2d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"4ec0f30b70bc436a632aa50f292eb2d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.394082 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.394024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1359749daf4e4b7415802bb044b0e39e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-231.ec2.internal\" (UID: \"1359749daf4e4b7415802bb044b0e39e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.394082 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.394060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ec0f30b70bc436a632aa50f292eb2d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"4ec0f30b70bc436a632aa50f292eb2d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.394181 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.394104 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec0f30b70bc436a632aa50f292eb2d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal\" (UID: \"4ec0f30b70bc436a632aa50f292eb2d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.480700 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.480639 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.494997 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.494972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1359749daf4e4b7415802bb044b0e39e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-231.ec2.internal\" (UID: \"1359749daf4e4b7415802bb044b0e39e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.495045 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.495011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1359749daf4e4b7415802bb044b0e39e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-231.ec2.internal\" (UID: \"1359749daf4e4b7415802bb044b0e39e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.581489 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.581411 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.633247 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.633219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.638461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.638445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Sep 08 03:55:19.682200 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.682159 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.786167 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.786131 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.886779 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:19.886685 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-231.ec2.internal\" not found" Sep 08 03:55:19.946553 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.946524 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:19.991872 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:19.991839 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" Sep 08 03:55:20.001812 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.001792 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 03:55:20.003320 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.003306 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" Sep 08 03:55:20.013051 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.013023 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 03:55:20.019335 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.019315 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 03:55:20.019484 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.019446 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 03:55:20.019526 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.019490 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 03:55:20.019526 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.019491 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 03:55:20.065899 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.065869 2575 apiserver.go:52] "Watching apiserver" Sep 08 03:55:20.086382 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.086353 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 03:55:20.086832 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.086806 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98","openshift-cluster-node-tuning-operator/tuned-v4hvn","openshift-image-registry/node-ca-bb7s2","openshift-multus/multus-additional-cni-plugins-x46p8","openshift-multus/multus-vgwcg","openshift-multus/network-metrics-daemon-qcndh","openshift-network-diagnostics/network-check-target-hctvp","kube-system/global-pull-secret-syncer-2r5kl","kube-system/konnectivity-agent-2c44c","openshift-dns/node-resolver-xcr5v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal","openshift-network-operator/iptables-alerter-h9s4l","openshift-ovn-kubernetes/ovnkube-node-4zvjr","kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal"] Sep 08 03:55:20.089542 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.089513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:20.090067 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.090033 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:20.090496 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.090477 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 03:55:20.092184 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.092159 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 03:50:19 +0000 UTC" deadline="2028-05-29 11:43:14.909032052 +0000 UTC" Sep 08 03:55:20.092184 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.092181 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15103h47m54.816853819s" Sep 08 03:55:20.092552 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.092531 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.095938 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.095504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.096239 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.096050 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 03:55:20.096239 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.096126 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 03:55:20.096239 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.096221 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h9wdd\"" Sep 08 03:55:20.097213 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.097187 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.097213 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.097205 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.097379 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.097256 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 03:55:20.097379 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.097284 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 03:55:20.098318 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.098297 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.099010 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.098990 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 03:55:20.099097 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099080 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.099364 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099323 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2h5cd\"" Sep 08 03:55:20.099459 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099436 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.099555 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-kubelet\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099555 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-slash\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099670 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-run-netns\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099670 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099670 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099670 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-systemd-units\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099831 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-var-lib-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099831 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-node-log\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099831 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-log-socket\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099831 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099779 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-cni-netd\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099831 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-ovnkube-config\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-etc-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-cni-bin\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbg2w\" (UniqueName: \"kubernetes.io/projected/7970b43e-05ca-481d-be96-a9e804fe0c69-kube-api-access-bbg2w\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-systemd\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-ovn\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-run-ovn-kubernetes\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.099996 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.099996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-env-overrides\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.100277 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.100011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7970b43e-05ca-481d-be96-a9e804fe0c69-ovn-node-metrics-cert\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.100277 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.100042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-ovnkube-script-lib\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.101859 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.101842 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 03:55:20.101926 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.101847 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rzlv4\"" Sep 08 03:55:20.102098 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.102080 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.102170 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.102114 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 03:55:20.102222 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.102171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.102467 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.102449 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 03:55:20.102534 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.102519 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.103332 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.103316 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 03:55:20.104526 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.104510 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wv6xc\"" Sep 08 03:55:20.104745 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.104720 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 03:55:20.105139 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.105122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.105210 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.105192 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:20.107939 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.107924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.110191 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.110172 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-njw5q\"" Sep 08 03:55:20.110330 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.110312 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 03:55:20.110400 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.110381 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 03:55:20.110909 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.110892 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.113216 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.113194 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 03:55:20.113445 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.113429 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2mkbx\"" Sep 08 03:55:20.113542 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.113468 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.113634 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.113430 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.113855 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.113835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.116367 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.116347 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.116367 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.116352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.116771 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.116755 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9s8nj\"" Sep 08 03:55:20.116855 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.116773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.119187 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.119170 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.119347 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.119333 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f2rl6\"" Sep 08 03:55:20.119452 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.119437 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.119718 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.119706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.119812 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.119785 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:20.122466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.122449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.124925 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.124907 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:55:20.124991 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.124915 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 03:55:20.125215 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.125189 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 03:55:20.125215 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.125209 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pzq2s\"" Sep 08 03:55:20.130269 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.130246 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7n4td" Sep 08 03:55:20.138025 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.137973 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7n4td" Sep 08 03:55:20.192846 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.192815 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 03:55:20.201062 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cni-binary-copy\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.201157 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysctl-d\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.201157 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f168d0-4eff-4fff-babb-9ed38bb788bc-dbus\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.201157 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-systemd-units\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201157 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-var-lib-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-log-socket\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201209 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-systemd-units\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-var-lib-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-log-socket\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjr7p\" (UniqueName: \"kubernetes.io/projected/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-kube-api-access-gjr7p\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-kubernetes\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-lib-modules\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.201301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbg2w\" (UniqueName: \"kubernetes.io/projected/7970b43e-05ca-481d-be96-a9e804fe0c69-kube-api-access-bbg2w\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-daemon-config\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201350 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-system-cni-dir\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-host\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-tmp-dir\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-kubelet\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-etc-kubernetes\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-systemd\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-kubelet\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cnibin\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-kubelet\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysconfig\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.201663 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-sys\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/366691a5-dc3c-4c66-898d-82092dc8e352-etc-tuned\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-ovnkube-config\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6b5053a-e0f8-42e8-9447-c8b2ed122699-host\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-netns\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49c41524-b3c6-482f-8e85-3a0040fa51a6-agent-certs\") pod \"konnectivity-agent-2c44c\" (UID: \"49c41524-b3c6-482f-8e85-3a0040fa51a6\") " pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.201966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-registration-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-cni-bin\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49c41524-b3c6-482f-8e85-3a0040fa51a6-konnectivity-ca\") pod \"konnectivity-agent-2c44c\" (UID: \"49c41524-b3c6-482f-8e85-3a0040fa51a6\") " pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-cni-bin\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lgj\" (UniqueName: \"kubernetes.io/projected/add0be35-d68a-4e03-9f2f-f1c4095e5d05-kube-api-access-g9lgj\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-run\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv4rf\" (UniqueName: \"kubernetes.io/projected/366691a5-dc3c-4c66-898d-82092dc8e352-kube-api-access-bv4rf\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/676d5752-f4b4-4f4f-acff-cc658c23696e-iptables-alerter-script\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.202371 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-env-overrides\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysctl-conf\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-hosts-file\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-run-netns\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-k8s-cni-cncf-io\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-run-netns\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-node-log\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-cni-netd\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-node-log\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-socket-dir-parent\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-cni-netd\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-cni-bin\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-cni-multus\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54xww\" (UniqueName: \"kubernetes.io/projected/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-kube-api-access-54xww\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-env-overrides\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-device-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwmd7\" (UniqueName: \"kubernetes.io/projected/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-kube-api-access-vwmd7\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.203197 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f168d0-4eff-4fff-babb-9ed38bb788bc-kubelet-config\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-systemd\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-system-cni-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-systemd\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-modprobe-d\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-sys-fs\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676d5752-f4b4-4f4f-acff-cc658c23696e-host-slash\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2h5n\" (UniqueName: \"kubernetes.io/projected/676d5752-f4b4-4f4f-acff-cc658c23696e-kube-api-access-f2h5n\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-socket-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/366691a5-dc3c-4c66-898d-82092dc8e352-tmp\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202840 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-ovnkube-config\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-etc-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6b5053a-e0f8-42e8-9447-c8b2ed122699-serviceca\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202894 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-etc-openvswitch\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.203941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf4qn\" (UniqueName: \"kubernetes.io/projected/c6b5053a-e0f8-42e8-9447-c8b2ed122699-kube-api-access-vf4qn\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-hostroot\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.202979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-var-lib-kubelet\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-ovn\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-run-ovn-kubernetes\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203097 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-run-ovn\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7970b43e-05ca-481d-be96-a9e804fe0c69-ovn-node-metrics-cert\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203144 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-ovnkube-script-lib\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-cni-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-cni-binary-copy\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-conf-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203177 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-run-ovn-kubernetes\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-multus-certs\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-slash\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-cnibin\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-slash\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.204466 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-252zd\" (UniqueName: \"kubernetes.io/projected/53110014-8f58-4ce0-820b-20aeba80aa90-kube-api-access-252zd\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.205049 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203400 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7970b43e-05ca-481d-be96-a9e804fe0c69-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.205049 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203581 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 03:55:20.205049 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.203686 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7970b43e-05ca-481d-be96-a9e804fe0c69-ovnkube-script-lib\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.207152 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.207129 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7970b43e-05ca-481d-be96-a9e804fe0c69-ovn-node-metrics-cert\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.209129 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.209106 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:20.209129 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.209128 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:20.209269 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.209139 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:20.209269 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.209212 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:20.70919578 +0000 UTC m=+2.034101905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:20.211205 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.211181 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbg2w\" (UniqueName: \"kubernetes.io/projected/7970b43e-05ca-481d-be96-a9e804fe0c69-kube-api-access-bbg2w\") pod \"ovnkube-node-4zvjr\" (UID: \"7970b43e-05ca-481d-be96-a9e804fe0c69\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.258150 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.258106 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1359749daf4e4b7415802bb044b0e39e.slice/crio-1e727110f8e873ac891b639c6b6cd355aee8daaa3de15424d6266a95138558d0 WatchSource:0}: Error finding container 1e727110f8e873ac891b639c6b6cd355aee8daaa3de15424d6266a95138558d0: Status 404 returned error can't find the container with id 1e727110f8e873ac891b639c6b6cd355aee8daaa3de15424d6266a95138558d0 Sep 08 03:55:20.266028 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.266001 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 03:55:20.270545 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.270520 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec0f30b70bc436a632aa50f292eb2d0.slice/crio-de4676c67071c46125ccb348805d279d44e1e28a82d83182d976c51d56e9bd2c WatchSource:0}: Error finding container de4676c67071c46125ccb348805d279d44e1e28a82d83182d976c51d56e9bd2c: Status 404 returned error can't find the container with id de4676c67071c46125ccb348805d279d44e1e28a82d83182d976c51d56e9bd2c Sep 08 03:55:20.304429 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304399 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-socket-dir-parent\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304429 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-cni-bin\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304650 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304446 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-cni-multus\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304650 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54xww\" (UniqueName: \"kubernetes.io/projected/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-kube-api-access-54xww\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304650 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-device-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.304650 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304558 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-cni-bin\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304650 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-cni-multus\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304700 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwmd7\" (UniqueName: \"kubernetes.io/projected/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-kube-api-access-vwmd7\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f168d0-4eff-4fff-babb-9ed38bb788bc-kubelet-config\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304747 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-socket-dir-parent\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304706 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-device-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-system-cni-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f168d0-4eff-4fff-babb-9ed38bb788bc-kubelet-config\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-modprobe-d\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.304873 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-sys-fs\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676d5752-f4b4-4f4f-acff-cc658c23696e-host-slash\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h5n\" (UniqueName: \"kubernetes.io/projected/676d5752-f4b4-4f4f-acff-cc658c23696e-kube-api-access-f2h5n\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304932 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676d5752-f4b4-4f4f-acff-cc658c23696e-host-slash\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-sys-fs\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.304950 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-system-cni-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-socket-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-modprobe-d\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.305032 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/366691a5-dc3c-4c66-898d-82092dc8e352-tmp\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.305111 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:20.805090769 +0000 UTC m=+2.129996898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305131 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6b5053a-e0f8-42e8-9447-c8b2ed122699-serviceca\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305150 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-socket-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf4qn\" (UniqueName: \"kubernetes.io/projected/c6b5053a-e0f8-42e8-9447-c8b2ed122699-kube-api-access-vf4qn\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-hostroot\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-var-lib-kubelet\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.305399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-cni-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-hostroot\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-cni-binary-copy\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-conf-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305349 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-conf-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-multus-certs\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-var-lib-kubelet\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-cnibin\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-multus-certs\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305373 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-cni-dir\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305573 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-cnibin\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-252zd\" (UniqueName: \"kubernetes.io/projected/53110014-8f58-4ce0-820b-20aeba80aa90-kube-api-access-252zd\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cni-binary-copy\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysctl-d\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysctl-d\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f168d0-4eff-4fff-babb-9ed38bb788bc-dbus\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjr7p\" (UniqueName: \"kubernetes.io/projected/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-kube-api-access-gjr7p\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.306315 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6b5053a-e0f8-42e8-9447-c8b2ed122699-serviceca\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-kubernetes\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305848 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f168d0-4eff-4fff-babb-9ed38bb788bc-dbus\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-lib-modules\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-cni-binary-copy\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-daemon-config\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-kubernetes\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-system-cni-dir\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.305985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-host\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306003 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-lib-modules\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-tmp-dir\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-kubelet\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306051 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-system-cni-dir\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306061 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-host\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-etc-kubernetes\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-var-lib-kubelet\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306113 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-etc-kubernetes\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-systemd\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cnibin\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysconfig\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-sys\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306268 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/366691a5-dc3c-4c66-898d-82092dc8e352-etc-tuned\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306271 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cni-binary-copy\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cnibin\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-systemd\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6b5053a-e0f8-42e8-9447-c8b2ed122699-host\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-netns\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.306391 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-multus-daemon-config\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-etc-selinux\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.307956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306415 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-tmp-dir\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.306444 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:55:20.806427234 +0000 UTC m=+2.131333366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49c41524-b3c6-482f-8e85-3a0040fa51a6-agent-certs\") pod \"konnectivity-agent-2c44c\" (UID: \"49c41524-b3c6-482f-8e85-3a0040fa51a6\") " pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6b5053a-e0f8-42e8-9447-c8b2ed122699-host\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-sys\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysconfig\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-registration-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49c41524-b3c6-482f-8e85-3a0040fa51a6-konnectivity-ca\") pod \"konnectivity-agent-2c44c\" (UID: \"49c41524-b3c6-482f-8e85-3a0040fa51a6\") " pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-netns\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lgj\" (UniqueName: \"kubernetes.io/projected/add0be35-d68a-4e03-9f2f-f1c4095e5d05-kube-api-access-g9lgj\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-run\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-registration-dir\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv4rf\" (UniqueName: \"kubernetes.io/projected/366691a5-dc3c-4c66-898d-82092dc8e352-kube-api-access-bv4rf\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306645 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/add0be35-d68a-4e03-9f2f-f1c4095e5d05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/676d5752-f4b4-4f4f-acff-cc658c23696e-iptables-alerter-script\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.308478 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306662 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/add0be35-d68a-4e03-9f2f-f1c4095e5d05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306681 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysctl-conf\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-hosts-file\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306727 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-run\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-k8s-cni-cncf-io\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.306825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-host-run-k8s-cni-cncf-io\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.307020 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-hosts-file\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.307025 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/366691a5-dc3c-4c66-898d-82092dc8e352-etc-sysctl-conf\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.307419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49c41524-b3c6-482f-8e85-3a0040fa51a6-konnectivity-ca\") pod \"konnectivity-agent-2c44c\" (UID: \"49c41524-b3c6-482f-8e85-3a0040fa51a6\") " pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.307458 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/676d5752-f4b4-4f4f-acff-cc658c23696e-iptables-alerter-script\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.308018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/366691a5-dc3c-4c66-898d-82092dc8e352-tmp\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.308797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/366691a5-dc3c-4c66-898d-82092dc8e352-etc-tuned\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.309180 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.309139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49c41524-b3c6-482f-8e85-3a0040fa51a6-agent-certs\") pod \"konnectivity-agent-2c44c\" (UID: \"49c41524-b3c6-482f-8e85-3a0040fa51a6\") " pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.313603 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.313580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54xww\" (UniqueName: \"kubernetes.io/projected/a7d0814b-6a60-465b-aeb6-cbc2db866eb4-kube-api-access-54xww\") pod \"multus-vgwcg\" (UID: \"a7d0814b-6a60-465b-aeb6-cbc2db866eb4\") " pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.317844 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.317819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-252zd\" (UniqueName: \"kubernetes.io/projected/53110014-8f58-4ce0-820b-20aeba80aa90-kube-api-access-252zd\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.317962 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.317941 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2h5n\" (UniqueName: \"kubernetes.io/projected/676d5752-f4b4-4f4f-acff-cc658c23696e-kube-api-access-f2h5n\") pod \"iptables-alerter-h9s4l\" (UID: \"676d5752-f4b4-4f4f-acff-cc658c23696e\") " pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.318024 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.318003 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwmd7\" (UniqueName: \"kubernetes.io/projected/1c417235-1d24-4eb4-90e7-b7ac62c2ac3e-kube-api-access-vwmd7\") pod \"node-resolver-xcr5v\" (UID: \"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e\") " pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.318119 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.318096 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf4qn\" (UniqueName: \"kubernetes.io/projected/c6b5053a-e0f8-42e8-9447-c8b2ed122699-kube-api-access-vf4qn\") pod \"node-ca-bb7s2\" (UID: \"c6b5053a-e0f8-42e8-9447-c8b2ed122699\") " pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.318819 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.318798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjr7p\" (UniqueName: \"kubernetes.io/projected/1f4e4517-e3b8-452f-a5ee-65d9709ebcbb-kube-api-access-gjr7p\") pod \"aws-ebs-csi-driver-node-gml98\" (UID: \"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.319071 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.319050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lgj\" (UniqueName: \"kubernetes.io/projected/add0be35-d68a-4e03-9f2f-f1c4095e5d05-kube-api-access-g9lgj\") pod \"multus-additional-cni-plugins-x46p8\" (UID: \"add0be35-d68a-4e03-9f2f-f1c4095e5d05\") " pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.319308 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.319288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv4rf\" (UniqueName: \"kubernetes.io/projected/366691a5-dc3c-4c66-898d-82092dc8e352-kube-api-access-bv4rf\") pod \"tuned-v4hvn\" (UID: \"366691a5-dc3c-4c66-898d-82092dc8e352\") " pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.402552 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.402467 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:20.433583 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.433538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:20.439435 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.439409 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bb7s2" Sep 08 03:55:20.444219 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.444188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7970b43e_05ca_481d_be96_a9e804fe0c69.slice/crio-c179fe045cc4503024e6c26938df986c88941f88e091ab612376bfca8f3c64f7 WatchSource:0}: Error finding container c179fe045cc4503024e6c26938df986c88941f88e091ab612376bfca8f3c64f7: Status 404 returned error can't find the container with id c179fe045cc4503024e6c26938df986c88941f88e091ab612376bfca8f3c64f7 Sep 08 03:55:20.448484 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.448463 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b5053a_e0f8_42e8_9447_c8b2ed122699.slice/crio-86070cdecdb9f3b25245aac175ad1a70524ad03b8f3443416523b3dc9018ff00 WatchSource:0}: Error finding container 86070cdecdb9f3b25245aac175ad1a70524ad03b8f3443416523b3dc9018ff00: Status 404 returned error can't find the container with id 86070cdecdb9f3b25245aac175ad1a70524ad03b8f3443416523b3dc9018ff00 Sep 08 03:55:20.458966 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.458941 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x46p8" Sep 08 03:55:20.468821 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.468650 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd0be35_d68a_4e03_9f2f_f1c4095e5d05.slice/crio-8b465393403a18c0f0263bf8f495bbfd193c0d6079d6c5c2e9de578ef2ba23f1 WatchSource:0}: Error finding container 8b465393403a18c0f0263bf8f495bbfd193c0d6079d6c5c2e9de578ef2ba23f1: Status 404 returned error can't find the container with id 8b465393403a18c0f0263bf8f495bbfd193c0d6079d6c5c2e9de578ef2ba23f1 Sep 08 03:55:20.473911 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.473893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vgwcg" Sep 08 03:55:20.479962 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.479943 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:20.482433 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.482409 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d0814b_6a60_465b_aeb6_cbc2db866eb4.slice/crio-c164a2ab93ca5424e4536fb5228bbba58946449cae5146c8d0b9643d85249901 WatchSource:0}: Error finding container c164a2ab93ca5424e4536fb5228bbba58946449cae5146c8d0b9643d85249901: Status 404 returned error can't find the container with id c164a2ab93ca5424e4536fb5228bbba58946449cae5146c8d0b9643d85249901 Sep 08 03:55:20.489257 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.489189 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c41524_b3c6_482f_8e85_3a0040fa51a6.slice/crio-8fe01a4441491f1fceafe7e1df15ffcdbe5ae21423f8cf717e30e0f0e7b9e1ca WatchSource:0}: Error finding container 8fe01a4441491f1fceafe7e1df15ffcdbe5ae21423f8cf717e30e0f0e7b9e1ca: Status 404 returned error can't find the container with id 8fe01a4441491f1fceafe7e1df15ffcdbe5ae21423f8cf717e30e0f0e7b9e1ca Sep 08 03:55:20.496601 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.496578 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" Sep 08 03:55:20.506589 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.506565 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4e4517_e3b8_452f_a5ee_65d9709ebcbb.slice/crio-24f20ffc930de7c01a09982afa8ea74d9f7ae72543c7c0d07cfc366a47454d1c WatchSource:0}: Error finding container 24f20ffc930de7c01a09982afa8ea74d9f7ae72543c7c0d07cfc366a47454d1c: Status 404 returned error can't find the container with id 24f20ffc930de7c01a09982afa8ea74d9f7ae72543c7c0d07cfc366a47454d1c Sep 08 03:55:20.516468 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.516447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" Sep 08 03:55:20.525331 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.525308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366691a5_dc3c_4c66_898d_82092dc8e352.slice/crio-645741973a1f51913080f4fabfaf3d9af0f02b80ccf1c01768a3cfc057f34ae8 WatchSource:0}: Error finding container 645741973a1f51913080f4fabfaf3d9af0f02b80ccf1c01768a3cfc057f34ae8: Status 404 returned error can't find the container with id 645741973a1f51913080f4fabfaf3d9af0f02b80ccf1c01768a3cfc057f34ae8 Sep 08 03:55:20.531787 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.531762 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcr5v" Sep 08 03:55:20.537153 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.537133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9s4l" Sep 08 03:55:20.541450 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.541419 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c417235_1d24_4eb4_90e7_b7ac62c2ac3e.slice/crio-306791900d30a7b02aaacf5909ddbbd2116304213502a225048147a73ed64c12 WatchSource:0}: Error finding container 306791900d30a7b02aaacf5909ddbbd2116304213502a225048147a73ed64c12: Status 404 returned error can't find the container with id 306791900d30a7b02aaacf5909ddbbd2116304213502a225048147a73ed64c12 Sep 08 03:55:20.547548 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:20.547522 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676d5752_f4b4_4f4f_acff_cc658c23696e.slice/crio-064911ca936d7417f7c6f8c65665b85783e6cd3f8c3a68c310b2a8710047b305 WatchSource:0}: Error finding container 064911ca936d7417f7c6f8c65665b85783e6cd3f8c3a68c310b2a8710047b305: Status 404 returned error can't find the container with id 064911ca936d7417f7c6f8c65665b85783e6cd3f8c3a68c310b2a8710047b305 Sep 08 03:55:20.709389 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.709315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:20.709525 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.709448 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:20.709525 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.709466 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:20.709525 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.709477 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:20.709633 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.709531 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:21.709513901 +0000 UTC m=+3.034420029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:20.810154 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.810117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:20.810344 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.810212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:20.810411 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.810380 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:20.810474 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.810450 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:55:21.810428351 +0000 UTC m=+3.135334493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:20.810932 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.810910 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:20.811027 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:20.811011 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:21.810990709 +0000 UTC m=+3.135896839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:20.863406 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:20.863369 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:21.141029 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.140878 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 03:50:20 +0000 UTC" deadline="2028-03-21 04:09:52.502601616 +0000 UTC" Sep 08 03:55:21.141029 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.140976 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13440h14m31.361631263s" Sep 08 03:55:21.175684 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.175647 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:21.196660 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.195977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:21.196660 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.196161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:21.213855 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.213399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" event={"ID":"4ec0f30b70bc436a632aa50f292eb2d0","Type":"ContainerStarted","Data":"de4676c67071c46125ccb348805d279d44e1e28a82d83182d976c51d56e9bd2c"} Sep 08 03:55:21.218850 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.218756 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" event={"ID":"1359749daf4e4b7415802bb044b0e39e","Type":"ContainerStarted","Data":"1e727110f8e873ac891b639c6b6cd355aee8daaa3de15424d6266a95138558d0"} Sep 08 03:55:21.239109 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.239069 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9s4l" event={"ID":"676d5752-f4b4-4f4f-acff-cc658c23696e","Type":"ContainerStarted","Data":"064911ca936d7417f7c6f8c65665b85783e6cd3f8c3a68c310b2a8710047b305"} Sep 08 03:55:21.252236 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.252195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcr5v" event={"ID":"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e","Type":"ContainerStarted","Data":"306791900d30a7b02aaacf5909ddbbd2116304213502a225048147a73ed64c12"} Sep 08 03:55:21.261487 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.261397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2c44c" event={"ID":"49c41524-b3c6-482f-8e85-3a0040fa51a6","Type":"ContainerStarted","Data":"8fe01a4441491f1fceafe7e1df15ffcdbe5ae21423f8cf717e30e0f0e7b9e1ca"} Sep 08 03:55:21.266268 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.266182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vgwcg" event={"ID":"a7d0814b-6a60-465b-aeb6-cbc2db866eb4","Type":"ContainerStarted","Data":"c164a2ab93ca5424e4536fb5228bbba58946449cae5146c8d0b9643d85249901"} Sep 08 03:55:21.278721 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.278666 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerStarted","Data":"8b465393403a18c0f0263bf8f495bbfd193c0d6079d6c5c2e9de578ef2ba23f1"} Sep 08 03:55:21.300606 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.300567 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" event={"ID":"366691a5-dc3c-4c66-898d-82092dc8e352","Type":"ContainerStarted","Data":"645741973a1f51913080f4fabfaf3d9af0f02b80ccf1c01768a3cfc057f34ae8"} Sep 08 03:55:21.306676 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.306640 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" event={"ID":"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb","Type":"ContainerStarted","Data":"24f20ffc930de7c01a09982afa8ea74d9f7ae72543c7c0d07cfc366a47454d1c"} Sep 08 03:55:21.321012 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.320961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bb7s2" event={"ID":"c6b5053a-e0f8-42e8-9447-c8b2ed122699","Type":"ContainerStarted","Data":"86070cdecdb9f3b25245aac175ad1a70524ad03b8f3443416523b3dc9018ff00"} Sep 08 03:55:21.333231 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.333120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"c179fe045cc4503024e6c26938df986c88941f88e091ab612376bfca8f3c64f7"} Sep 08 03:55:21.719507 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.719465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:21.719724 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.719645 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:21.719724 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.719691 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:21.719724 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.719708 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:21.719949 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.719782 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:23.719754501 +0000 UTC m=+5.044660631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:21.820377 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.820336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:21.820581 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:21.820433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:21.820581 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.820568 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:21.820688 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.820637 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:21.820785 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.820642 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:55:23.820623347 +0000 UTC m=+5.145529478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:21.820785 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:21.820724 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:23.820702602 +0000 UTC m=+5.145608745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:22.142069 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:22.141912 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 03:50:20 +0000 UTC" deadline="2028-06-02 12:08:50.867555294 +0000 UTC" Sep 08 03:55:22.142069 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:22.141978 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15200h13m28.72558179s" Sep 08 03:55:22.191260 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:22.190470 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:22.191260 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:22.190646 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:22.191260 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:22.191098 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:22.191260 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:22.191190 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:22.560872 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:22.560489 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:23.193455 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:23.192599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:23.193455 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.192767 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:23.738593 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:23.738540 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:23.738784 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.738770 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:23.738863 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.738794 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:23.738863 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.738807 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:23.738980 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.738884 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:27.738850909 +0000 UTC m=+9.063757056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:23.839102 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:23.839069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:23.839223 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:23.839162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:23.839305 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.839288 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:23.839380 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.839353 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:55:27.839335406 +0000 UTC m=+9.164241536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:23.839770 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.839749 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:23.839865 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:23.839807 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:27.839790769 +0000 UTC m=+9.164696897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:24.190729 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:24.190582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:24.190729 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:24.190611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:24.190933 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:24.190745 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:24.190933 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:24.190884 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:25.191894 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:25.191858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:25.192528 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:25.192000 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:26.190756 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:26.190721 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:26.190933 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:26.190760 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:26.190933 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:26.190855 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:26.191061 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:26.191039 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:27.190733 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:27.190288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:27.190733 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.190419 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:27.774824 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:27.774725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:27.774989 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.774904 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:27.774989 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.774923 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:27.774989 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.774935 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:27.775151 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.775000 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:35.774981146 +0000 UTC m=+17.099887285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:27.876009 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:27.875669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:27.876009 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:27.875741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:27.876009 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.875887 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:27.876009 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.875958 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:35.875938326 +0000 UTC m=+17.200844454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:27.876403 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.875887 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:27.876403 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:27.876309 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:55:35.876291661 +0000 UTC m=+17.201197787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:28.190682 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:28.190633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:28.190864 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:28.190671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:28.190864 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:28.190806 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:28.191278 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:28.190952 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:29.191089 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:29.190982 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:29.191548 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:29.191105 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:30.190671 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:30.190573 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:30.190671 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:30.190624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:30.190873 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:30.190720 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:30.190873 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:30.190829 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:31.190931 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:31.190890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:31.191366 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:31.191028 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:32.190177 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:32.190092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:32.190177 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:32.190118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:32.190380 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:32.190243 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:32.190380 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:32.190356 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:33.190530 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:33.190496 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:33.190983 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:33.190639 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:34.190333 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:34.190293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:34.190532 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:34.190433 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:34.190783 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:34.190308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:34.190783 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:34.190747 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:35.190564 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:35.190521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:35.190746 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.190639 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:35.832827 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:35.832786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:35.833449 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.832959 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:35.833449 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.832986 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:35.833449 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.832999 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:35.833449 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.833072 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:51.833053318 +0000 UTC m=+33.157959462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:35.933881 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:35.933838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:35.934051 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:35.933917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:35.934051 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.933960 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:35.934051 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.934018 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:35.934051 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.934044 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:51.934024697 +0000 UTC m=+33.258930820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:35.934280 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:35.934082 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:55:51.934064217 +0000 UTC m=+33.258970346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:36.190789 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:36.190754 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:36.190977 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:36.190754 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:36.190977 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:36.190895 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:36.190977 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:36.190966 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:37.190753 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:37.190706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:37.191333 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:37.190856 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:38.190440 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:38.190404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:38.190628 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:38.190404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:38.190628 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:38.190557 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:38.190628 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:38.190587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:39.190810 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:39.190779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:39.191165 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:39.190864 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:40.191272 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.190954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:40.191972 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.191023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:40.191972 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:40.191378 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:40.191972 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:40.191432 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:40.384905 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.384866 2575 generic.go:356] "Generic (PLEG): container finished" podID="add0be35-d68a-4e03-9f2f-f1c4095e5d05" containerID="2ed5b58a7e6c813c0b5d9c85845338a4f2c824cc0424f89b8f8f7729c58d5e07" exitCode=0 Sep 08 03:55:40.385068 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.384954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerDied","Data":"2ed5b58a7e6c813c0b5d9c85845338a4f2c824cc0424f89b8f8f7729c58d5e07"} Sep 08 03:55:40.386508 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.386485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" event={"ID":"366691a5-dc3c-4c66-898d-82092dc8e352","Type":"ContainerStarted","Data":"424788d1e644432d19e83fd0c89900fc1e86bc9b89457d43fcfde250b846547d"} Sep 08 03:55:40.388076 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.388059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" event={"ID":"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb","Type":"ContainerStarted","Data":"8ffcb31e5e8e297d7206a3950b4f820401952ffb1f8dae3689a49527ee703522"} Sep 08 03:55:40.389418 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.389397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bb7s2" event={"ID":"c6b5053a-e0f8-42e8-9447-c8b2ed122699","Type":"ContainerStarted","Data":"9a4cc001a3aa84bca55772831ab01e79e4bc0257d2de1570abe9b09225c4c3da"} Sep 08 03:55:40.392344 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 03:55:40.392693 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392677 2575 generic.go:356] "Generic (PLEG): container finished" podID="7970b43e-05ca-481d-be96-a9e804fe0c69" containerID="deb51f398f54a56fcfef51375e829a81e3dae9c988ee091208949a1243af270f" exitCode=1 Sep 08 03:55:40.392762 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392742 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"594914f29d9a512c5d865bc91e987b44d327cea2dcb7e47e4f287c6cd60d44eb"} Sep 08 03:55:40.392821 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"512b09a603248056352723e01e5b982fcac118ec2016e05f10098ee83bef71ee"} Sep 08 03:55:40.392862 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"fb64acd16af9d3b3cdb4b91303a80668ed1a9e5a8fd19eea0842a8fbc53de741"} Sep 08 03:55:40.392896 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392883 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"33655343f7b7965279385af761d6a4c9304a0ea14effdebd0301b3e363f19bb2"} Sep 08 03:55:40.392936 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerDied","Data":"deb51f398f54a56fcfef51375e829a81e3dae9c988ee091208949a1243af270f"} Sep 08 03:55:40.393011 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.392999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"27807a231cc35cf20c7612296ada2381bc005044986114855f1f9ff5d051fdea"} Sep 08 03:55:40.394030 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.394009 2575 generic.go:356] "Generic (PLEG): container finished" podID="4ec0f30b70bc436a632aa50f292eb2d0" containerID="7dd19308f06abda2cbb645abe253a9a4a098589c4664d1cd58b7a6ceef393217" exitCode=0 Sep 08 03:55:40.394104 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.394082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" event={"ID":"4ec0f30b70bc436a632aa50f292eb2d0","Type":"ContainerDied","Data":"7dd19308f06abda2cbb645abe253a9a4a098589c4664d1cd58b7a6ceef393217"} Sep 08 03:55:40.395529 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.395509 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" event={"ID":"1359749daf4e4b7415802bb044b0e39e","Type":"ContainerStarted","Data":"bec5e6323a5bd1f00e2e1dccc43cf6cf5a2bd4b2e127e8788e3bacbb185de76e"} Sep 08 03:55:40.396974 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.396952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcr5v" event={"ID":"1c417235-1d24-4eb4-90e7-b7ac62c2ac3e","Type":"ContainerStarted","Data":"10616fa2256bbf5ade9cf639d999e1fe578409ecbce7ef2a748b8468b747606f"} Sep 08 03:55:40.398464 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.398437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2c44c" event={"ID":"49c41524-b3c6-482f-8e85-3a0040fa51a6","Type":"ContainerStarted","Data":"3a672661d453dbe32ea345880448be24e6fa8e174838db3532343f613dd1e606"} Sep 08 03:55:40.399857 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.399837 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vgwcg" event={"ID":"a7d0814b-6a60-465b-aeb6-cbc2db866eb4","Type":"ContainerStarted","Data":"5f4ad84d54d27228fa43252d6a403ab7c8a7723b9422de447c25eebff86c72ed"} Sep 08 03:55:40.427401 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.427353 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vgwcg" podStartSLOduration=2.016040224 podStartE2EDuration="21.427335057s" totalImagesPullingTime="19.411294833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:40.427114539 +0000 UTC m=+21.752020684" watchObservedRunningTime="2026-09-08 03:55:40.427335057 +0000 UTC m=+21.752241203" Sep 08 03:55:40.460892 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.460841 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-231.ec2.internal" podStartSLOduration=20.460823975 podStartE2EDuration="20.460823975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:40.460372338 +0000 UTC m=+21.785278483" watchObservedRunningTime="2026-09-08 03:55:40.460823975 +0000 UTC m=+21.785730120" Sep 08 03:55:40.475957 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.475915 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bb7s2" podStartSLOduration=2.708322301 podStartE2EDuration="21.475900484s" totalImagesPullingTime="18.767578183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:40.475395307 +0000 UTC m=+21.800301453" watchObservedRunningTime="2026-09-08 03:55:40.475900484 +0000 UTC m=+21.800806629" Sep 08 03:55:40.500318 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.500272 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2c44c" podStartSLOduration=2.742882866 podStartE2EDuration="21.500252247s" totalImagesPullingTime="18.757369381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:40.500232275 +0000 UTC m=+21.825138423" watchObservedRunningTime="2026-09-08 03:55:40.500252247 +0000 UTC m=+21.825158393" Sep 08 03:55:40.576172 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.576109 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v4hvn" podStartSLOduration=2.853318548 podStartE2EDuration="21.57608859s" totalImagesPullingTime="18.722770042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:40.53537334 +0000 UTC m=+21.860279486" watchObservedRunningTime="2026-09-08 03:55:40.57608859 +0000 UTC m=+21.900994736" Sep 08 03:55:40.601956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.601917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:40.697387 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:40.697361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.031402 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.031370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.110620 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.110548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.190385 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.190351 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:41.190545 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:41.190471 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:41.211016 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.210973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.330553 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.330515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.405409 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.405140 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" event={"ID":"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb","Type":"ContainerStarted","Data":"79406f877fcece3c482ea2165abae3fdff999c32bb943d7e96dfda82a0bc1431"} Sep 08 03:55:41.408851 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.408824 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 03:55:41.408851 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.408821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" event={"ID":"4ec0f30b70bc436a632aa50f292eb2d0","Type":"ContainerStarted","Data":"851a92ac31f52a1a5c0d467d24bc398f9b4bf1d8cb3174b903efb532fb470060"} Sep 08 03:55:41.410817 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.410779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9s4l" event={"ID":"676d5752-f4b4-4f4f-acff-cc658c23696e","Type":"ContainerStarted","Data":"326027171d20549e0d2329b4d440eca323a1a4d0a7c9a510c019d3b6fefeea1d"} Sep 08 03:55:41.421813 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.421789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.432450 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.432406 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xcr5v" podStartSLOduration=3.75920545 podStartE2EDuration="22.432391787s" totalImagesPullingTime="18.673186337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:40.575779571 +0000 UTC m=+21.900685717" watchObservedRunningTime="2026-09-08 03:55:41.432391787 +0000 UTC m=+22.757297932" Sep 08 03:55:41.432575 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.432482 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-231.ec2.internal" podStartSLOduration=21.432478749 podStartE2EDuration="21.432478749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:41.431858355 +0000 UTC m=+22.756764503" watchObservedRunningTime="2026-09-08 03:55:41.432478749 +0000 UTC m=+22.757384893" Sep 08 03:55:41.451039 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.450982 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h9s4l" podStartSLOduration=3.752054013 podStartE2EDuration="22.450967813s" totalImagesPullingTime="18.6989138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:41.450184818 +0000 UTC m=+22.775090957" watchObservedRunningTime="2026-09-08 03:55:41.450967813 +0000 UTC m=+22.775873958" Sep 08 03:55:41.523417 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.523386 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.624320 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.624211 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.913714 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.913681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:41.986525 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:41.986497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:42.168835 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.168637 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T03:55:41.408845313Z","UUID":"8788fa96-1923-48ca-ab77-3a53c0d03483","Handler":null,"Name":"","Endpoint":""} Sep 08 03:55:42.170272 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.170253 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 03:55:42.170399 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.170284 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 03:55:42.190508 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.190482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:42.190693 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.190544 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:42.190693 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:42.190647 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:42.191000 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:42.190974 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:42.690292 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.690213 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:42.794061 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:42.794023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:43.103192 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.103118 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:43.163874 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.163840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:43.191067 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.191034 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:43.191238 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:43.191171 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:43.421301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.421073 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" event={"ID":"1f4e4517-e3b8-452f-a5ee-65d9709ebcbb","Type":"ContainerStarted","Data":"947b01df6c72f39ba0cafb1335139a2d2c365b9cd20dda79a392232aec18b8a3"} Sep 08 03:55:43.425327 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.425304 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 03:55:43.425761 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.425724 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"af34d20d395a0f362de4bf6a66c14462ad83de57f6f4f57f429de80a277ae93a"} Sep 08 03:55:43.441847 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:43.441791 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gml98" podStartSLOduration=3.4116186600000002 podStartE2EDuration="24.441775618s" totalImagesPullingTime="21.030156958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:43.441519297 +0000 UTC m=+24.766425443" watchObservedRunningTime="2026-09-08 03:55:43.441775618 +0000 UTC m=+24.766681762" Sep 08 03:55:44.190549 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.190512 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:44.191028 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.190556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:44.191028 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:44.190649 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:44.191028 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:44.190766 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:44.272486 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.272446 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:44.273135 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.273107 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:44.428916 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.428807 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:44.429128 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.429104 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2c44c" Sep 08 03:55:44.496708 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.496682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:44.598128 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.598072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:44.681770 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:44.681732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:45.013146 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.013116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:45.115819 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.115777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:45.190052 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.190020 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:45.190205 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:45.190152 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:45.434470 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.434330 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 03:55:45.434902 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.434865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"3899326f8f555a3a9469bc1c1d2573f5016325187a3edabfb1652bbbb2be8884"} Sep 08 03:55:45.435240 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.435165 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:45.435353 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.435263 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:45.435353 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.435344 2575 scope.go:117] "RemoveContainer" containerID="deb51f398f54a56fcfef51375e829a81e3dae9c988ee091208949a1243af270f" Sep 08 03:55:45.450784 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:45.450758 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:46.190633 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.190596 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:46.190804 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.190607 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:46.190804 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:46.190719 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:46.190804 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:46.190788 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:46.438710 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.438641 2575 generic.go:356] "Generic (PLEG): container finished" podID="add0be35-d68a-4e03-9f2f-f1c4095e5d05" containerID="22b1e14caf254a350c870139855ea387c6cf7d4df9b62224a6cbcaf5c839bee8" exitCode=0 Sep 08 03:55:46.439244 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.438723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerDied","Data":"22b1e14caf254a350c870139855ea387c6cf7d4df9b62224a6cbcaf5c839bee8"} Sep 08 03:55:46.442881 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.442862 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 03:55:46.443460 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.443430 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" event={"ID":"7970b43e-05ca-481d-be96-a9e804fe0c69","Type":"ContainerStarted","Data":"1e41b51cc171bf53ef16bd95804e152197d521aaf533b14706c657e1b8d1a870"} Sep 08 03:55:46.443672 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.443643 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:46.459089 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.459061 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:55:46.507156 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.507104 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" podStartSLOduration=8.648712742 podStartE2EDuration="27.50708799s" totalImagesPullingTime="18.858375248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:46.507083655 +0000 UTC m=+27.831989800" watchObservedRunningTime="2026-09-08 03:55:46.50708799 +0000 UTC m=+27.831994118" Sep 08 03:55:46.677777 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.677741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:46.766922 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:46.766830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:47.191117 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.190926 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:47.191117 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:47.191054 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:47.448427 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.448121 2575 generic.go:356] "Generic (PLEG): container finished" podID="add0be35-d68a-4e03-9f2f-f1c4095e5d05" containerID="bee5a033cf05458a6e90c64e33b0773073a4eaad0190bfb0cb86f5be56002e01" exitCode=0 Sep 08 03:55:47.448427 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.448177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerDied","Data":"bee5a033cf05458a6e90c64e33b0773073a4eaad0190bfb0cb86f5be56002e01"} Sep 08 03:55:47.460134 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.460110 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hctvp"] Sep 08 03:55:47.460266 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.460200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:47.460316 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:47.460280 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:47.469370 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.469335 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qcndh"] Sep 08 03:55:47.469518 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.469458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:47.469993 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:47.469617 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:47.471327 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.470615 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2r5kl"] Sep 08 03:55:47.473420 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:47.470826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:47.473420 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:47.472802 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:48.452538 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:48.452505 2575 generic.go:356] "Generic (PLEG): container finished" podID="add0be35-d68a-4e03-9f2f-f1c4095e5d05" containerID="852284f6638d489c4d6070e34fdb48ee7e359fd03519a4149f1c099efd5f5d63" exitCode=0 Sep 08 03:55:48.452995 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:48.452590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerDied","Data":"852284f6638d489c4d6070e34fdb48ee7e359fd03519a4149f1c099efd5f5d63"} Sep 08 03:55:49.191251 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:49.191216 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:49.191412 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:49.191325 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:49.191772 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:49.191742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:49.191868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:49.191846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:49.191916 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:49.191859 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:49.191969 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:49.191917 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:51.190127 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:51.190080 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:51.190601 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:51.190080 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:51.190601 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.190220 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:55:51.190601 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:51.190089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:51.190601 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.190268 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r5kl" podUID="18f168d0-4eff-4fff-babb-9ed38bb788bc" Sep 08 03:55:51.190601 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.190377 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hctvp" podUID="124fa202-0592-4502-8e55-ca1f17ba9509" Sep 08 03:55:51.841619 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:51.841575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:51.841827 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.841770 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:51.841827 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.841793 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:51.841827 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.841803 2575 projected.go:196] Error preparing data for projected volume kube-api-access-qvs6w for pod openshift-network-diagnostics/network-check-target-hctvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:51.841986 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.841853 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w podName:124fa202-0592-4502-8e55-ca1f17ba9509 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:23.841840194 +0000 UTC m=+65.166746322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvs6w" (UniqueName: "kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w") pod "network-check-target-hctvp" (UID: "124fa202-0592-4502-8e55-ca1f17ba9509") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:51.942907 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:51.942873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:51.943101 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:51.942941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:51.943101 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.942999 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:51.943101 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.943066 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:51.943228 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.943073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret podName:18f168d0-4eff-4fff-babb-9ed38bb788bc nodeName:}" failed. No retries permitted until 2026-09-08 03:56:23.943056975 +0000 UTC m=+65.267963102 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret") pod "global-pull-secret-syncer-2r5kl" (UID: "18f168d0-4eff-4fff-babb-9ed38bb788bc") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:51.943228 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:51.943132 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:23.943114166 +0000 UTC m=+65.268020290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:52.515702 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.515652 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-231.ec2.internal" event="NodeReady" Sep 08 03:55:52.516053 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.515795 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 03:55:52.580542 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.580510 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wktgd"] Sep 08 03:55:52.590113 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.590091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.591826 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.591802 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hc6t9"] Sep 08 03:55:52.595594 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.595573 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 03:55:52.595838 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.595823 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cprn7\"" Sep 08 03:55:52.595918 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.595846 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 03:55:52.595978 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.595955 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 03:55:52.602775 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.602753 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wktgd"] Sep 08 03:55:52.602867 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.602842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.605326 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.605310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 03:55:52.605758 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.605741 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 03:55:52.605906 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.605886 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sl2fz\"" Sep 08 03:55:52.617027 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.617004 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hc6t9"] Sep 08 03:55:52.651503 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.649167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjvmk\" (UniqueName: \"kubernetes.io/projected/c08abbc2-d329-401d-9a50-c12cd0fad961-kube-api-access-pjvmk\") pod \"ingress-canary-wktgd\" (UID: \"c08abbc2-d329-401d-9a50-c12cd0fad961\") " pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.651503 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.649225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127ab4d5-3d69-495a-affe-2503d0061675-tmp-dir\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.651503 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.649272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/127ab4d5-3d69-495a-affe-2503d0061675-config-volume\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.651503 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.649350 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08abbc2-d329-401d-9a50-c12cd0fad961-cert\") pod \"ingress-canary-wktgd\" (UID: \"c08abbc2-d329-401d-9a50-c12cd0fad961\") " pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.651503 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.649378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgw9\" (UniqueName: \"kubernetes.io/projected/127ab4d5-3d69-495a-affe-2503d0061675-kube-api-access-8fgw9\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.651503 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.649425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.750261 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjvmk\" (UniqueName: \"kubernetes.io/projected/c08abbc2-d329-401d-9a50-c12cd0fad961-kube-api-access-pjvmk\") pod \"ingress-canary-wktgd\" (UID: \"c08abbc2-d329-401d-9a50-c12cd0fad961\") " pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.750422 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127ab4d5-3d69-495a-affe-2503d0061675-tmp-dir\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.750422 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/127ab4d5-3d69-495a-affe-2503d0061675-config-volume\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.750545 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08abbc2-d329-401d-9a50-c12cd0fad961-cert\") pod \"ingress-canary-wktgd\" (UID: \"c08abbc2-d329-401d-9a50-c12cd0fad961\") " pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.750545 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgw9\" (UniqueName: \"kubernetes.io/projected/127ab4d5-3d69-495a-affe-2503d0061675-kube-api-access-8fgw9\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.750545 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.750702 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127ab4d5-3d69-495a-affe-2503d0061675-tmp-dir\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.750702 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:52.750691 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:52.750805 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:52.750755 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:53.250735711 +0000 UTC m=+34.575641854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:55:52.750867 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.750830 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/127ab4d5-3d69-495a-affe-2503d0061675-config-volume\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.754409 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.754387 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08abbc2-d329-401d-9a50-c12cd0fad961-cert\") pod \"ingress-canary-wktgd\" (UID: \"c08abbc2-d329-401d-9a50-c12cd0fad961\") " pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.767416 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.767267 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjvmk\" (UniqueName: \"kubernetes.io/projected/c08abbc2-d329-401d-9a50-c12cd0fad961-kube-api-access-pjvmk\") pod \"ingress-canary-wktgd\" (UID: \"c08abbc2-d329-401d-9a50-c12cd0fad961\") " pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.768433 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.768407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgw9\" (UniqueName: \"kubernetes.io/projected/127ab4d5-3d69-495a-affe-2503d0061675-kube-api-access-8fgw9\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:52.814948 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.814913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:52.899439 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.899416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wktgd" Sep 08 03:55:52.913352 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:52.913296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:53.190909 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.190833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:55:53.191126 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.190833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:55:53.191126 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.191036 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:55:53.195850 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.195829 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 03:55:53.195982 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.195862 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 03:55:53.197209 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.197194 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 03:55:53.198192 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.198174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 03:55:53.198295 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.198180 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gr9j5\"" Sep 08 03:55:53.200728 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.200710 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzmtk\"" Sep 08 03:55:53.215324 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.215302 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wktgd"] Sep 08 03:55:53.219218 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:55:53.219196 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08abbc2_d329_401d_9a50_c12cd0fad961.slice/crio-42a09ee0f64ae8844e419939c21a1dd194ecb99d657a20f4283e5792b9f0c186 WatchSource:0}: Error finding container 42a09ee0f64ae8844e419939c21a1dd194ecb99d657a20f4283e5792b9f0c186: Status 404 returned error can't find the container with id 42a09ee0f64ae8844e419939c21a1dd194ecb99d657a20f4283e5792b9f0c186 Sep 08 03:55:53.254146 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.254104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:53.254302 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:53.254212 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:53.254302 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:53.254276 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:54.254259706 +0000 UTC m=+35.579165834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:55:53.466528 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.466454 2575 generic.go:356] "Generic (PLEG): container finished" podID="add0be35-d68a-4e03-9f2f-f1c4095e5d05" containerID="6f73e2362c5c7503e7bfadd95545785cb27b8a369360219786fd3526b3b3723f" exitCode=0 Sep 08 03:55:53.466776 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.466516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerDied","Data":"6f73e2362c5c7503e7bfadd95545785cb27b8a369360219786fd3526b3b3723f"} Sep 08 03:55:53.467787 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:53.467768 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wktgd" event={"ID":"c08abbc2-d329-401d-9a50-c12cd0fad961","Type":"ContainerStarted","Data":"42a09ee0f64ae8844e419939c21a1dd194ecb99d657a20f4283e5792b9f0c186"} Sep 08 03:55:54.262634 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:54.262601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:54.263386 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:54.262785 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:54.263386 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:54.262870 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:56.262848208 +0000 UTC m=+37.587754355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:55:54.474385 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:54.474340 2575 generic.go:356] "Generic (PLEG): container finished" podID="add0be35-d68a-4e03-9f2f-f1c4095e5d05" containerID="89a0e2929817959680fddf1c740a6a5bf079bccead98bae4e383ce6ba9c5e9d5" exitCode=0 Sep 08 03:55:54.474579 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:54.474420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerDied","Data":"89a0e2929817959680fddf1c740a6a5bf079bccead98bae4e383ce6ba9c5e9d5"} Sep 08 03:55:55.481546 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:55.481265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x46p8" event={"ID":"add0be35-d68a-4e03-9f2f-f1c4095e5d05","Type":"ContainerStarted","Data":"824ed3de0ea4c2bbf07fb5392d0c49b27c4e1c6dca25e238eb092673167bd09d"} Sep 08 03:55:55.527476 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:55.527424 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x46p8" podStartSLOduration=7.088431791 podStartE2EDuration="36.527407467s" totalImagesPullingTime="29.438975676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:55.525885298 +0000 UTC m=+36.850791446" watchObservedRunningTime="2026-09-08 03:55:55.527407467 +0000 UTC m=+36.852313611" Sep 08 03:55:55.815516 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:55.815396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:55.924408 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:55.924382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:56.278903 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:56.278872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:55:56.279037 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:56.279005 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:56.279075 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:55:56.279067 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:00.279046047 +0000 UTC m=+41.603952172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:55:56.485000 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:56.484912 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wktgd" event={"ID":"c08abbc2-d329-401d-9a50-c12cd0fad961","Type":"ContainerStarted","Data":"b4a0da77514d7744b5550393cb19107ded7505db0758a0928deac600b29a0e47"} Sep 08 03:55:58.061138 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:58.061103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:55:58.148402 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:55:58.148374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:00.307193 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:00.307148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:56:00.307585 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:00.307295 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:56:00.307585 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:00.307353 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:08.307337298 +0000 UTC m=+49.632243431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:56:02.478205 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:02.478173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:02.585726 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:02.585693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:02.712411 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:02.712383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:03.474313 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:03.474276 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:03.595284 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:03.595247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:06.531468 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:06.531431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:06.688727 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:06.688688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:07.414737 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:07.414707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:08.362542 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:08.362498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:56:08.362978 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:08.362647 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:56:08.362978 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:08.362727 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:24.362712077 +0000 UTC m=+65.687618199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:56:14.456607 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:14.456573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:14.556509 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:14.556475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:18.362810 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:18.362778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:18.460364 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:18.460336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:18.463551 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:18.463533 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zvjr" Sep 08 03:56:18.513933 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:18.513872 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wktgd" podStartSLOduration=23.567063183 podStartE2EDuration="26.513855192s" totalImagesPullingTime="2.946792009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:56.531072293 +0000 UTC m=+37.855978438" watchObservedRunningTime="2026-09-08 03:56:18.513855192 +0000 UTC m=+59.838761336" Sep 08 03:56:18.668472 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:18.668439 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:18.788205 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:18.788174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:19.477084 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:19.477053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:19.565709 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:19.565680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:23.864082 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.864034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:56:23.867322 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.867300 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 03:56:23.878916 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.878884 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 03:56:23.888721 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.888693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvs6w\" (UniqueName: \"kubernetes.io/projected/124fa202-0592-4502-8e55-ca1f17ba9509-kube-api-access-qvs6w\") pod \"network-check-target-hctvp\" (UID: \"124fa202-0592-4502-8e55-ca1f17ba9509\") " pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:56:23.964889 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.964836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:56:23.965088 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.964936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:56:23.968802 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.968784 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 03:56:23.968925 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.968908 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 03:56:23.975329 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:23.975308 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 03:56:23.975383 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:23.975373 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:57:27.975356949 +0000 UTC m=+129.300263077 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : secret "metrics-daemon-secret" not found Sep 08 03:56:23.977401 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:23.977382 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f168d0-4eff-4fff-babb-9ed38bb788bc-original-pull-secret\") pod \"global-pull-secret-syncer-2r5kl\" (UID: \"18f168d0-4eff-4fff-babb-9ed38bb788bc\") " pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:56:24.104689 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.104647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gr9j5\"" Sep 08 03:56:24.106751 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.106722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r5kl" Sep 08 03:56:24.110933 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.110910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:56:24.367766 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.367687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:56:24.367986 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:24.367832 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:56:24.367986 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:24.367900 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:56.367882478 +0000 UTC m=+97.692788604 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:56:24.391144 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.391113 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2r5kl"] Sep 08 03:56:24.394807 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:56:24.394784 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f168d0_4eff_4fff_babb_9ed38bb788bc.slice/crio-db9ca068d8f5fdba12a2ca52cb9d7b23f981da0ba0a267ef05a1974c5fca2918 WatchSource:0}: Error finding container db9ca068d8f5fdba12a2ca52cb9d7b23f981da0ba0a267ef05a1974c5fca2918: Status 404 returned error can't find the container with id db9ca068d8f5fdba12a2ca52cb9d7b23f981da0ba0a267ef05a1974c5fca2918 Sep 08 03:56:24.406072 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.406049 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hctvp"] Sep 08 03:56:24.408990 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:56:24.408958 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124fa202_0592_4502_8e55_ca1f17ba9509.slice/crio-1fda4646c908e93fe3071b9739c3543f94b25202df716e11430e639f7c81d287 WatchSource:0}: Error finding container 1fda4646c908e93fe3071b9739c3543f94b25202df716e11430e639f7c81d287: Status 404 returned error can't find the container with id 1fda4646c908e93fe3071b9739c3543f94b25202df716e11430e639f7c81d287 Sep 08 03:56:24.549944 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.549905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2r5kl" event={"ID":"18f168d0-4eff-4fff-babb-9ed38bb788bc","Type":"ContainerStarted","Data":"db9ca068d8f5fdba12a2ca52cb9d7b23f981da0ba0a267ef05a1974c5fca2918"} Sep 08 03:56:24.550988 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:24.550968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hctvp" event={"ID":"124fa202-0592-4502-8e55-ca1f17ba9509","Type":"ContainerStarted","Data":"1fda4646c908e93fe3071b9739c3543f94b25202df716e11430e639f7c81d287"} Sep 08 03:56:29.565765 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:29.565727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2r5kl" event={"ID":"18f168d0-4eff-4fff-babb-9ed38bb788bc","Type":"ContainerStarted","Data":"b412f2118ec701659b2d4e945817453a615c17169da7d4d5accf7a3ed627274a"} Sep 08 03:56:29.567194 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:29.567172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hctvp" event={"ID":"124fa202-0592-4502-8e55-ca1f17ba9509","Type":"ContainerStarted","Data":"b5d86350ea9bbe95eb86c55603cfe39af964133a8713c3f78bee006fd71ac689"} Sep 08 03:56:29.567308 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:29.567298 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:56:29.629704 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:29.629630 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2r5kl" podStartSLOduration=65.974193192 podStartE2EDuration="1m10.629613438s" totalImagesPullingTime="4.655420246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:56:29.60281564 +0000 UTC m=+70.927721785" watchObservedRunningTime="2026-09-08 03:56:29.629613438 +0000 UTC m=+70.954519579" Sep 08 03:56:41.438261 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:41.438140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:41.568465 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:41.568435 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:44.069343 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:44.069309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:56:56.376218 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:56:56.376174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:56:56.376747 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:56.376296 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:56:56.376747 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:56:56.376358 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 03:58:00.376344254 +0000 UTC m=+161.701250378 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:57:00.571279 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:57:00.571246 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hctvp" Sep 08 03:57:00.606324 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:57:00.606261 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hctvp" podStartSLOduration=96.969497164 podStartE2EDuration="1m41.606214194s" totalImagesPullingTime="4.63671703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:56:29.633922048 +0000 UTC m=+70.958828192" watchObservedRunningTime="2026-09-08 03:57:00.606214194 +0000 UTC m=+101.931120340" Sep 08 03:57:09.163459 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:57:09.163413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:57:09.319583 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:57:09.319552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:57:27.987983 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:57:27.987935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:57:27.988469 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:57:27.988069 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 03:57:27.988469 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:57:27.988159 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:29.988144554 +0000 UTC m=+251.313050676 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : secret "metrics-daemon-secret" not found Sep 08 03:57:55.610529 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:57:55.610480 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hc6t9" podUID="127ab4d5-3d69-495a-affe-2503d0061675" Sep 08 03:57:55.780941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:57:55.780914 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hc6t9" Sep 08 03:57:56.211595 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:57:56.211543 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 03:58:00.398390 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:58:00.398331 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 03:58:00.398865 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:58:00.398492 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:58:00.398865 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:58:00.398577 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls podName:127ab4d5-3d69-495a-affe-2503d0061675 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:02.398552868 +0000 UTC m=+283.723458996 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls") pod "dns-default-hc6t9" (UID: "127ab4d5-3d69-495a-affe-2503d0061675") : secret "dns-default-metrics-tls" not found Sep 08 03:58:07.190959 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:58:07.190925 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:59:05.650459 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:05.650411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:09.148362 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:09.148327 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:29.988332 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:29.988268 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 03:59:29.988843 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:29.988410 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 03:59:29.988843 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:29.988481 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs podName:53110014-8f58-4ce0-820b-20aeba80aa90 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:31.988466133 +0000 UTC m=+373.313372259 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs") pod "network-metrics-daemon-qcndh" (UID: "53110014-8f58-4ce0-820b-20aeba80aa90") : secret "metrics-daemon-secret" not found Sep 08 03:59:38.882851 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.882814 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-6qlcn"] Sep 08 03:59:38.885836 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.885816 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:38.889441 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.889413 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"network-check-source-685456655f-6qlcn\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" podUID="323b8297-35f8-4a11-add1-176a65b6df1a" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:38.889813 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.889789 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"network-diagnostics-dockercfg-f65mq\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f65mq\"" type="*v1.Secret" Sep 08 03:59:38.894541 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.894520 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77f987bb9-flstl"] Sep 08 03:59:38.897169 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.897149 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82"] Sep 08 03:59:38.897281 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.897264 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.899869 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.899850 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:38.905968 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.905943 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-6q7g4\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6q7g4\"" type="*v1.Secret" Sep 08 03:59:38.905968 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.905948 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" Sep 08 03:59:38.906108 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.905949 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" Sep 08 03:59:38.907344 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.907324 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" Sep 08 03:59:38.907430 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.907419 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-9whqn\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9whqn\"" type="*v1.Secret" Sep 08 03:59:38.908429 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.908400 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-6qlcn"] Sep 08 03:59:38.909596 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.909569 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-operator-config\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" Sep 08 03:59:38.909809 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.909786 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 08 03:59:38.909913 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.909894 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" Sep 08 03:59:38.909986 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.909919 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" Sep 08 03:59:38.910305 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.910282 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-77f987bb9-flstl\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.911252 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.911228 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 08 03:59:38.912827 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.912800 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"network-check-source-685456655f-6qlcn\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" podUID="323b8297-35f8-4a11-add1-176a65b6df1a" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:38.924621 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:38.924589 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"service-ca-operator-859f94c4b-vgw82\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" podUID="27c480f0-2dd8-4758-abce-7065251e4e48" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:38.935103 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.935073 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82"] Sep 08 03:59:38.944364 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-947sv\" (UniqueName: \"kubernetes.io/projected/323b8297-35f8-4a11-add1-176a65b6df1a-kube-api-access-947sv\") pod \"network-check-source-685456655f-6qlcn\" (UID: \"323b8297-35f8-4a11-add1-176a65b6df1a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:38.944472 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944472 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pkc8\" (UniqueName: \"kubernetes.io/projected/27c480f0-2dd8-4758-abce-7065251e4e48-kube-api-access-2pkc8\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:38.944472 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-bound-sa-token\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944472 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-registry-certificates\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944472 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6687325-60c9-41b4-a847-b2395744d3ec-ca-trust-extracted\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944647 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-trusted-ca\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944647 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944647 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27c480f0-2dd8-4758-abce-7065251e4e48-config\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:38.944647 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-image-registry-private-configuration\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.944647 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c480f0-2dd8-4758-abce-7065251e4e48-serving-cert\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:38.944647 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.944589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7st7v\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-kube-api-access-7st7v\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:38.948320 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:38.948298 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77f987bb9-flstl"] Sep 08 03:59:39.045243 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-image-registry-private-configuration\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045243 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c480f0-2dd8-4758-abce-7065251e4e48-serving-cert\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:39.045461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7st7v\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-kube-api-access-7st7v\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-947sv\" (UniqueName: \"kubernetes.io/projected/323b8297-35f8-4a11-add1-176a65b6df1a-kube-api-access-947sv\") pod \"network-check-source-685456655f-6qlcn\" (UID: \"323b8297-35f8-4a11-add1-176a65b6df1a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:39.045461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045360 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pkc8\" (UniqueName: \"kubernetes.io/projected/27c480f0-2dd8-4758-abce-7065251e4e48-kube-api-access-2pkc8\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:39.045461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-bound-sa-token\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045461 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-registry-certificates\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6687325-60c9-41b4-a847-b2395744d3ec-ca-trust-extracted\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-trusted-ca\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.045720 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27c480f0-2dd8-4758-abce-7065251e4e48-config\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:39.045911 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.045878 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6687325-60c9-41b4-a847-b2395744d3ec-ca-trust-extracted\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.046065 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.046047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-registry-certificates\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.086195 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.086152 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf"] Sep 08 03:59:39.089264 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.089238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-947sv\" (UniqueName: \"kubernetes.io/projected/323b8297-35f8-4a11-add1-176a65b6df1a-kube-api-access-947sv\") pod \"network-check-source-685456655f-6qlcn\" (UID: \"323b8297-35f8-4a11-add1-176a65b6df1a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:39.089428 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.089242 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.107092 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.107068 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 08 03:59:39.107326 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.107309 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:59:39.107412 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.107397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kntsw\"" Sep 08 03:59:39.107543 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.107517 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 08 03:59:39.126487 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.126444 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7st7v\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-kube-api-access-7st7v\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.130294 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.130259 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tzlbw"] Sep 08 03:59:39.133076 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.133035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.142166 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.142147 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 08 03:59:39.144638 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.144619 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 08 03:59:39.144768 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.144748 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:59:39.144835 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.144784 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 08 03:59:39.145823 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.145809 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zw99b\"" Sep 08 03:59:39.146002 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.145986 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.146040 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.146010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045d3f60-0435-48ef-8836-8e0233230c96-trusted-ca\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.146040 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.146030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/045d3f60-0435-48ef-8836-8e0233230c96-config\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.146149 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.146053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzsd\" (UniqueName: \"kubernetes.io/projected/045d3f60-0435-48ef-8836-8e0233230c96-kube-api-access-ktzsd\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.146149 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.146105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/045d3f60-0435-48ef-8836-8e0233230c96-serving-cert\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.146237 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.146151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtlh7\" (UniqueName: \"kubernetes.io/projected/56c40f3a-e5bc-4db6-8702-7f417498908b-kube-api-access-dtlh7\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.165192 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.165163 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf"] Sep 08 03:59:39.166259 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.166237 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-bound-sa-token\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.184309 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.184273 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 08 03:59:39.188787 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.188757 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tzlbw"] Sep 08 03:59:39.246841 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.246808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.246841 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.246842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045d3f60-0435-48ef-8836-8e0233230c96-trusted-ca\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.247055 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.246860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/045d3f60-0435-48ef-8836-8e0233230c96-config\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.247055 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.246886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzsd\" (UniqueName: \"kubernetes.io/projected/045d3f60-0435-48ef-8836-8e0233230c96-kube-api-access-ktzsd\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.247055 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.246914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/045d3f60-0435-48ef-8836-8e0233230c96-serving-cert\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.247055 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.246942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtlh7\" (UniqueName: \"kubernetes.io/projected/56c40f3a-e5bc-4db6-8702-7f417498908b-kube-api-access-dtlh7\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.247055 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:39.246947 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 03:59:39.247055 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:39.247028 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls podName:56c40f3a-e5bc-4db6-8702-7f417498908b nodeName:}" failed. No retries permitted until 2026-09-08 03:59:39.747007804 +0000 UTC m=+261.071913944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nrkwf" (UID: "56c40f3a-e5bc-4db6-8702-7f417498908b") : secret "samples-operator-tls" not found Sep 08 03:59:39.247531 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.247508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/045d3f60-0435-48ef-8836-8e0233230c96-config\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.247801 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.247781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045d3f60-0435-48ef-8836-8e0233230c96-trusted-ca\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.249215 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.249196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/045d3f60-0435-48ef-8836-8e0233230c96-serving-cert\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.271768 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.271737 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtlh7\" (UniqueName: \"kubernetes.io/projected/56c40f3a-e5bc-4db6-8702-7f417498908b-kube-api-access-dtlh7\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.277190 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.277168 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzsd\" (UniqueName: \"kubernetes.io/projected/045d3f60-0435-48ef-8836-8e0233230c96-kube-api-access-ktzsd\") pod \"console-operator-85b454874b-tzlbw\" (UID: \"045d3f60-0435-48ef-8836-8e0233230c96\") " pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.441501 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.441393 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:39.492211 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.492179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:39.634238 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.634203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:39.723611 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.723537 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-tzlbw"] Sep 08 03:59:39.726852 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:59:39.726821 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045d3f60_0435_48ef_8836_8e0233230c96.slice/crio-3d5cf1e2354f20ee170305ae80d207adcaa6c5c04aac9e0fa6fcb2e2fe0804f8 WatchSource:0}: Error finding container 3d5cf1e2354f20ee170305ae80d207adcaa6c5c04aac9e0fa6fcb2e2fe0804f8: Status 404 returned error can't find the container with id 3d5cf1e2354f20ee170305ae80d207adcaa6c5c04aac9e0fa6fcb2e2fe0804f8 Sep 08 03:59:39.749858 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.749832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:39.750008 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:39.749989 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 03:59:39.750060 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:39.750051 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls podName:56c40f3a-e5bc-4db6-8702-7f417498908b nodeName:}" failed. No retries permitted until 2026-09-08 03:59:40.750036734 +0000 UTC m=+262.074942857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nrkwf" (UID: "56c40f3a-e5bc-4db6-8702-7f417498908b") : secret "samples-operator-tls" not found Sep 08 03:59:39.790284 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.790250 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:59:39.810780 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.810744 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 03:59:39.817115 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.817087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-trusted-ca\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:39.930532 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.930498 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 03:59:39.937775 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:39.937754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-image-registry-private-configuration\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:40.004439 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.004360 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9whqn\"" Sep 08 03:59:40.018964 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.018932 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 08 03:59:40.022093 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.022068 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pkc8\" (UniqueName: \"kubernetes.io/projected/27c480f0-2dd8-4758-abce-7065251e4e48-kube-api-access-2pkc8\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:40.033035 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.033009 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" event={"ID":"045d3f60-0435-48ef-8836-8e0233230c96","Type":"ContainerStarted","Data":"3d5cf1e2354f20ee170305ae80d207adcaa6c5c04aac9e0fa6fcb2e2fe0804f8"} Sep 08 03:59:40.037079 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.037062 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 03:59:40.045679 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045645 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:59:40.045679 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045668 2575 secret.go:189] Couldn't get secret openshift-service-ca-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition Sep 08 03:59:40.045679 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045678 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f987bb9-flstl: secret "image-registry-tls" not found Sep 08 03:59:40.045790 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045735 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c480f0-2dd8-4758-abce-7065251e4e48-serving-cert podName:27c480f0-2dd8-4758-abce-7065251e4e48 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:40.545714832 +0000 UTC m=+261.870620972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/27c480f0-2dd8-4758-abce-7065251e4e48-serving-cert") pod "service-ca-operator-859f94c4b-vgw82" (UID: "27c480f0-2dd8-4758-abce-7065251e4e48") : failed to sync secret cache: timed out waiting for the condition Sep 08 03:59:40.045790 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045755 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls podName:b6687325-60c9-41b4-a847-b2395744d3ec nodeName:}" failed. No retries permitted until 2026-09-08 03:59:40.545746261 +0000 UTC m=+261.870652385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls") pod "image-registry-77f987bb9-flstl" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec") : secret "image-registry-tls" not found Sep 08 03:59:40.045790 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045781 2575 configmap.go:193] Couldn't get configMap openshift-service-ca-operator/service-ca-operator-config: failed to sync configmap cache: timed out waiting for the condition Sep 08 03:59:40.045790 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045787 2575 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition Sep 08 03:59:40.045913 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045828 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27c480f0-2dd8-4758-abce-7065251e4e48-config podName:27c480f0-2dd8-4758-abce-7065251e4e48 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:40.545818304 +0000 UTC m=+261.870724432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/27c480f0-2dd8-4758-abce-7065251e4e48-config") pod "service-ca-operator-859f94c4b-vgw82" (UID: "27c480f0-2dd8-4758-abce-7065251e4e48") : failed to sync configmap cache: timed out waiting for the condition Sep 08 03:59:40.045913 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.045844 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets podName:b6687325-60c9-41b4-a847-b2395744d3ec nodeName:}" failed. No retries permitted until 2026-09-08 03:59:40.545836167 +0000 UTC m=+261.870742303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets") pod "image-registry-77f987bb9-flstl" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec") : failed to sync secret cache: timed out waiting for the condition Sep 08 03:59:40.056539 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.056515 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f65mq\"" Sep 08 03:59:40.065011 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.064991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" Sep 08 03:59:40.179258 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.179221 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 03:59:40.262093 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.262026 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 08 03:59:40.340856 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.340820 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-6qlcn"] Sep 08 03:59:40.345186 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:59:40.345157 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323b8297_35f8_4a11_add1_176a65b6df1a.slice/crio-262382ddb8f2f8a7081b54862186626ebd3e494865819cd259f3af42c1410ba8 WatchSource:0}: Error finding container 262382ddb8f2f8a7081b54862186626ebd3e494865819cd259f3af42c1410ba8: Status 404 returned error can't find the container with id 262382ddb8f2f8a7081b54862186626ebd3e494865819cd259f3af42c1410ba8 Sep 08 03:59:40.364852 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.364828 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6q7g4\"" Sep 08 03:59:40.388740 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.388705 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 08 03:59:40.556857 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.556767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:40.556857 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.556830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27c480f0-2dd8-4758-abce-7065251e4e48-config\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:40.557077 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.556896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c480f0-2dd8-4758-abce-7065251e4e48-serving-cert\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:40.557077 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.556939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:40.557077 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.557044 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:59:40.557077 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.557060 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f987bb9-flstl: secret "image-registry-tls" not found Sep 08 03:59:40.557264 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.557128 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls podName:b6687325-60c9-41b4-a847-b2395744d3ec nodeName:}" failed. No retries permitted until 2026-09-08 03:59:41.557108817 +0000 UTC m=+262.882014960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls") pod "image-registry-77f987bb9-flstl" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec") : secret "image-registry-tls" not found Sep 08 03:59:40.557446 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.557419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27c480f0-2dd8-4758-abce-7065251e4e48-config\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:40.559605 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.559570 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27c480f0-2dd8-4758-abce-7065251e4e48-serving-cert\") pod \"service-ca-operator-859f94c4b-vgw82\" (UID: \"27c480f0-2dd8-4758-abce-7065251e4e48\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:40.559732 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.559625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:40.712016 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.711976 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" Sep 08 03:59:40.758343 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:40.758311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:40.758509 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.758440 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 03:59:40.758578 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:40.758510 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls podName:56c40f3a-e5bc-4db6-8702-7f417498908b nodeName:}" failed. No retries permitted until 2026-09-08 03:59:42.758493676 +0000 UTC m=+264.083399802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nrkwf" (UID: "56c40f3a-e5bc-4db6-8702-7f417498908b") : secret "samples-operator-tls" not found Sep 08 03:59:41.006354 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:41.006320 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82"] Sep 08 03:59:41.009842 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:59:41.009799 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c480f0_2dd8_4758_abce_7065251e4e48.slice/crio-50ec7eb93787e16fd61ffa946b0d1e9a791b24c17a1c79a1d6b55dd272e7e41d WatchSource:0}: Error finding container 50ec7eb93787e16fd61ffa946b0d1e9a791b24c17a1c79a1d6b55dd272e7e41d: Status 404 returned error can't find the container with id 50ec7eb93787e16fd61ffa946b0d1e9a791b24c17a1c79a1d6b55dd272e7e41d Sep 08 03:59:41.037532 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:41.037496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" event={"ID":"27c480f0-2dd8-4758-abce-7065251e4e48","Type":"ContainerStarted","Data":"50ec7eb93787e16fd61ffa946b0d1e9a791b24c17a1c79a1d6b55dd272e7e41d"} Sep 08 03:59:41.039301 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:41.039271 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" event={"ID":"323b8297-35f8-4a11-add1-176a65b6df1a","Type":"ContainerStarted","Data":"533aa26bd56b72f719bcf6a1305623e29838d0be1e99bab7b0e287ccec63519d"} Sep 08 03:59:41.039449 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:41.039317 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" event={"ID":"323b8297-35f8-4a11-add1-176a65b6df1a","Type":"ContainerStarted","Data":"262382ddb8f2f8a7081b54862186626ebd3e494865819cd259f3af42c1410ba8"} Sep 08 03:59:41.060778 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:41.060715 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-6qlcn" podStartSLOduration=3.060698156 podStartE2EDuration="3.060698156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:59:41.059631237 +0000 UTC m=+262.384537383" watchObservedRunningTime="2026-09-08 03:59:41.060698156 +0000 UTC m=+262.385604301" Sep 08 03:59:41.564707 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:41.564650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:41.564910 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:41.564793 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:59:41.564910 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:41.564821 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f987bb9-flstl: secret "image-registry-tls" not found Sep 08 03:59:41.564910 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:41.564888 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls podName:b6687325-60c9-41b4-a847-b2395744d3ec nodeName:}" failed. No retries permitted until 2026-09-08 03:59:43.564865637 +0000 UTC m=+264.889771823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls") pod "image-registry-77f987bb9-flstl" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec") : secret "image-registry-tls" not found Sep 08 03:59:42.044128 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.044099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/0.log" Sep 08 03:59:42.044626 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.044147 2575 generic.go:356] "Generic (PLEG): container finished" podID="045d3f60-0435-48ef-8836-8e0233230c96" containerID="2a4a90a39a1ebb5ca51d8139e10ec7fa4a8b74b2b5a55d9859ec594f1114ff67" exitCode=255 Sep 08 03:59:42.044626 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.044184 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" event={"ID":"045d3f60-0435-48ef-8836-8e0233230c96","Type":"ContainerDied","Data":"2a4a90a39a1ebb5ca51d8139e10ec7fa4a8b74b2b5a55d9859ec594f1114ff67"} Sep 08 03:59:42.044626 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.044485 2575 scope.go:117] "RemoveContainer" containerID="2a4a90a39a1ebb5ca51d8139e10ec7fa4a8b74b2b5a55d9859ec594f1114ff67" Sep 08 03:59:42.774176 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.774137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:42.774371 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:42.774283 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 03:59:42.774371 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:42.774366 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls podName:56c40f3a-e5bc-4db6-8702-7f417498908b nodeName:}" failed. No retries permitted until 2026-09-08 03:59:46.774346109 +0000 UTC m=+268.099252233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nrkwf" (UID: "56c40f3a-e5bc-4db6-8702-7f417498908b") : secret "samples-operator-tls" not found Sep 08 03:59:42.889344 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.889305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:42.994267 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:42.994236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:43.050117 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.050065 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/1.log" Sep 08 03:59:43.050574 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.050555 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/0.log" Sep 08 03:59:43.050619 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.050600 2575 generic.go:356] "Generic (PLEG): container finished" podID="045d3f60-0435-48ef-8836-8e0233230c96" containerID="cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e" exitCode=255 Sep 08 03:59:43.050687 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.050670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" event={"ID":"045d3f60-0435-48ef-8836-8e0233230c96","Type":"ContainerDied","Data":"cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e"} Sep 08 03:59:43.050801 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.050787 2575 scope.go:117] "RemoveContainer" containerID="2a4a90a39a1ebb5ca51d8139e10ec7fa4a8b74b2b5a55d9859ec594f1114ff67" Sep 08 03:59:43.051052 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.051036 2575 scope.go:117] "RemoveContainer" containerID="cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e" Sep 08 03:59:43.051243 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:43.051224 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tzlbw_openshift-console-operator(045d3f60-0435-48ef-8836-8e0233230c96)\"" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podUID="045d3f60-0435-48ef-8836-8e0233230c96" Sep 08 03:59:43.580060 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.580018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:43.580261 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:43.580151 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:59:43.580261 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:43.580167 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f987bb9-flstl: secret "image-registry-tls" not found Sep 08 03:59:43.580261 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:43.580232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls podName:b6687325-60c9-41b4-a847-b2395744d3ec nodeName:}" failed. No retries permitted until 2026-09-08 03:59:47.580213329 +0000 UTC m=+268.905119453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls") pod "image-registry-77f987bb9-flstl" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec") : secret "image-registry-tls" not found Sep 08 03:59:43.989945 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:43.989887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.056042 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.056017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/1.log" Sep 08 03:59:44.056442 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.056411 2575 scope.go:117] "RemoveContainer" containerID="cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e" Sep 08 03:59:44.056592 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:44.056571 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tzlbw_openshift-console-operator(045d3f60-0435-48ef-8836-8e0233230c96)\"" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podUID="045d3f60-0435-48ef-8836-8e0233230c96" Sep 08 03:59:44.057627 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.057596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" event={"ID":"27c480f0-2dd8-4758-abce-7065251e4e48","Type":"ContainerStarted","Data":"d70bb7352edd7a2758ac8099966fd1effa4f70f1ab0dcffd98735d8e4026d2a9"} Sep 08 03:59:44.101430 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.101397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.106538 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.106493 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" podStartSLOduration=4.08525078 podStartE2EDuration="6.106471388s" totalImagesPullingTime="2.021220608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:59:44.106212362 +0000 UTC m=+265.431118508" watchObservedRunningTime="2026-09-08 03:59:44.106471388 +0000 UTC m=+265.431377532" Sep 08 03:59:44.440023 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.439993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.540916 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.540885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.673687 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.673610 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.776322 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.776239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.797223 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.797189 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6xvqj"] Sep 08 03:59:44.800470 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.800453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.807923 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.807903 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 03:59:44.808217 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.808198 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 03:59:44.808627 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.808611 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h24jh\"" Sep 08 03:59:44.809395 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.809380 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 03:59:44.809465 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.809397 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 03:59:44.825392 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.825362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xvqj"] Sep 08 03:59:44.871646 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.871608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:44.891793 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.891762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-crio-socket\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.891939 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.891835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.891939 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.891857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.891939 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.891873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-data-volume\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.891939 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.891907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chck6\" (UniqueName: \"kubernetes.io/projected/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-api-access-chck6\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993080 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993080 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-data-volume\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chck6\" (UniqueName: \"kubernetes.io/projected/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-api-access-chck6\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-crio-socket\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:44.993173 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:44.993216 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:44.993239 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:45.493220578 +0000 UTC m=+266.818126700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : configmap "kube-rbac-proxy" not found Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993271 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-crio-socket\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:44.993335 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:44.993285 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:45.493267618 +0000 UTC m=+266.818173748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:44.993600 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:44.993461 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-data-volume\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:45.004038 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:45.004011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chck6\" (UniqueName: \"kubernetes.io/projected/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-api-access-chck6\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:45.050691 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:45.050599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:45.161085 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:45.161048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:45.262547 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:45.262514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:45.497920 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:45.497871 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:45.498097 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:45.498016 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:45.498097 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:45.498049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:45.498097 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:45.498095 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:46.498073959 +0000 UTC m=+267.822980097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : configmap "kube-rbac-proxy" not found Sep 08 03:59:45.498264 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:45.498150 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:45.498264 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:45.498208 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:46.498195526 +0000 UTC m=+267.823101666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:46.505904 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:46.505855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:46.505904 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:46.505901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:46.506325 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:46.506004 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:46.506325 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:46.506068 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:48.506054033 +0000 UTC m=+269.830960156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:46.506325 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:46.506098 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:46.506325 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:46.506157 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:48.506144193 +0000 UTC m=+269.831050315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : configmap "kube-rbac-proxy" not found Sep 08 03:59:46.807755 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:46.807644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:46.807918 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:46.807801 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 03:59:46.807918 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:46.807864 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls podName:56c40f3a-e5bc-4db6-8702-7f417498908b nodeName:}" failed. No retries permitted until 2026-09-08 03:59:54.807849239 +0000 UTC m=+276.132755373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nrkwf" (UID: "56c40f3a-e5bc-4db6-8702-7f417498908b") : secret "samples-operator-tls" not found Sep 08 03:59:46.852381 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:46.852348 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:46.939592 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:46.939565 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcr5v_1c417235-1d24-4eb4-90e7-b7ac62c2ac3e/dns-node-resolver/0.log" Sep 08 03:59:46.956790 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:46.956764 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:47.612826 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:47.612787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:47.613215 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:47.612898 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:59:47.613215 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:47.612911 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77f987bb9-flstl: secret "image-registry-tls" not found Sep 08 03:59:47.613215 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:47.612963 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls podName:b6687325-60c9-41b4-a847-b2395744d3ec nodeName:}" failed. No retries permitted until 2026-09-08 03:59:55.612949771 +0000 UTC m=+276.937855895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls") pod "image-registry-77f987bb9-flstl" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec") : secret "image-registry-tls" not found Sep 08 03:59:47.746754 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:47.746724 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bb7s2_c6b5053a-e0f8-42e8-9447-c8b2ed122699/node-ca/0.log" Sep 08 03:59:48.151395 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:48.151358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:48.519956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:48.519872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:48.519956 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:48.519908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:48.520183 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:48.520020 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:48.520183 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:48.520019 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:48.520183 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:48.520066 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:52.520054055 +0000 UTC m=+273.844960178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:48.520183 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:48.520150 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 03:59:52.520129521 +0000 UTC m=+273.845035651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : configmap "kube-rbac-proxy" not found Sep 08 03:59:48.741537 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:48.741501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wktgd_c08abbc2-d329-401d-9a50-c12cd0fad961/serve-healthcheck-canary/0.log" Sep 08 03:59:49.442385 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:49.442339 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:49.442565 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:49.442401 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 03:59:49.442756 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:49.442742 2575 scope.go:117] "RemoveContainer" containerID="cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e" Sep 08 03:59:49.442907 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:49.442889 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-tzlbw_openshift-console-operator(045d3f60-0435-48ef-8836-8e0233230c96)\"" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podUID="045d3f60-0435-48ef-8836-8e0233230c96" Sep 08 03:59:50.541565 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:50.541534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:50.698822 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:50.698788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:50.866098 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:50.866024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:51.077430 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:51.077397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:51.259581 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:51.259547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:51.392564 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:51.392530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:51.953729 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:51.953695 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:52.336712 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:52.336621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:52.550879 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:52.550842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:52.550879 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:52.550878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 03:59:52.551078 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:52.550971 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:52.551078 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:52.551008 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:52.551078 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:52.551039 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 04:00:00.551022311 +0000 UTC m=+281.875928434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : configmap "kube-rbac-proxy" not found Sep 08 03:59:52.551078 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:52.551059 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls podName:2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e nodeName:}" failed. No retries permitted until 2026-09-08 04:00:00.55104701 +0000 UTC m=+281.875953133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xvqj" (UID: "2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:52.577639 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:52.577602 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:52.965085 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:52.965044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:53.730632 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:53.730590 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:53.810136 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:53.810091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:53.935941 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:53.935912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:54.142475 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:54.142447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:54.343040 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:54.343009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:54.515868 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:54.515787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:54.830516 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:54.830433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:54.869953 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:54.869922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:54.872379 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:54.872356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c40f3a-e5bc-4db6-8702-7f417498908b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nrkwf\" (UID: \"56c40f3a-e5bc-4db6-8702-7f417498908b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:55.000726 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.000684 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" Sep 08 03:59:55.142331 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.142305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:55.277032 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.277002 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf"] Sep 08 03:59:55.676368 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.676333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:55.678779 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.678748 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"image-registry-77f987bb9-flstl\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:55.706521 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.706468 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:55.786700 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.786670 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:55.948278 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.948199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:55.988025 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:55.987992 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77f987bb9-flstl"] Sep 08 03:59:55.991929 ip-10-0-131-231 kubenswrapper[2575]: W0908 03:59:55.991904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6687325_60c9_41b4_a847_b2395744d3ec.slice/crio-c61e5bc8bbe5a8374710a2a1f0e6e078630aad5e64fc5c0b0ae9c5afd82d9ee2 WatchSource:0}: Error finding container c61e5bc8bbe5a8374710a2a1f0e6e078630aad5e64fc5c0b0ae9c5afd82d9ee2: Status 404 returned error can't find the container with id c61e5bc8bbe5a8374710a2a1f0e6e078630aad5e64fc5c0b0ae9c5afd82d9ee2 Sep 08 03:59:56.095501 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.095457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f987bb9-flstl" event={"ID":"b6687325-60c9-41b4-a847-b2395744d3ec","Type":"ContainerStarted","Data":"ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853"} Sep 08 03:59:56.095709 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.095526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f987bb9-flstl" event={"ID":"b6687325-60c9-41b4-a847-b2395744d3ec","Type":"ContainerStarted","Data":"c61e5bc8bbe5a8374710a2a1f0e6e078630aad5e64fc5c0b0ae9c5afd82d9ee2"} Sep 08 03:59:56.095709 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.095555 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 03:59:56.096988 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.096962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" event={"ID":"56c40f3a-e5bc-4db6-8702-7f417498908b","Type":"ContainerStarted","Data":"566ae1efcfc3a9ddcc187de56dd8148b6983f1ec866a45372c8bf15c5d502908"} Sep 08 03:59:56.115539 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.115474 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77f987bb9-flstl" podStartSLOduration=18.115453319 podStartE2EDuration="18.115453319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:59:56.115074214 +0000 UTC m=+277.439980360" watchObservedRunningTime="2026-09-08 03:59:56.115453319 +0000 UTC m=+277.440359465" Sep 08 03:59:56.360925 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.360850 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:56.533602 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.533568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:56.985164 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:56.985133 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:57.102734 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:57.102698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" event={"ID":"56c40f3a-e5bc-4db6-8702-7f417498908b","Type":"ContainerStarted","Data":"9cd3ae0a8a4fed1c2ac1f5c739d7d0b093dcce4a8113a7539525b36ae00b1561"} Sep 08 03:59:57.192699 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:57.192650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:57.312314 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:57.312221 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:57.743126 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:57.743088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:57.942535 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:57.942488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:58.107638 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:58.107551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" event={"ID":"56c40f3a-e5bc-4db6-8702-7f417498908b","Type":"ContainerStarted","Data":"031bd4c3c2715c63b0dd93b7ea05761e7bc197bcaaf7adc79c8552ba48c521b7"} Sep 08 03:59:58.139290 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:58.139239 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nrkwf" podStartSLOduration=18.458627048 podStartE2EDuration="20.139224203s" totalImagesPullingTime="1.680597155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:59:58.137253035 +0000 UTC m=+279.462159179" watchObservedRunningTime="2026-09-08 03:59:58.139224203 +0000 UTC m=+279.464130348" Sep 08 03:59:58.192777 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:58.192747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:58.545499 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:58.545468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:58.781805 ip-10-0-131-231 kubenswrapper[2575]: E0908 03:59:58.781766 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hc6t9" podUID="127ab4d5-3d69-495a-affe-2503d0061675" Sep 08 03:59:59.110556 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:59.110513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hc6t9" Sep 08 03:59:59.176969 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:59.176939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:59.573143 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:59.573113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 03:59:59.740882 ip-10-0-131-231 kubenswrapper[2575]: I0908 03:59:59.740849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:00.389540 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.389510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:00.608623 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.608587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:00.612792 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.612769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 04:00:00.612858 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.612801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 04:00:00.613285 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.613263 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 04:00:00.615056 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.615035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xvqj\" (UID: \"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e\") " pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 04:00:00.709396 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.709290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xvqj" Sep 08 04:00:00.806091 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.806062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:00.993909 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:00.993816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:01.004131 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:01.004101 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xvqj"] Sep 08 04:00:01.007694 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:01.007672 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2573afe7_a55f_4ce5_9a1b_4afc95ea3c9e.slice/crio-7df393008f14e0e40ac36f6975eed40d8cb72cfd0f5b75df3e3485ed7da52530 WatchSource:0}: Error finding container 7df393008f14e0e40ac36f6975eed40d8cb72cfd0f5b75df3e3485ed7da52530: Status 404 returned error can't find the container with id 7df393008f14e0e40ac36f6975eed40d8cb72cfd0f5b75df3e3485ed7da52530 Sep 08 04:00:01.118864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:01.118823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xvqj" event={"ID":"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e","Type":"ContainerStarted","Data":"a9b46bb0a53c125023e01ab2ce23df91bb364584ba3aedf5480f1c87fe9d43cb"} Sep 08 04:00:01.119028 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:01.118893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xvqj" event={"ID":"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e","Type":"ContainerStarted","Data":"7df393008f14e0e40ac36f6975eed40d8cb72cfd0f5b75df3e3485ed7da52530"} Sep 08 04:00:01.287606 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:01.287529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:01.928671 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:01.928625 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:02.190818 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.190736 2575 scope.go:117] "RemoveContainer" containerID="cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e" Sep 08 04:00:02.221395 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.221368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:02.427163 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.427121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 04:00:02.429627 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.429602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/127ab4d5-3d69-495a-affe-2503d0061675-metrics-tls\") pod \"dns-default-hc6t9\" (UID: \"127ab4d5-3d69-495a-affe-2503d0061675\") " pod="openshift-dns/dns-default-hc6t9" Sep 08 04:00:02.716060 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.716024 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sl2fz\"" Sep 08 04:00:02.722320 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.722301 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hc6t9" Sep 08 04:00:02.998116 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:02.998081 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hc6t9"] Sep 08 04:00:03.002515 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:03.002485 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127ab4d5_3d69_495a_affe_2503d0061675.slice/crio-b0ccfc7346205eb5e0d9449c0fe47f2a201e70ceeb1cf89b4940f2231ab5b16b WatchSource:0}: Error finding container b0ccfc7346205eb5e0d9449c0fe47f2a201e70ceeb1cf89b4940f2231ab5b16b: Status 404 returned error can't find the container with id b0ccfc7346205eb5e0d9449c0fe47f2a201e70ceeb1cf89b4940f2231ab5b16b Sep 08 04:00:03.126873 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.126780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xvqj" event={"ID":"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e","Type":"ContainerStarted","Data":"a5173a680efaf9398b3eb5c58195764fec56fc21a2e0cd35583ab57fef0c1290"} Sep 08 04:00:03.128265 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.128246 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:00:03.128632 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.128618 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/1.log" Sep 08 04:00:03.128702 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.128648 2575 generic.go:356] "Generic (PLEG): container finished" podID="045d3f60-0435-48ef-8836-8e0233230c96" containerID="820c660344146aac68a1df46dcafc5efb2c8aeef263c2c537cba2ddf3a83e718" exitCode=255 Sep 08 04:00:03.128762 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.128734 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" event={"ID":"045d3f60-0435-48ef-8836-8e0233230c96","Type":"ContainerDied","Data":"820c660344146aac68a1df46dcafc5efb2c8aeef263c2c537cba2ddf3a83e718"} Sep 08 04:00:03.128816 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.128793 2575 scope.go:117] "RemoveContainer" containerID="cf3b4adfe1182117ad0a6f442be62867991ccf310f77c57198fffdfd4bab1c9e" Sep 08 04:00:03.129131 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.129107 2575 scope.go:117] "RemoveContainer" containerID="820c660344146aac68a1df46dcafc5efb2c8aeef263c2c537cba2ddf3a83e718" Sep 08 04:00:03.129320 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:00:03.129301 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tzlbw_openshift-console-operator(045d3f60-0435-48ef-8836-8e0233230c96)\"" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podUID="045d3f60-0435-48ef-8836-8e0233230c96" Sep 08 04:00:03.129906 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:03.129887 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hc6t9" event={"ID":"127ab4d5-3d69-495a-affe-2503d0061675","Type":"ContainerStarted","Data":"b0ccfc7346205eb5e0d9449c0fe47f2a201e70ceeb1cf89b4940f2231ab5b16b"} Sep 08 04:00:04.135056 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:04.135028 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:00:06.143668 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:06.143602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hc6t9" event={"ID":"127ab4d5-3d69-495a-affe-2503d0061675","Type":"ContainerStarted","Data":"cf17ea58e1dad8a385e51c06c04ba8917ba0ec9373b42e115fffdf4fc99bfe84"} Sep 08 04:00:06.144137 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:06.143691 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hc6t9" event={"ID":"127ab4d5-3d69-495a-affe-2503d0061675","Type":"ContainerStarted","Data":"386405bdea22122fbeaf29c963080c596bc610d66260b95d0a555fee48b200bf"} Sep 08 04:00:06.144137 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:06.143721 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hc6t9" Sep 08 04:00:06.145620 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:06.145600 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xvqj" event={"ID":"2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e","Type":"ContainerStarted","Data":"b921de1ccad3029d9ed0cd27a24385aac3a1d475b968edfa4687c3d07d55c98a"} Sep 08 04:00:06.169559 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:06.169507 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hc6t9" podStartSLOduration=251.716007284 podStartE2EDuration="4m14.169491022s" totalImagesPullingTime="2.453483738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:06.169335283 +0000 UTC m=+287.494241427" watchObservedRunningTime="2026-09-08 04:00:06.169491022 +0000 UTC m=+287.494397166" Sep 08 04:00:06.194494 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:06.194445 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6xvqj" podStartSLOduration=17.86665573 podStartE2EDuration="22.194428008s" totalImagesPullingTime="4.327772278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:59:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:06.193907461 +0000 UTC m=+287.518813607" watchObservedRunningTime="2026-09-08 04:00:06.194428008 +0000 UTC m=+287.519334153" Sep 08 04:00:09.442365 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:09.442316 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 04:00:09.442365 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:09.442383 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 04:00:09.442833 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:09.442702 2575 scope.go:117] "RemoveContainer" containerID="820c660344146aac68a1df46dcafc5efb2c8aeef263c2c537cba2ddf3a83e718" Sep 08 04:00:09.442873 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:00:09.442855 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tzlbw_openshift-console-operator(045d3f60-0435-48ef-8836-8e0233230c96)\"" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podUID="045d3f60-0435-48ef-8836-8e0233230c96" Sep 08 04:00:10.191403 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:00:10.191356 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qcndh" podUID="53110014-8f58-4ce0-820b-20aeba80aa90" Sep 08 04:00:14.351857 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.351820 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77f987bb9-flstl"] Sep 08 04:00:14.356043 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.356012 2575 patch_prober.go:28] interesting pod/image-registry-77f987bb9-flstl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 08 04:00:14.356176 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.356062 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77f987bb9-flstl" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 04:00:14.367302 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.367278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:14.484107 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.484077 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-785d654894-dpldt"] Sep 08 04:00:14.486987 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.486971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.496386 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:00:14.496354 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-785d654894-dpldt\" is forbidden: User \"system:node:ip-10-0-131-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-131-231.ec2.internal' and this object" podUID="8e90d328-ba46-4052-b942-9425bf7a5c4b" pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.549122 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.549087 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785d654894-dpldt"] Sep 08 04:00:14.616809 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e90d328-ba46-4052-b942-9425bf7a5c4b-image-registry-private-configuration\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.616809 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-bound-sa-token\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.616809 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e90d328-ba46-4052-b942-9425bf7a5c4b-trusted-ca\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.617040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e90d328-ba46-4052-b942-9425bf7a5c4b-registry-certificates\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.617040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e90d328-ba46-4052-b942-9425bf7a5c4b-installation-pull-secrets\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.617040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-registry-tls\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.617040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e90d328-ba46-4052-b942-9425bf7a5c4b-ca-trust-extracted\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.617040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.616964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5sng\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-kube-api-access-c5sng\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.717910 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.717872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-registry-tls\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.717910 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.717909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e90d328-ba46-4052-b942-9425bf7a5c4b-ca-trust-extracted\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718122 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.717926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5sng\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-kube-api-access-c5sng\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718122 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.717968 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e90d328-ba46-4052-b942-9425bf7a5c4b-image-registry-private-configuration\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718122 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.717990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-bound-sa-token\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718122 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.718019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e90d328-ba46-4052-b942-9425bf7a5c4b-trusted-ca\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718408 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.718215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e90d328-ba46-4052-b942-9425bf7a5c4b-registry-certificates\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718408 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.718254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e90d328-ba46-4052-b942-9425bf7a5c4b-installation-pull-secrets\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718408 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.718364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e90d328-ba46-4052-b942-9425bf7a5c4b-ca-trust-extracted\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.718989 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.718964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e90d328-ba46-4052-b942-9425bf7a5c4b-registry-certificates\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.719227 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.719203 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e90d328-ba46-4052-b942-9425bf7a5c4b-trusted-ca\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.720533 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.720512 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-registry-tls\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.720615 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.720513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e90d328-ba46-4052-b942-9425bf7a5c4b-image-registry-private-configuration\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.720615 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.720599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e90d328-ba46-4052-b942-9425bf7a5c4b-installation-pull-secrets\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.811329 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.811293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5sng\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-kube-api-access-c5sng\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:14.813083 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:14.813059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e90d328-ba46-4052-b942-9425bf7a5c4b-bound-sa-token\") pod \"image-registry-785d654894-dpldt\" (UID: \"8e90d328-ba46-4052-b942-9425bf7a5c4b\") " pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:15.095254 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.095221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:15.187607 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.187573 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f"] Sep 08 04:00:15.190874 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.190852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:15.194197 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.194170 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 08 04:00:15.194441 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.194425 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jhwbk\"" Sep 08 04:00:15.235763 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.235730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f"] Sep 08 04:00:15.322315 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.322275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3770b90f-7bfc-4f01-ac17-16b5d994220c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-l9l4f\" (UID: \"3770b90f-7bfc-4f01-ac17-16b5d994220c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:15.423548 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.423506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3770b90f-7bfc-4f01-ac17-16b5d994220c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-l9l4f\" (UID: \"3770b90f-7bfc-4f01-ac17-16b5d994220c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:15.425941 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.425922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3770b90f-7bfc-4f01-ac17-16b5d994220c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-l9l4f\" (UID: \"3770b90f-7bfc-4f01-ac17-16b5d994220c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:15.452084 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.452051 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785d654894-dpldt"] Sep 08 04:00:15.454829 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:15.454803 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e90d328_ba46_4052_b942_9425bf7a5c4b.slice/crio-fd452537dd82357914d86870d71644a19f6e9bfbb57bc9046a0f01611645bc84 WatchSource:0}: Error finding container fd452537dd82357914d86870d71644a19f6e9bfbb57bc9046a0f01611645bc84: Status 404 returned error can't find the container with id fd452537dd82357914d86870d71644a19f6e9bfbb57bc9046a0f01611645bc84 Sep 08 04:00:15.500944 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.500922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:15.798542 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:15.798457 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f"] Sep 08 04:00:15.802640 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:15.802612 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3770b90f_7bfc_4f01_ac17_16b5d994220c.slice/crio-1752a468b025a08bdac36e87d2df0c534867dbdca690766685ba2f2e2eb6819a WatchSource:0}: Error finding container 1752a468b025a08bdac36e87d2df0c534867dbdca690766685ba2f2e2eb6819a: Status 404 returned error can't find the container with id 1752a468b025a08bdac36e87d2df0c534867dbdca690766685ba2f2e2eb6819a Sep 08 04:00:16.154139 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:16.154108 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hc6t9" Sep 08 04:00:16.181825 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:16.181793 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" event={"ID":"3770b90f-7bfc-4f01-ac17-16b5d994220c","Type":"ContainerStarted","Data":"1752a468b025a08bdac36e87d2df0c534867dbdca690766685ba2f2e2eb6819a"} Sep 08 04:00:16.183181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:16.183146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785d654894-dpldt" event={"ID":"8e90d328-ba46-4052-b942-9425bf7a5c4b","Type":"ContainerStarted","Data":"b46dda03f5e2a9cd6952bba3f7f7413e9c3894e29ec2879ad81e9443a0e5e91d"} Sep 08 04:00:16.183181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:16.183185 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785d654894-dpldt" event={"ID":"8e90d328-ba46-4052-b942-9425bf7a5c4b","Type":"ContainerStarted","Data":"fd452537dd82357914d86870d71644a19f6e9bfbb57bc9046a0f01611645bc84"} Sep 08 04:00:16.183378 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:16.183268 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:17.665806 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:17.665772 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:19.102583 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.102554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:00:19.103046 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.103008 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:00:19.109707 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.109686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:00:19.110182 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.110168 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:00:19.112753 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.112734 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 04:00:19.195750 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.195606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" event={"ID":"3770b90f-7bfc-4f01-ac17-16b5d994220c","Type":"ContainerStarted","Data":"c8f1351b1e2d57838f59fe25c7640d6645e549e2c0ebdaf43136cae81aa485f8"} Sep 08 04:00:19.204045 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.195774 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:19.204045 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.200502 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" Sep 08 04:00:19.223168 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.223020 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-785d654894-dpldt" podStartSLOduration=5.223003909 podStartE2EDuration="5.223003909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:16.271787412 +0000 UTC m=+297.596693556" watchObservedRunningTime="2026-09-08 04:00:19.223003909 +0000 UTC m=+300.547910051" Sep 08 04:00:19.223348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:19.223273 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-l9l4f" podStartSLOduration=1.766451862 podStartE2EDuration="4.223266352s" totalImagesPullingTime="2.45681449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:19.222854045 +0000 UTC m=+300.547760191" watchObservedRunningTime="2026-09-08 04:00:19.223266352 +0000 UTC m=+300.548172497" Sep 08 04:00:20.080230 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.080193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:20.128421 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.128386 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9pzjl"] Sep 08 04:00:20.131906 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.131888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.137118 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.137092 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 08 04:00:20.137416 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.137391 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 04:00:20.137519 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.137483 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 04:00:20.137595 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.137528 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 08 04:00:20.137670 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.137640 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fvk78\"" Sep 08 04:00:20.138181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.137968 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 04:00:20.144878 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.144851 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9pzjl"] Sep 08 04:00:20.177973 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.177941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:20.258735 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.258694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.258901 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.258772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-kube-api-access-tzpcb\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.258901 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.258814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.258973 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.258914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.359484 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.359395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.359484 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.359437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.359711 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.359595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.359711 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.359689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-kube-api-access-tzpcb\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.360125 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.360098 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.361969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.361943 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.362075 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.361990 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.372913 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.372886 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzpcb\" (UniqueName: \"kubernetes.io/projected/442116c0-70b3-481d-bf4d-bbcbbf68e1b6-kube-api-access-tzpcb\") pod \"prometheus-operator-6f4946db56-9pzjl\" (UID: \"442116c0-70b3-481d-bf4d-bbcbbf68e1b6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.393181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.393122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:20.441219 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.441176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" Sep 08 04:00:20.457580 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.457546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:20.715060 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.715028 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9pzjl"] Sep 08 04:00:20.718254 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:20.718228 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442116c0_70b3_481d_bf4d_bbcbbf68e1b6.slice/crio-75d6257351a3e980da8b19d5f5e2f22587d911efd1f11de81d32d4904a582e9e WatchSource:0}: Error finding container 75d6257351a3e980da8b19d5f5e2f22587d911efd1f11de81d32d4904a582e9e: Status 404 returned error can't find the container with id 75d6257351a3e980da8b19d5f5e2f22587d911efd1f11de81d32d4904a582e9e Sep 08 04:00:20.720208 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:20.720192 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 04:00:21.194750 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:21.194719 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 04:00:21.195112 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:21.194797 2575 scope.go:117] "RemoveContainer" containerID="820c660344146aac68a1df46dcafc5efb2c8aeef263c2c537cba2ddf3a83e718" Sep 08 04:00:21.195112 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:00:21.194932 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-tzlbw_openshift-console-operator(045d3f60-0435-48ef-8836-8e0233230c96)\"" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podUID="045d3f60-0435-48ef-8836-8e0233230c96" Sep 08 04:00:21.203316 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:21.203288 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" event={"ID":"442116c0-70b3-481d-bf4d-bbcbbf68e1b6","Type":"ContainerStarted","Data":"75d6257351a3e980da8b19d5f5e2f22587d911efd1f11de81d32d4904a582e9e"} Sep 08 04:00:22.208541 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:22.208451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" event={"ID":"442116c0-70b3-481d-bf4d-bbcbbf68e1b6","Type":"ContainerStarted","Data":"ad5161dc10f44ad8f8bd290d70c5e973e3089aa0be039105458e867393bfb9ec"} Sep 08 04:00:22.208541 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:22.208506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" event={"ID":"442116c0-70b3-481d-bf4d-bbcbbf68e1b6","Type":"ContainerStarted","Data":"5960b298ea20b94837bca50da5b1b507a214033b04c66c3668ea2c99b138f97f"} Sep 08 04:00:22.229846 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:22.229790 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-9pzjl" podStartSLOduration=1.001254998 podStartE2EDuration="2.229773806s" totalImagesPullingTime="1.228518808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:22.228861234 +0000 UTC m=+303.553767378" watchObservedRunningTime="2026-09-08 04:00:22.229773806 +0000 UTC m=+303.554679951" Sep 08 04:00:23.093562 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:23.093524 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.116143 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.116093 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.266956 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.266921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.356746 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.356719 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 04:00:24.426040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.426011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.606032 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.606001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.744678 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.744592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.926856 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.926822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:24.956092 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.956058 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-msm7k"] Sep 08 04:00:24.959546 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.959528 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:24.963073 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.963045 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 04:00:24.964728 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.964699 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7k9nw\"" Sep 08 04:00:24.966073 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.966047 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 04:00:24.966165 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:24.966067 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 04:00:25.097615 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74w59\" (UniqueName: \"kubernetes.io/projected/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-kube-api-access-74w59\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097615 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-wtmp\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-root\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-textfile\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-metrics-client-ca\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-tls\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.097864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.097811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-sys\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.110018 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.109985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:25.198626 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-root\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-textfile\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-root\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-metrics-client-ca\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-tls\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-sys\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.198974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74w59\" (UniqueName: \"kubernetes.io/projected/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-kube-api-access-74w59\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.199016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-wtmp\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199072 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.199062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-sys\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199577 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.199134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-textfile\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199577 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.199254 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-wtmp\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199577 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.199339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.199748 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.199682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-metrics-client-ca\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.201367 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.201344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.201819 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.201797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-node-exporter-tls\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.208106 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.208082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74w59\" (UniqueName: \"kubernetes.io/projected/5a9cf5dc-dce3-458f-96a2-85dbacb774e7-kube-api-access-74w59\") pod \"node-exporter-msm7k\" (UID: \"5a9cf5dc-dce3-458f-96a2-85dbacb774e7\") " pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.268066 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.268034 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-msm7k" Sep 08 04:00:25.279326 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:25.279298 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9cf5dc_dce3_458f_96a2_85dbacb774e7.slice/crio-b13cd8269966858a40934abeb94b77290fa4e15346f5e26700f79548e1a060d7 WatchSource:0}: Error finding container b13cd8269966858a40934abeb94b77290fa4e15346f5e26700f79548e1a060d7: Status 404 returned error can't find the container with id b13cd8269966858a40934abeb94b77290fa4e15346f5e26700f79548e1a060d7 Sep 08 04:00:25.362823 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.362738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:25.490816 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.490785 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:25.601027 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.600991 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:25.712506 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.712476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:25.830218 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:25.830166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:26.024864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:26.024741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:26.212154 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:26.212120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:26.221680 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:26.221639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msm7k" event={"ID":"5a9cf5dc-dce3-458f-96a2-85dbacb774e7","Type":"ContainerStarted","Data":"b13cd8269966858a40934abeb94b77290fa4e15346f5e26700f79548e1a060d7"} Sep 08 04:00:27.642641 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.642606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:27.700274 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.700239 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-754cb57bbf-fdppl"] Sep 08 04:00:27.705829 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.705796 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.710525 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.710491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 08 04:00:27.710701 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.710553 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 08 04:00:27.710701 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.710556 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 08 04:00:27.710938 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.710903 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 08 04:00:27.710938 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.710922 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5nt4gmvl8ic50\"" Sep 08 04:00:27.711109 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.710977 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 08 04:00:27.712218 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.712176 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6jhww\"" Sep 08 04:00:27.733952 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.733919 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-754cb57bbf-fdppl"] Sep 08 04:00:27.821815 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.821791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-tls\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.821883 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.821830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.821921 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.821895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.821960 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.821928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcfh\" (UniqueName: \"kubernetes.io/projected/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-kube-api-access-ndcfh\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.821960 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.821952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.822031 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.821977 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.822031 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.822000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-metrics-client-ca\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.822107 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.822064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-grpc-tls\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923327 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcfh\" (UniqueName: \"kubernetes.io/projected/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-kube-api-access-ndcfh\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923327 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923428 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923428 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-metrics-client-ca\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923428 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-grpc-tls\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.923586 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.923464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-tls\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.924208 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.924176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-metrics-client-ca\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.926042 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.926014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-grpc-tls\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.926442 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.926416 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.926552 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.926486 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.926552 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.926544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.926675 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.926580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.926746 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.926727 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-secret-thanos-querier-tls\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:27.932994 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:27.932974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcfh\" (UniqueName: \"kubernetes.io/projected/a8be6aae-9e9d-40b3-a4d6-238d4b8da295-kube-api-access-ndcfh\") pod \"thanos-querier-754cb57bbf-fdppl\" (UID: \"a8be6aae-9e9d-40b3-a4d6-238d4b8da295\") " pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:28.018530 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:28.018491 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:28.138969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:28.138931 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:28.212074 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:28.211981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:28.230040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:28.230008 2575 generic.go:356] "Generic (PLEG): container finished" podID="5a9cf5dc-dce3-458f-96a2-85dbacb774e7" containerID="5214c6dd11bc3d69b3db1849b1c97ea51999139a78f8dc08e21e693e45e01f1c" exitCode=0 Sep 08 04:00:28.230187 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:28.230076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msm7k" event={"ID":"5a9cf5dc-dce3-458f-96a2-85dbacb774e7","Type":"ContainerDied","Data":"5214c6dd11bc3d69b3db1849b1c97ea51999139a78f8dc08e21e693e45e01f1c"} Sep 08 04:00:28.297839 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:28.297813 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-754cb57bbf-fdppl"] Sep 08 04:00:28.300555 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:28.300528 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8be6aae_9e9d_40b3_a4d6_238d4b8da295.slice/crio-15bb8eebeba2f774a62a29c87610a91f03855e08b504e11b77fba89967163429 WatchSource:0}: Error finding container 15bb8eebeba2f774a62a29c87610a91f03855e08b504e11b77fba89967163429: Status 404 returned error can't find the container with id 15bb8eebeba2f774a62a29c87610a91f03855e08b504e11b77fba89967163429 Sep 08 04:00:29.236465 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.236428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"15bb8eebeba2f774a62a29c87610a91f03855e08b504e11b77fba89967163429"} Sep 08 04:00:29.238985 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.238920 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msm7k" event={"ID":"5a9cf5dc-dce3-458f-96a2-85dbacb774e7","Type":"ContainerStarted","Data":"339ebcb0e9ba520e27a2f6bd6067f06fd32ecf266e4477fed48d693df8369667"} Sep 08 04:00:29.238985 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.238968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msm7k" event={"ID":"5a9cf5dc-dce3-458f-96a2-85dbacb774e7","Type":"ContainerStarted","Data":"cf2a5a9bfe319fdf9a838514eec5dd8d2f68f6bd02f1ab0d70eb40a9eae5daeb"} Sep 08 04:00:29.292832 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.292794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:29.417614 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.417552 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-msm7k" podStartSLOduration=2.819965322 podStartE2EDuration="5.417532396s" totalImagesPullingTime="2.533256063s" totalInitContainerRuntime="64.311011ms" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:29.277275425 +0000 UTC m=+310.602181570" watchObservedRunningTime="2026-09-08 04:00:29.417532396 +0000 UTC m=+310.742438542" Sep 08 04:00:29.417848 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.417832 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-569d4f5cd9-zqlz7"] Sep 08 04:00:29.421021 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.421000 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.425059 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.425018 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 04:00:29.425192 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.425166 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 04:00:29.425325 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.425309 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 04:00:29.425418 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.425400 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ab3hitgo1iq9s\"" Sep 08 04:00:29.426324 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.426305 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 04:00:29.426435 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.426352 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z95jt\"" Sep 08 04:00:29.454003 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.453973 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-569d4f5cd9-zqlz7"] Sep 08 04:00:29.538628 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538534 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa644d67-0072-4f07-b83d-17fe05fc61e3-metrics-server-audit-profiles\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.538796 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-client-ca-bundle\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.538796 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-secret-metrics-server-client-certs\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.538796 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa644d67-0072-4f07-b83d-17fe05fc61e3-audit-log\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.538938 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-secret-metrics-server-tls\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.538938 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa644d67-0072-4f07-b83d-17fe05fc61e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.538938 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.538879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5b6\" (UniqueName: \"kubernetes.io/projected/aa644d67-0072-4f07-b83d-17fe05fc61e3-kube-api-access-gv5b6\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.639841 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv5b6\" (UniqueName: \"kubernetes.io/projected/aa644d67-0072-4f07-b83d-17fe05fc61e3-kube-api-access-gv5b6\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa644d67-0072-4f07-b83d-17fe05fc61e3-metrics-server-audit-profiles\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-client-ca-bundle\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-secret-metrics-server-client-certs\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa644d67-0072-4f07-b83d-17fe05fc61e3-audit-log\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-secret-metrics-server-tls\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.639993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa644d67-0072-4f07-b83d-17fe05fc61e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640452 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.640428 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa644d67-0072-4f07-b83d-17fe05fc61e3-audit-log\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640755 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.640729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa644d67-0072-4f07-b83d-17fe05fc61e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.640878 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.640858 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa644d67-0072-4f07-b83d-17fe05fc61e3-metrics-server-audit-profiles\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.642443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.642412 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-secret-metrics-server-tls\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.642622 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.642604 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-secret-metrics-server-client-certs\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.642925 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.642905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa644d67-0072-4f07-b83d-17fe05fc61e3-client-ca-bundle\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.650140 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.650110 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv5b6\" (UniqueName: \"kubernetes.io/projected/aa644d67-0072-4f07-b83d-17fe05fc61e3-kube-api-access-gv5b6\") pod \"metrics-server-569d4f5cd9-zqlz7\" (UID: \"aa644d67-0072-4f07-b83d-17fe05fc61e3\") " pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:29.731705 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:29.731650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:30.405558 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:30.405531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:30.513960 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:30.513878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-569d4f5cd9-zqlz7"] Sep 08 04:00:30.515927 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:30.515899 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:30.516941 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:30.516919 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa644d67_0072_4f07_b83d_17fe05fc61e3.slice/crio-91d45970e8d8663485f895c4732be3c14b197d9513fe740dec25da558272afd0 WatchSource:0}: Error finding container 91d45970e8d8663485f895c4732be3c14b197d9513fe740dec25da558272afd0: Status 404 returned error can't find the container with id 91d45970e8d8663485f895c4732be3c14b197d9513fe740dec25da558272afd0 Sep 08 04:00:31.170369 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.170336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:31.249633 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.249595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"296cc21f587d4ff45ee58484e017aad8f8f4f029b92fccd4227c5de2c7b4ff1f"} Sep 08 04:00:31.249848 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.249696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"37c4ca189b34a9a247dcb604393306df3eb22afee91e5a84d577fe9f1e09acd4"} Sep 08 04:00:31.249848 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.249746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"42d38479485167ecd2b41f57591b654bf30a7c6a2dc1d9341d239049f9128bee"} Sep 08 04:00:31.252431 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.251710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" event={"ID":"aa644d67-0072-4f07-b83d-17fe05fc61e3","Type":"ContainerStarted","Data":"91d45970e8d8663485f895c4732be3c14b197d9513fe740dec25da558272afd0"} Sep 08 04:00:31.777276 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.777204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:31.922218 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:31.922185 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:32.261403 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:32.261365 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"da926264259453f6613ada564f9afa3f068f93aba4903628f65ca0baa63684a9"} Sep 08 04:00:32.261568 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:32.261451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"e4a2233a7bf53ed0613f23163e6a180a598a035d9560fdacdc3b658bd1ae9108"} Sep 08 04:00:32.261568 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:32.261498 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" event={"ID":"a8be6aae-9e9d-40b3-a4d6-238d4b8da295","Type":"ContainerStarted","Data":"81d3d28542374e69f50fa6fef98c6faeb75ce148d43f00106322a95a66e123f4"} Sep 08 04:00:32.261796 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:32.261778 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:32.329129 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:32.329018 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" podStartSLOduration=1.763002893 podStartE2EDuration="5.329000173s" totalImagesPullingTime="3.56599728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:32.327702076 +0000 UTC m=+313.652608229" watchObservedRunningTime="2026-09-08 04:00:32.329000173 +0000 UTC m=+313.653906317" Sep 08 04:00:33.266437 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:33.266403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" event={"ID":"aa644d67-0072-4f07-b83d-17fe05fc61e3","Type":"ContainerStarted","Data":"2eb9dd35e899023ee87d13763cb190baae7c149337a8042708cd01cdceb99d8c"} Sep 08 04:00:33.308784 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:33.308730 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" podStartSLOduration=1.726355034 podStartE2EDuration="4.308716273s" totalImagesPullingTime="2.582361239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:33.308545038 +0000 UTC m=+314.633451184" watchObservedRunningTime="2026-09-08 04:00:33.308716273 +0000 UTC m=+314.633622417" Sep 08 04:00:34.190645 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.190607 2575 scope.go:117] "RemoveContainer" containerID="820c660344146aac68a1df46dcafc5efb2c8aeef263c2c537cba2ddf3a83e718" Sep 08 04:00:34.273246 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.273222 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:00:34.273672 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.273294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" event={"ID":"045d3f60-0435-48ef-8836-8e0233230c96","Type":"ContainerStarted","Data":"d76d0aec879e3d78d6ce57d302af86175f6e51dc8e649466a00b1547f88344bc"} Sep 08 04:00:34.305226 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.305170 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" podStartSLOduration=54.395720921 podStartE2EDuration="56.305153017s" totalImagesPullingTime="1.909432096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:34.304621005 +0000 UTC m=+315.629527355" watchObservedRunningTime="2026-09-08 04:00:34.305153017 +0000 UTC m=+315.630059161" Sep 08 04:00:34.956295 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.956257 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-qdslj"] Sep 08 04:00:34.959537 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.959521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:34.964273 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.964248 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-shksg\"" Sep 08 04:00:34.965105 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.965084 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 04:00:34.966361 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:34.966338 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 04:00:35.017868 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.017822 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-qdslj"] Sep 08 04:00:35.051399 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.051363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:35.088291 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.088255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wth8\" (UniqueName: \"kubernetes.io/projected/6ad2809a-6385-4f87-969c-c795837d5bec-kube-api-access-7wth8\") pod \"downloads-85d98c998f-qdslj\" (UID: \"6ad2809a-6385-4f87-969c-c795837d5bec\") " pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:35.183181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.183146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:35.189265 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.189235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wth8\" (UniqueName: \"kubernetes.io/projected/6ad2809a-6385-4f87-969c-c795837d5bec-kube-api-access-7wth8\") pod \"downloads-85d98c998f-qdslj\" (UID: \"6ad2809a-6385-4f87-969c-c795837d5bec\") " pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:35.199859 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.199825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wth8\" (UniqueName: \"kubernetes.io/projected/6ad2809a-6385-4f87-969c-c795837d5bec-kube-api-access-7wth8\") pod \"downloads-85d98c998f-qdslj\" (UID: \"6ad2809a-6385-4f87-969c-c795837d5bec\") " pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:35.268865 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.268772 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:35.301479 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.301446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:35.502798 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.502765 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:35.566324 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.566251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-qdslj"] Sep 08 04:00:35.569492 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:35.569466 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad2809a_6385_4f87_969c_c795837d5bec.slice/crio-8359f33f9921ba1518e5d45d0460b84d83a19c32ce2968bb04a57d2f4104aa7d WatchSource:0}: Error finding container 8359f33f9921ba1518e5d45d0460b84d83a19c32ce2968bb04a57d2f4104aa7d: Status 404 returned error can't find the container with id 8359f33f9921ba1518e5d45d0460b84d83a19c32ce2968bb04a57d2f4104aa7d Sep 08 04:00:35.671377 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:35.671341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:36.284276 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:36.284224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-qdslj" event={"ID":"6ad2809a-6385-4f87-969c-c795837d5bec","Type":"ContainerStarted","Data":"8359f33f9921ba1518e5d45d0460b84d83a19c32ce2968bb04a57d2f4104aa7d"} Sep 08 04:00:36.493333 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:36.493293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:36.633397 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:36.633364 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:36.786822 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:36.786793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:36.956994 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:36.956911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:37.144900 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:37.144870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:37.198437 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:37.198408 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-785d654894-dpldt" Sep 08 04:00:37.506699 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:37.506648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:37.623052 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:37.623019 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:37.763059 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:37.762976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:38.273794 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:38.273762 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-754cb57bbf-fdppl" Sep 08 04:00:39.371692 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.371618 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77f987bb9-flstl" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" containerName="registry" containerID="cri-o://ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853" gracePeriod=30 Sep 08 04:00:39.626959 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.626891 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 04:00:39.727328 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727290 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6687325-60c9-41b4-a847-b2395744d3ec-ca-trust-extracted\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727509 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727347 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-trusted-ca\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727509 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727424 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-image-registry-private-configuration\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727509 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727455 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-bound-sa-token\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727509 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727487 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727749 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727515 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727749 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727551 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7st7v\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-kube-api-access-7st7v\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727749 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727598 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-registry-certificates\") pod \"b6687325-60c9-41b4-a847-b2395744d3ec\" (UID: \"b6687325-60c9-41b4-a847-b2395744d3ec\") " Sep 08 04:00:39.727913 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.727882 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:00:39.728501 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.728460 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:00:39.730479 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.730433 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:00:39.730717 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.730588 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:00:39.730717 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.730690 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-kube-api-access-7st7v" (OuterVolumeSpecName: "kube-api-access-7st7v") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "kube-api-access-7st7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:00:39.730962 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.730932 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:00:39.731288 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.731266 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:00:39.738849 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.738824 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6687325-60c9-41b4-a847-b2395744d3ec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b6687325-60c9-41b4-a847-b2395744d3ec" (UID: "b6687325-60c9-41b4-a847-b2395744d3ec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:00:39.828315 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828281 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6687325-60c9-41b4-a847-b2395744d3ec-ca-trust-extracted\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828315 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828318 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-trusted-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828334 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-image-registry-private-configuration\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828347 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-bound-sa-token\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828364 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-registry-tls\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828378 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6687325-60c9-41b4-a847-b2395744d3ec-installation-pull-secrets\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828390 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7st7v\" (UniqueName: \"kubernetes.io/projected/b6687325-60c9-41b4-a847-b2395744d3ec-kube-api-access-7st7v\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.828553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:39.828400 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6687325-60c9-41b4-a847-b2395744d3ec-registry-certificates\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:00:40.303088 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.303047 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6687325-60c9-41b4-a847-b2395744d3ec" containerID="ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853" exitCode=0 Sep 08 04:00:40.303088 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.303101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f987bb9-flstl" event={"ID":"b6687325-60c9-41b4-a847-b2395744d3ec","Type":"ContainerDied","Data":"ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853"} Sep 08 04:00:40.303295 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.303119 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77f987bb9-flstl" Sep 08 04:00:40.303295 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.303154 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77f987bb9-flstl" event={"ID":"b6687325-60c9-41b4-a847-b2395744d3ec","Type":"ContainerDied","Data":"c61e5bc8bbe5a8374710a2a1f0e6e078630aad5e64fc5c0b0ae9c5afd82d9ee2"} Sep 08 04:00:40.303295 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.303181 2575 scope.go:117] "RemoveContainer" containerID="ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853" Sep 08 04:00:40.313372 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.313351 2575 scope.go:117] "RemoveContainer" containerID="ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853" Sep 08 04:00:40.313728 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:00:40.313679 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853\": container with ID starting with ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853 not found: ID does not exist" containerID="ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853" Sep 08 04:00:40.313816 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.313722 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853"} err="failed to get container status \"ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853\": rpc error: code = NotFound desc = could not find container \"ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853\": container with ID starting with ba851be38675f0dace143dea2023af642e57f6c606960f24a218d1d17db36853 not found: ID does not exist" Sep 08 04:00:40.331483 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.331454 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77f987bb9-flstl"] Sep 08 04:00:40.333893 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:40.333869 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77f987bb9-flstl"] Sep 08 04:00:41.197212 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.197170 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" path="/var/lib/kubelet/pods/b6687325-60c9-41b4-a847-b2395744d3ec/volumes" Sep 08 04:00:41.353782 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.353750 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56cc4c477d-669fp"] Sep 08 04:00:41.354170 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.354153 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" containerName="registry" Sep 08 04:00:41.354230 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.354174 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" containerName="registry" Sep 08 04:00:41.354279 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.354245 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6687325-60c9-41b4-a847-b2395744d3ec" containerName="registry" Sep 08 04:00:41.357450 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.357429 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.364849 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.364814 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 04:00:41.365959 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.365925 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 04:00:41.365959 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.365953 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r25sn\"" Sep 08 04:00:41.366125 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.366085 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 04:00:41.366237 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.366212 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 04:00:41.366237 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.366221 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 04:00:41.381824 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.381790 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cc4c477d-669fp"] Sep 08 04:00:41.544813 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.544722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-service-ca\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.544813 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.544783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-console-config\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.545035 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.544862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-oauth-serving-cert\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.545035 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.544927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-oauth-config\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.545035 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.544972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-serving-cert\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.545035 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.544994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phx2h\" (UniqueName: \"kubernetes.io/projected/cba41978-333d-4e15-b164-27f1c86f4ac4-kube-api-access-phx2h\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.646249 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.646206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-oauth-config\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.646443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.646272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-serving-cert\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.646443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.646302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phx2h\" (UniqueName: \"kubernetes.io/projected/cba41978-333d-4e15-b164-27f1c86f4ac4-kube-api-access-phx2h\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.646443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.646357 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-service-ca\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.646443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.646388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-console-config\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.646443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.646418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-oauth-serving-cert\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.647440 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.647396 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-service-ca\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.647552 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.647491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-oauth-serving-cert\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.647616 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.647587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-console-config\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.649265 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.649242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-serving-cert\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.649345 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.649251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-oauth-config\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.655885 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.655865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phx2h\" (UniqueName: \"kubernetes.io/projected/cba41978-333d-4e15-b164-27f1c86f4ac4-kube-api-access-phx2h\") pod \"console-56cc4c477d-669fp\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.668712 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.668672 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:41.952024 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:41.951996 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cc4c477d-669fp"] Sep 08 04:00:41.954863 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:41.954832 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba41978_333d_4e15_b164_27f1c86f4ac4.slice/crio-9d092198f22ec0d7d6f198062b76b8fd958930feae2c1e7fc67aecce04307ea4 WatchSource:0}: Error finding container 9d092198f22ec0d7d6f198062b76b8fd958930feae2c1e7fc67aecce04307ea4: Status 404 returned error can't find the container with id 9d092198f22ec0d7d6f198062b76b8fd958930feae2c1e7fc67aecce04307ea4 Sep 08 04:00:42.313951 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:42.313874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cc4c477d-669fp" event={"ID":"cba41978-333d-4e15-b164-27f1c86f4ac4","Type":"ContainerStarted","Data":"9d092198f22ec0d7d6f198062b76b8fd958930feae2c1e7fc67aecce04307ea4"} Sep 08 04:00:43.152222 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:43.152148 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:43.274428 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:43.274384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:44.273874 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:44.273834 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 04:00:44.278765 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:44.278733 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-tzlbw" Sep 08 04:00:46.335985 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:46.335943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cc4c477d-669fp" event={"ID":"cba41978-333d-4e15-b164-27f1c86f4ac4","Type":"ContainerStarted","Data":"d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614"} Sep 08 04:00:46.355439 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:46.355246 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56cc4c477d-669fp" podStartSLOduration=1.723139573 podStartE2EDuration="5.355229051s" totalImagesPullingTime="3.632089478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:46.355102831 +0000 UTC m=+327.680008979" watchObservedRunningTime="2026-09-08 04:00:46.355229051 +0000 UTC m=+327.680135197" Sep 08 04:00:46.658334 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:46.658299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:46.721651 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:46.721613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:47.142130 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:47.142091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:47.282153 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:47.282113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:49.732221 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:49.732182 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:49.732621 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:49.732253 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:00:50.603868 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:50.603837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:51.376518 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.376481 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f69889559-gqcqz"] Sep 08 04:00:51.382258 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.382192 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.392022 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.391992 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 04:00:51.396741 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.396714 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f69889559-gqcqz"] Sep 08 04:00:51.444314 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-serving-cert\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.444482 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-service-ca\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.444482 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-oauth-serving-cert\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.444482 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-trusted-ca-bundle\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.444482 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlr5r\" (UniqueName: \"kubernetes.io/projected/a11b4cee-fdf9-46c2-83bd-09836355f04e-kube-api-access-rlr5r\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.444642 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-config\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.444642 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.444562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-oauth-config\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.545856 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.545811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-oauth-config\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546058 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.545877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-serving-cert\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546058 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.545912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-service-ca\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546058 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.545942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-oauth-serving-cert\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546058 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.545982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-trusted-ca-bundle\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546058 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.546011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlr5r\" (UniqueName: \"kubernetes.io/projected/a11b4cee-fdf9-46c2-83bd-09836355f04e-kube-api-access-rlr5r\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546324 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.546060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-config\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546995 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.546835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-service-ca\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546995 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.546835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-oauth-serving-cert\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.546995 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.546934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-config\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.547238 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.547051 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-trusted-ca-bundle\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.548726 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.548702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-oauth-config\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.548849 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.548804 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-serving-cert\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.555773 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.555749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlr5r\" (UniqueName: \"kubernetes.io/projected/a11b4cee-fdf9-46c2-83bd-09836355f04e-kube-api-access-rlr5r\") pod \"console-7f69889559-gqcqz\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:51.669891 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.669850 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:51.670080 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.669926 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:51.675501 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.675475 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:51.693917 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:51.693879 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:00:52.368133 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:52.368097 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:00:54.203982 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.203804 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f69889559-gqcqz"] Sep 08 04:00:54.206954 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:00:54.206882 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11b4cee_fdf9_46c2_83bd_09836355f04e.slice/crio-7ea7dac1b199a50aba86347d4d2a8b9186cae742c7b75f9085b9504d47e19702 WatchSource:0}: Error finding container 7ea7dac1b199a50aba86347d4d2a8b9186cae742c7b75f9085b9504d47e19702: Status 404 returned error can't find the container with id 7ea7dac1b199a50aba86347d4d2a8b9186cae742c7b75f9085b9504d47e19702 Sep 08 04:00:54.373113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.373073 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-qdslj" event={"ID":"6ad2809a-6385-4f87-969c-c795837d5bec","Type":"ContainerStarted","Data":"c178969fc33e67e82deb7261fac916ba4ac3e3fce4b5695f645ded2599acad08"} Sep 08 04:00:54.373286 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.373254 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:54.375391 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.375364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f69889559-gqcqz" event={"ID":"a11b4cee-fdf9-46c2-83bd-09836355f04e","Type":"ContainerStarted","Data":"3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25"} Sep 08 04:00:54.375504 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.375406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f69889559-gqcqz" event={"ID":"a11b4cee-fdf9-46c2-83bd-09836355f04e","Type":"ContainerStarted","Data":"7ea7dac1b199a50aba86347d4d2a8b9186cae742c7b75f9085b9504d47e19702"} Sep 08 04:00:54.391036 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.391000 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-qdslj" Sep 08 04:00:54.393061 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.393003 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-qdslj" podStartSLOduration=1.9284598769999999 podStartE2EDuration="20.392984493s" totalImagesPullingTime="18.464524616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:54.392693033 +0000 UTC m=+335.717599179" watchObservedRunningTime="2026-09-08 04:00:54.392984493 +0000 UTC m=+335.717890642" Sep 08 04:00:54.438742 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.438490 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f69889559-gqcqz" podStartSLOduration=3.438467437 podStartE2EDuration="3.438467437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:54.436709757 +0000 UTC m=+335.761615903" watchObservedRunningTime="2026-09-08 04:00:54.438467437 +0000 UTC m=+335.763373584" Sep 08 04:00:54.789784 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.789744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:00:54.858479 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:00:54.858435 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:01.671151 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:01.671101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:01.696515 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:01.694775 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:01:01.696515 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:01.695559 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:01:01.703649 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:01.703619 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:01:01.748099 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:01.748067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:02.415994 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:02.415963 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:01:02.487488 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:02.487451 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cc4c477d-669fp"] Sep 08 04:01:04.194074 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:04.194033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:04.271212 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:04.271179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:04.420967 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:04.420932 2575 generic.go:356] "Generic (PLEG): container finished" podID="27c480f0-2dd8-4758-abce-7065251e4e48" containerID="d70bb7352edd7a2758ac8099966fd1effa4f70f1ab0dcffd98735d8e4026d2a9" exitCode=0 Sep 08 04:01:04.421131 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:04.421001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" event={"ID":"27c480f0-2dd8-4758-abce-7065251e4e48","Type":"ContainerDied","Data":"d70bb7352edd7a2758ac8099966fd1effa4f70f1ab0dcffd98735d8e4026d2a9"} Sep 08 04:01:04.421403 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:04.421374 2575 scope.go:117] "RemoveContainer" containerID="d70bb7352edd7a2758ac8099966fd1effa4f70f1ab0dcffd98735d8e4026d2a9" Sep 08 04:01:05.431251 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:05.431214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vgw82" event={"ID":"27c480f0-2dd8-4758-abce-7065251e4e48","Type":"ContainerStarted","Data":"950f0cd84406fd08a35d3a2f40ef52d0b410f408f435855049d9f54576694fe9"} Sep 08 04:01:09.738287 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:09.738254 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:01:09.742028 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:09.741999 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-569d4f5cd9-zqlz7" Sep 08 04:01:16.698158 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:16.698071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:16.800784 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:16.800746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:23.478724 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:23.478687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:23.779876 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:23.779789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:27.520963 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.520919 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56cc4c477d-669fp" podUID="cba41978-333d-4e15-b164-27f1c86f4ac4" containerName="console" containerID="cri-o://d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614" gracePeriod=15 Sep 08 04:01:27.791468 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.791396 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:01:27.873250 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873207 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-oauth-serving-cert\") pod \"cba41978-333d-4e15-b164-27f1c86f4ac4\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " Sep 08 04:01:27.873250 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873250 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-console-config\") pod \"cba41978-333d-4e15-b164-27f1c86f4ac4\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " Sep 08 04:01:27.873475 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873290 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-oauth-config\") pod \"cba41978-333d-4e15-b164-27f1c86f4ac4\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " Sep 08 04:01:27.873475 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873322 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phx2h\" (UniqueName: \"kubernetes.io/projected/cba41978-333d-4e15-b164-27f1c86f4ac4-kube-api-access-phx2h\") pod \"cba41978-333d-4e15-b164-27f1c86f4ac4\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " Sep 08 04:01:27.873475 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873349 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-service-ca\") pod \"cba41978-333d-4e15-b164-27f1c86f4ac4\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " Sep 08 04:01:27.873475 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873364 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-serving-cert\") pod \"cba41978-333d-4e15-b164-27f1c86f4ac4\" (UID: \"cba41978-333d-4e15-b164-27f1c86f4ac4\") " Sep 08 04:01:27.873801 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873767 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cba41978-333d-4e15-b164-27f1c86f4ac4" (UID: "cba41978-333d-4e15-b164-27f1c86f4ac4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:01:27.873877 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873776 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-console-config" (OuterVolumeSpecName: "console-config") pod "cba41978-333d-4e15-b164-27f1c86f4ac4" (UID: "cba41978-333d-4e15-b164-27f1c86f4ac4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:01:27.873877 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.873823 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-service-ca" (OuterVolumeSpecName: "service-ca") pod "cba41978-333d-4e15-b164-27f1c86f4ac4" (UID: "cba41978-333d-4e15-b164-27f1c86f4ac4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:01:27.875766 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.875732 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cba41978-333d-4e15-b164-27f1c86f4ac4" (UID: "cba41978-333d-4e15-b164-27f1c86f4ac4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:01:27.875867 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.875783 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cba41978-333d-4e15-b164-27f1c86f4ac4" (UID: "cba41978-333d-4e15-b164-27f1c86f4ac4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:01:27.875867 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.875800 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba41978-333d-4e15-b164-27f1c86f4ac4-kube-api-access-phx2h" (OuterVolumeSpecName: "kube-api-access-phx2h") pod "cba41978-333d-4e15-b164-27f1c86f4ac4" (UID: "cba41978-333d-4e15-b164-27f1c86f4ac4"). InnerVolumeSpecName "kube-api-access-phx2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:01:27.974708 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.974644 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:01:27.974708 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.974703 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:01:27.974708 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.974713 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:01:27.974945 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.974721 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phx2h\" (UniqueName: \"kubernetes.io/projected/cba41978-333d-4e15-b164-27f1c86f4ac4-kube-api-access-phx2h\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:01:27.974945 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.974731 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba41978-333d-4e15-b164-27f1c86f4ac4-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:01:27.974945 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:27.974739 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba41978-333d-4e15-b164-27f1c86f4ac4-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:01:28.521149 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.521116 2575 generic.go:356] "Generic (PLEG): container finished" podID="cba41978-333d-4e15-b164-27f1c86f4ac4" containerID="d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614" exitCode=0 Sep 08 04:01:28.521568 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.521161 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cc4c477d-669fp" Sep 08 04:01:28.521568 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.521178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cc4c477d-669fp" event={"ID":"cba41978-333d-4e15-b164-27f1c86f4ac4","Type":"ContainerDied","Data":"d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614"} Sep 08 04:01:28.521568 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.521218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cc4c477d-669fp" event={"ID":"cba41978-333d-4e15-b164-27f1c86f4ac4","Type":"ContainerDied","Data":"9d092198f22ec0d7d6f198062b76b8fd958930feae2c1e7fc67aecce04307ea4"} Sep 08 04:01:28.521568 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.521238 2575 scope.go:117] "RemoveContainer" containerID="d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614" Sep 08 04:01:28.529999 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.529980 2575 scope.go:117] "RemoveContainer" containerID="d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614" Sep 08 04:01:28.530293 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:01:28.530271 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614\": container with ID starting with d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614 not found: ID does not exist" containerID="d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614" Sep 08 04:01:28.530353 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.530305 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614"} err="failed to get container status \"d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614\": rpc error: code = NotFound desc = could not find container \"d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614\": container with ID starting with d245737a9aaefcc734814d9d2329f1b9c3acba48e253c52defc31039d23f1614 not found: ID does not exist" Sep 08 04:01:28.543247 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.543215 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cc4c477d-669fp"] Sep 08 04:01:28.547461 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:28.547437 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56cc4c477d-669fp"] Sep 08 04:01:29.194958 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:29.194926 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba41978-333d-4e15-b164-27f1c86f4ac4" path="/var/lib/kubelet/pods/cba41978-333d-4e15-b164-27f1c86f4ac4/volumes" Sep 08 04:01:31.658467 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:31.658431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:31.721520 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:31.721485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:32.006953 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:32.006867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 04:01:32.009134 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:32.009114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53110014-8f58-4ce0-820b-20aeba80aa90-metrics-certs\") pod \"network-metrics-daemon-qcndh\" (UID: \"53110014-8f58-4ce0-820b-20aeba80aa90\") " pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 04:01:32.298586 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:32.298505 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzmtk\"" Sep 08 04:01:32.306190 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:32.306162 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcndh" Sep 08 04:01:32.617153 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:32.616954 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qcndh"] Sep 08 04:01:32.619785 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:01:32.619758 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53110014_8f58_4ce0_820b_20aeba80aa90.slice/crio-f5dd91ce11d6b585618c72425bbb33c11ee2af55e96bca3ee35b4a97bfde7d72 WatchSource:0}: Error finding container f5dd91ce11d6b585618c72425bbb33c11ee2af55e96bca3ee35b4a97bfde7d72: Status 404 returned error can't find the container with id f5dd91ce11d6b585618c72425bbb33c11ee2af55e96bca3ee35b4a97bfde7d72 Sep 08 04:01:33.541002 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:33.540958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcndh" event={"ID":"53110014-8f58-4ce0-820b-20aeba80aa90","Type":"ContainerStarted","Data":"f5dd91ce11d6b585618c72425bbb33c11ee2af55e96bca3ee35b4a97bfde7d72"} Sep 08 04:01:34.547690 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:34.547581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcndh" event={"ID":"53110014-8f58-4ce0-820b-20aeba80aa90","Type":"ContainerStarted","Data":"02e1629631439fc5573508384a8623db23c21bdc9f1d018a864b2b5ff8b5836d"} Sep 08 04:01:34.547690 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:34.547636 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcndh" event={"ID":"53110014-8f58-4ce0-820b-20aeba80aa90","Type":"ContainerStarted","Data":"b789363232abeab76c4e7eab11aa29e584b1ac7c79d9ed811e4762051a9d5d06"} Sep 08 04:01:34.571134 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:34.571075 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qcndh" podStartSLOduration=374.185775432 podStartE2EDuration="6m15.571058796s" totalImagesPullingTime="1.385283364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:34.570507145 +0000 UTC m=+375.895413291" watchObservedRunningTime="2026-09-08 04:01:34.571058796 +0000 UTC m=+375.895964983" Sep 08 04:01:34.692355 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:34.692319 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:34.765908 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:34.765878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:44.126380 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:44.126339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:44.225506 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:44.225471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:47.381523 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.381489 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 04:01:47.381904 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.381783 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba41978-333d-4e15-b164-27f1c86f4ac4" containerName="console" Sep 08 04:01:47.381904 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.381795 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba41978-333d-4e15-b164-27f1c86f4ac4" containerName="console" Sep 08 04:01:47.381904 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.381892 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba41978-333d-4e15-b164-27f1c86f4ac4" containerName="console" Sep 08 04:01:47.385279 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.385258 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.388414 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388390 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 04:01:47.388414 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388408 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 04:01:47.388612 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388400 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 04:01:47.388840 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388814 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 04:01:47.388947 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388840 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8dtdw\"" Sep 08 04:01:47.388947 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 04:01:47.388947 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388824 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 04:01:47.388947 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.388824 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 04:01:47.389379 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.389223 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 04:01:47.395065 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.395045 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 04:01:47.408391 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.408362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 04:01:47.421705 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421846 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421846 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe3eb0a4-7815-472b-993b-b42f9e2b3210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421846 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe3eb0a4-7815-472b-993b-b42f9e2b3210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kq66\" (UniqueName: \"kubernetes.io/projected/fe3eb0a4-7815-472b-993b-b42f9e2b3210-kube-api-access-8kq66\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe3eb0a4-7815-472b-993b-b42f9e2b3210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.421969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe3eb0a4-7815-472b-993b-b42f9e2b3210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.422102 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.421975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe3eb0a4-7815-472b-993b-b42f9e2b3210-config-out\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.422102 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.422008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.422102 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.422028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-web-config\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.422102 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.422058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.422102 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.422080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522520 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522520 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe3eb0a4-7815-472b-993b-b42f9e2b3210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe3eb0a4-7815-472b-993b-b42f9e2b3210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kq66\" (UniqueName: \"kubernetes.io/projected/fe3eb0a4-7815-472b-993b-b42f9e2b3210-kube-api-access-8kq66\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe3eb0a4-7815-472b-993b-b42f9e2b3210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.522793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe3eb0a4-7815-472b-993b-b42f9e2b3210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe3eb0a4-7815-472b-993b-b42f9e2b3210-config-out\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-web-config\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.522962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523507 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.523481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe3eb0a4-7815-472b-993b-b42f9e2b3210-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523702 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.523605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe3eb0a4-7815-472b-993b-b42f9e2b3210-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.523987 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.523961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe3eb0a4-7815-472b-993b-b42f9e2b3210-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.525931 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.525810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.525931 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.525901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-web-config\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.525931 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.525899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.526158 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.526127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe3eb0a4-7815-472b-993b-b42f9e2b3210-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.526299 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.526280 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe3eb0a4-7815-472b-993b-b42f9e2b3210-config-out\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.526515 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.526491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.527038 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.527009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.527233 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.527214 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.527551 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.527535 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe3eb0a4-7815-472b-993b-b42f9e2b3210-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.533052 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.533035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kq66\" (UniqueName: \"kubernetes.io/projected/fe3eb0a4-7815-472b-993b-b42f9e2b3210-kube-api-access-8kq66\") pod \"alertmanager-main-0\" (UID: \"fe3eb0a4-7815-472b-993b-b42f9e2b3210\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.696319 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.696225 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 04:01:47.981203 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:47.981171 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 04:01:47.982484 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:01:47.982450 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3eb0a4_7815_472b_993b_b42f9e2b3210.slice/crio-1e5d33571e6345584249713f109e0c92739c9b306d86aab8c65ea7d2b7987435 WatchSource:0}: Error finding container 1e5d33571e6345584249713f109e0c92739c9b306d86aab8c65ea7d2b7987435: Status 404 returned error can't find the container with id 1e5d33571e6345584249713f109e0c92739c9b306d86aab8c65ea7d2b7987435 Sep 08 04:01:48.601708 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:48.601672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"1e5d33571e6345584249713f109e0c92739c9b306d86aab8c65ea7d2b7987435"} Sep 08 04:01:49.608850 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:49.608762 2575 generic.go:356] "Generic (PLEG): container finished" podID="fe3eb0a4-7815-472b-993b-b42f9e2b3210" containerID="5d7f45c41d3d58582c754bba9d47b18610db2cc3bf38bcf8c09e76c24653ea2d" exitCode=0 Sep 08 04:01:49.608850 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:49.608810 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerDied","Data":"5d7f45c41d3d58582c754bba9d47b18610db2cc3bf38bcf8c09e76c24653ea2d"} Sep 08 04:01:51.620503 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.620420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"f89345229469d020774d630f200ee2f73e0f0fc9f7acb1d85c2a373165fc96f0"} Sep 08 04:01:51.620503 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.620487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"8a1dd34da2e18a4e1746a585a2eaa8f1a928e1b25a353cd6c3d728f5396a3e7a"} Sep 08 04:01:51.620923 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.620512 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"e6162819c1adf4d1d2c97915a1efe968897470a0a7dbd909d0f2353482544c23"} Sep 08 04:01:51.620923 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.620537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"7562b6d46b2fc255f43aa8e92092fcd39aaa4843d1be3c5a0098f1cd6c7792a5"} Sep 08 04:01:51.620923 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.620561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"73c440b9b4b783a72af6c3cb6c29da71fa3e17c6006ce9ac1df929fd3b614c93"} Sep 08 04:01:51.620923 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.620582 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe3eb0a4-7815-472b-993b-b42f9e2b3210","Type":"ContainerStarted","Data":"5aa77b6ca1efc27a901558f44dcf07bf75c1a5da1fee5d15c04e89bb72c82007"} Sep 08 04:01:51.655192 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:51.655127 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.106811846 podStartE2EDuration="4.655107729s" totalImagesPullingTime="2.525674121s" totalInitContainerRuntime="22.621762ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:51.653742569 +0000 UTC m=+392.978648717" watchObservedRunningTime="2026-09-08 04:01:51.655107729 +0000 UTC m=+392.980013874" Sep 08 04:01:52.513603 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.513567 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b86d5c7f6-4fsps"] Sep 08 04:01:52.516939 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.516916 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.536385 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.536357 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b86d5c7f6-4fsps"] Sep 08 04:01:52.569474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-oauth-serving-cert\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.569696 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-serving-cert\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.569696 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-service-ca\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.569696 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-oauth-config\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.569696 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-trusted-ca-bundle\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.569696 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-console-config\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.569915 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.569717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfk2r\" (UniqueName: \"kubernetes.io/projected/b413532c-ad41-49d4-aa8f-941cee37b373-kube-api-access-hfk2r\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670154 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-console-config\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670154 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfk2r\" (UniqueName: \"kubernetes.io/projected/b413532c-ad41-49d4-aa8f-941cee37b373-kube-api-access-hfk2r\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-oauth-serving-cert\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-serving-cert\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-service-ca\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-oauth-config\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.670745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.670540 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-trusted-ca-bundle\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.671066 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.671017 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-console-config\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.671253 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.671230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-service-ca\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.671411 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.671390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-oauth-serving-cert\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.671488 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.671449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-trusted-ca-bundle\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.672973 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.672949 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-oauth-config\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.673250 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.673229 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-serving-cert\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.673789 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.673755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:52.690381 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.690360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfk2r\" (UniqueName: \"kubernetes.io/projected/b413532c-ad41-49d4-aa8f-941cee37b373-kube-api-access-hfk2r\") pod \"console-5b86d5c7f6-4fsps\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:52.771355 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.771263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:52.826862 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:52.826822 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:01:53.100958 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:53.100930 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b86d5c7f6-4fsps"] Sep 08 04:01:53.103957 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:01:53.103928 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb413532c_ad41_49d4_aa8f_941cee37b373.slice/crio-33617e727c6a39f2cb0a25fffb2554442eca59b4c977b10dac26e528c65accb0 WatchSource:0}: Error finding container 33617e727c6a39f2cb0a25fffb2554442eca59b4c977b10dac26e528c65accb0: Status 404 returned error can't find the container with id 33617e727c6a39f2cb0a25fffb2554442eca59b4c977b10dac26e528c65accb0 Sep 08 04:01:53.631673 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:53.631615 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86d5c7f6-4fsps" event={"ID":"b413532c-ad41-49d4-aa8f-941cee37b373","Type":"ContainerStarted","Data":"54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e"} Sep 08 04:01:53.631830 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:53.631682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86d5c7f6-4fsps" event={"ID":"b413532c-ad41-49d4-aa8f-941cee37b373","Type":"ContainerStarted","Data":"33617e727c6a39f2cb0a25fffb2554442eca59b4c977b10dac26e528c65accb0"} Sep 08 04:01:53.656396 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:53.656333 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b86d5c7f6-4fsps" podStartSLOduration=1.656316573 podStartE2EDuration="1.656316573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:53.656152799 +0000 UTC m=+394.981058948" watchObservedRunningTime="2026-09-08 04:01:53.656316573 +0000 UTC m=+394.981222765" Sep 08 04:01:55.519244 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:55.519210 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:55.625396 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:55.625360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:55.721623 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:55.721589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:55.883701 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:55.883675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:01:55.959190 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:01:55.959157 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:02.827640 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:02.827594 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:02:02.828190 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:02.827680 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:02:02.832859 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:02.832833 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:02:03.679947 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:03.679920 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:02:03.731481 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:03.731411 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f69889559-gqcqz"] Sep 08 04:02:03.846252 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:03.846222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:03.947001 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:03.946912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:04.047877 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:04.047844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:16.604973 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:16.604938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:17.834025 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:17.833991 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:19.122300 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:19.122270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:19.918709 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:19.918642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:20.029075 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:20.029041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:28.758523 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:28.758462 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f69889559-gqcqz" podUID="a11b4cee-fdf9-46c2-83bd-09836355f04e" containerName="console" containerID="cri-o://3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25" gracePeriod=15 Sep 08 04:02:28.997033 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:28.997009 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:02:29.072532 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072432 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlr5r\" (UniqueName: \"kubernetes.io/projected/a11b4cee-fdf9-46c2-83bd-09836355f04e-kube-api-access-rlr5r\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.072532 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072481 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-serving-cert\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.072532 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072500 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-config\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.072532 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072533 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-trusted-ca-bundle\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.072892 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072708 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-oauth-config\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.072892 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072758 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-service-ca\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.072892 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072792 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-oauth-serving-cert\") pod \"a11b4cee-fdf9-46c2-83bd-09836355f04e\" (UID: \"a11b4cee-fdf9-46c2-83bd-09836355f04e\") " Sep 08 04:02:29.073054 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072916 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:02:29.073054 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.072927 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-config" (OuterVolumeSpecName: "console-config") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:02:29.073151 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.073075 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-trusted-ca-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.073151 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.073093 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.073248 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.073214 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:02:29.073302 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.073269 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:02:29.074668 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.074617 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:02:29.074885 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.074863 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:02:29.074885 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.074867 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11b4cee-fdf9-46c2-83bd-09836355f04e-kube-api-access-rlr5r" (OuterVolumeSpecName: "kube-api-access-rlr5r") pod "a11b4cee-fdf9-46c2-83bd-09836355f04e" (UID: "a11b4cee-fdf9-46c2-83bd-09836355f04e"). InnerVolumeSpecName "kube-api-access-rlr5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:02:29.173419 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.173387 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.173419 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.173414 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.173419 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.173425 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11b4cee-fdf9-46c2-83bd-09836355f04e-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.173630 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.173435 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlr5r\" (UniqueName: \"kubernetes.io/projected/a11b4cee-fdf9-46c2-83bd-09836355f04e-kube-api-access-rlr5r\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.173630 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.173446 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11b4cee-fdf9-46c2-83bd-09836355f04e-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:02:29.776609 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.776575 2575 generic.go:356] "Generic (PLEG): container finished" podID="a11b4cee-fdf9-46c2-83bd-09836355f04e" containerID="3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25" exitCode=0 Sep 08 04:02:29.777051 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.776617 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f69889559-gqcqz" Sep 08 04:02:29.777051 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.776664 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f69889559-gqcqz" event={"ID":"a11b4cee-fdf9-46c2-83bd-09836355f04e","Type":"ContainerDied","Data":"3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25"} Sep 08 04:02:29.777051 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.776711 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f69889559-gqcqz" event={"ID":"a11b4cee-fdf9-46c2-83bd-09836355f04e","Type":"ContainerDied","Data":"7ea7dac1b199a50aba86347d4d2a8b9186cae742c7b75f9085b9504d47e19702"} Sep 08 04:02:29.777051 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.776729 2575 scope.go:117] "RemoveContainer" containerID="3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25" Sep 08 04:02:29.784945 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.784929 2575 scope.go:117] "RemoveContainer" containerID="3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25" Sep 08 04:02:29.785249 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:02:29.785225 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25\": container with ID starting with 3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25 not found: ID does not exist" containerID="3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25" Sep 08 04:02:29.785323 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.785260 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25"} err="failed to get container status \"3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25\": rpc error: code = NotFound desc = could not find container \"3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25\": container with ID starting with 3b95ec178baaf458b15737b877d928aef242e09e1e6bca9b1506d970ff974f25 not found: ID does not exist" Sep 08 04:02:29.796544 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.796515 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f69889559-gqcqz"] Sep 08 04:02:29.804685 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:29.804642 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f69889559-gqcqz"] Sep 08 04:02:31.195750 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:31.195715 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a11b4cee-fdf9-46c2-83bd-09836355f04e" path="/var/lib/kubelet/pods/a11b4cee-fdf9-46c2-83bd-09836355f04e/volumes" Sep 08 04:02:59.391331 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:59.391292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:02:59.472480 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:02:59.472449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:11.279342 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:11.279304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:11.342422 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:11.342387 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:16.668594 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:16.668561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:16.769129 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:16.769092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:17.014693 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:17.014578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:18.929401 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:18.929365 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-555fd5b8bc-x85zb"] Sep 08 04:03:18.929793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:18.929695 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b4cee-fdf9-46c2-83bd-09836355f04e" containerName="console" Sep 08 04:03:18.929793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:18.929707 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b4cee-fdf9-46c2-83bd-09836355f04e" containerName="console" Sep 08 04:03:18.929793 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:18.929764 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b4cee-fdf9-46c2-83bd-09836355f04e" containerName="console" Sep 08 04:03:18.932614 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:18.932598 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:18.963205 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:18.963174 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-555fd5b8bc-x85zb"] Sep 08 04:03:19.033714 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.033675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:19.090236 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-service-ca\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.090409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-oauth-config\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.090409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9kt\" (UniqueName: \"kubernetes.io/projected/5da13415-119e-4e67-a5fc-4ce0e13344b5-kube-api-access-tt9kt\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.090409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-serving-cert\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.090409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-trusted-ca-bundle\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.090409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-config\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.090409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.090386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-oauth-serving-cert\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191004 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.190919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-oauth-serving-cert\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191004 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.190992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-service-ca\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191201 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-oauth-config\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191201 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9kt\" (UniqueName: \"kubernetes.io/projected/5da13415-119e-4e67-a5fc-4ce0e13344b5-kube-api-access-tt9kt\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191201 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-serving-cert\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191201 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-trusted-ca-bundle\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-config\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191742 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-oauth-serving-cert\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191909 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-service-ca\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.191990 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.191840 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-config\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.192574 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.192548 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-trusted-ca-bundle\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.194051 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.194012 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-oauth-config\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.194145 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.194106 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-serving-cert\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.202200 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.202182 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9kt\" (UniqueName: \"kubernetes.io/projected/5da13415-119e-4e67-a5fc-4ce0e13344b5-kube-api-access-tt9kt\") pod \"console-555fd5b8bc-x85zb\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.242873 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.242848 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:19.526376 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.526351 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-555fd5b8bc-x85zb"] Sep 08 04:03:19.528820 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:03:19.528793 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da13415_119e_4e67_a5fc_4ce0e13344b5.slice/crio-69c698e9555b43c799fa74532251ff16511d4e37ebd2ecca7a88ba99b39eeff8 WatchSource:0}: Error finding container 69c698e9555b43c799fa74532251ff16511d4e37ebd2ecca7a88ba99b39eeff8: Status 404 returned error can't find the container with id 69c698e9555b43c799fa74532251ff16511d4e37ebd2ecca7a88ba99b39eeff8 Sep 08 04:03:19.979469 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.979429 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-555fd5b8bc-x85zb" event={"ID":"5da13415-119e-4e67-a5fc-4ce0e13344b5","Type":"ContainerStarted","Data":"d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912"} Sep 08 04:03:19.979877 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:19.979506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-555fd5b8bc-x85zb" event={"ID":"5da13415-119e-4e67-a5fc-4ce0e13344b5","Type":"ContainerStarted","Data":"69c698e9555b43c799fa74532251ff16511d4e37ebd2ecca7a88ba99b39eeff8"} Sep 08 04:03:20.000674 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:20.000612 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-555fd5b8bc-x85zb" podStartSLOduration=2.000595935 podStartE2EDuration="2.000595935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:03:19.999409465 +0000 UTC m=+481.324315611" watchObservedRunningTime="2026-09-08 04:03:20.000595935 +0000 UTC m=+481.325502081" Sep 08 04:03:29.243253 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:29.243217 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:29.243749 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:29.243294 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:29.248000 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:29.247981 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:30.022560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:30.022531 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:03:30.077232 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:30.077193 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b86d5c7f6-4fsps"] Sep 08 04:03:30.258012 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:30.257954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:30.349197 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:30.349112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:41.105527 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:41.105493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:03:55.098984 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.098938 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b86d5c7f6-4fsps" podUID="b413532c-ad41-49d4-aa8f-941cee37b373" containerName="console" containerID="cri-o://54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e" gracePeriod=15 Sep 08 04:03:55.331977 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.331952 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:03:55.379634 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379553 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-oauth-serving-cert\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.379634 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379589 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-service-ca\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.379634 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379627 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfk2r\" (UniqueName: \"kubernetes.io/projected/b413532c-ad41-49d4-aa8f-941cee37b373-kube-api-access-hfk2r\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.379934 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379670 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-trusted-ca-bundle\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.379934 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379693 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-serving-cert\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.379934 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379707 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-console-config\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.379934 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.379758 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-oauth-config\") pod \"b413532c-ad41-49d4-aa8f-941cee37b373\" (UID: \"b413532c-ad41-49d4-aa8f-941cee37b373\") " Sep 08 04:03:55.380143 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.380054 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:03:55.380143 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.380064 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-service-ca" (OuterVolumeSpecName: "service-ca") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:03:55.380143 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.380107 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:03:55.380429 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.380395 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-console-config" (OuterVolumeSpecName: "console-config") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:03:55.381915 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.381894 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:03:55.381915 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.381899 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b413532c-ad41-49d4-aa8f-941cee37b373-kube-api-access-hfk2r" (OuterVolumeSpecName: "kube-api-access-hfk2r") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "kube-api-access-hfk2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:03:55.382039 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.381996 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b413532c-ad41-49d4-aa8f-941cee37b373" (UID: "b413532c-ad41-49d4-aa8f-941cee37b373"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:03:55.480815 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480781 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:55.480815 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480809 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:55.480815 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480819 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfk2r\" (UniqueName: \"kubernetes.io/projected/b413532c-ad41-49d4-aa8f-941cee37b373-kube-api-access-hfk2r\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:55.481031 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480828 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-trusted-ca-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:55.481031 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480837 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:55.481031 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480846 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b413532c-ad41-49d4-aa8f-941cee37b373-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:55.481031 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:55.480854 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b413532c-ad41-49d4-aa8f-941cee37b373-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:03:56.123640 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.123604 2575 generic.go:356] "Generic (PLEG): container finished" podID="b413532c-ad41-49d4-aa8f-941cee37b373" containerID="54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e" exitCode=0 Sep 08 04:03:56.124068 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.123651 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86d5c7f6-4fsps" Sep 08 04:03:56.124068 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.123696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86d5c7f6-4fsps" event={"ID":"b413532c-ad41-49d4-aa8f-941cee37b373","Type":"ContainerDied","Data":"54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e"} Sep 08 04:03:56.124068 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.123748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86d5c7f6-4fsps" event={"ID":"b413532c-ad41-49d4-aa8f-941cee37b373","Type":"ContainerDied","Data":"33617e727c6a39f2cb0a25fffb2554442eca59b4c977b10dac26e528c65accb0"} Sep 08 04:03:56.124068 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.123770 2575 scope.go:117] "RemoveContainer" containerID="54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e" Sep 08 04:03:56.132399 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.132383 2575 scope.go:117] "RemoveContainer" containerID="54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e" Sep 08 04:03:56.132667 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:03:56.132639 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e\": container with ID starting with 54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e not found: ID does not exist" containerID="54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e" Sep 08 04:03:56.132721 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.132687 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e"} err="failed to get container status \"54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e\": rpc error: code = NotFound desc = could not find container \"54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e\": container with ID starting with 54328c86703b9dcd38013af677bb87bffb9202ee5f7831a418058149fb9e5b9e not found: ID does not exist" Sep 08 04:03:56.146069 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.146040 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b86d5c7f6-4fsps"] Sep 08 04:03:56.150355 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:56.150331 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b86d5c7f6-4fsps"] Sep 08 04:03:57.195238 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:57.195206 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b413532c-ad41-49d4-aa8f-941cee37b373" path="/var/lib/kubelet/pods/b413532c-ad41-49d4-aa8f-941cee37b373/volumes" Sep 08 04:03:58.169332 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:03:58.169297 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:15.427010 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:15.426930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:15.609986 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:15.609952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:15.714101 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:15.714027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:16.868053 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.868013 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds"] Sep 08 04:04:16.868444 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.868350 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b413532c-ad41-49d4-aa8f-941cee37b373" containerName="console" Sep 08 04:04:16.868444 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.868362 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b413532c-ad41-49d4-aa8f-941cee37b373" containerName="console" Sep 08 04:04:16.868444 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.868415 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b413532c-ad41-49d4-aa8f-941cee37b373" containerName="console" Sep 08 04:04:16.871516 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.871499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:16.875745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.875717 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qvw5w\"" Sep 08 04:04:16.875896 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.875724 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 08 04:04:16.876696 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.876681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 08 04:04:16.885435 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.885411 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds"] Sep 08 04:04:16.968691 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.968634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:16.968874 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.968712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:16.968874 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:16.968750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7cr4\" (UniqueName: \"kubernetes.io/projected/4d9cd091-02fd-4545-8f4b-6144b39ecd89-kube-api-access-n7cr4\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.069554 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.069511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7cr4\" (UniqueName: \"kubernetes.io/projected/4d9cd091-02fd-4545-8f4b-6144b39ecd89-kube-api-access-n7cr4\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.069768 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.069577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.069768 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.069633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.070048 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.070025 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.070115 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.070050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.078390 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.078370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7cr4\" (UniqueName: \"kubernetes.io/projected/4d9cd091-02fd-4545-8f4b-6144b39ecd89-kube-api-access-n7cr4\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.181203 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.181167 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:17.286384 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.286351 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:17.296118 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.296089 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw"] Sep 08 04:04:17.299467 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.299449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.303610 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.303587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 08 04:04:17.303870 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.303853 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 08 04:04:17.303870 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.303866 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 08 04:04:17.305218 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.305198 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 08 04:04:17.305539 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.305521 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 08 04:04:17.306008 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.305993 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 08 04:04:17.306079 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.305994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dzxnr\"" Sep 08 04:04:17.322605 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.322567 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw"] Sep 08 04:04:17.384233 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.384199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:17.454126 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.454044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds"] Sep 08 04:04:17.456924 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:04:17.456895 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9cd091_02fd_4545_8f4b_6144b39ecd89.slice/crio-d40d1cd3bd2ee4266c991ca7fc67af501d30a8adef85e3522326eae787772298 WatchSource:0}: Error finding container d40d1cd3bd2ee4266c991ca7fc67af501d30a8adef85e3522326eae787772298: Status 404 returned error can't find the container with id d40d1cd3bd2ee4266c991ca7fc67af501d30a8adef85e3522326eae787772298 Sep 08 04:04:17.473230 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.473358 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.473358 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdwb2\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-kube-api-access-vdwb2\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.473358 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.473463 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/131d6f53-bb45-43bf-96be-4138751a55f8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.473463 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.473463 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.473443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.574872 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.574829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.574872 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.574871 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdwb2\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-kube-api-access-vdwb2\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.575113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.574895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.575113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.574922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/131d6f53-bb45-43bf-96be-4138751a55f8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.575113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.574964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.575113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.575010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.575113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.575066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.575621 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.575596 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.577379 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.577354 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.577379 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.577369 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.577607 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.577592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/131d6f53-bb45-43bf-96be-4138751a55f8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.577747 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.577729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.584383 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.584360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.584864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.584843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdwb2\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-kube-api-access-vdwb2\") pod \"istiod-openshift-gateway-7b7995d5cd-gg8qw\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.608712 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.608674 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:17.909898 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:17.909869 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw"] Sep 08 04:04:18.213441 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:18.213363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" event={"ID":"4d9cd091-02fd-4545-8f4b-6144b39ecd89","Type":"ContainerStarted","Data":"d40d1cd3bd2ee4266c991ca7fc67af501d30a8adef85e3522326eae787772298"} Sep 08 04:04:18.215687 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:18.215611 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" event={"ID":"131d6f53-bb45-43bf-96be-4138751a55f8","Type":"ContainerStarted","Data":"04eab5a72d88a77a6dabee55c951092e715e80a98ce63ddf108a791550a82dbf"} Sep 08 04:04:18.518857 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:18.518770 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:20.671884 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:20.671826 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:20.672227 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:20.671917 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:21.232484 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.232445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" event={"ID":"131d6f53-bb45-43bf-96be-4138751a55f8","Type":"ContainerStarted","Data":"849e85351723135b43127ad66f58a98c447b5c4ed5b47e018a26559974c74b18"} Sep 08 04:04:21.232719 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.232698 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:21.234476 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.234442 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-gg8qw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 08 04:04:21.234619 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.234495 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" podUID="131d6f53-bb45-43bf-96be-4138751a55f8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 04:04:21.257454 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.257399 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" podStartSLOduration=1.497967956 podStartE2EDuration="4.257381745s" totalImagesPullingTime="2.759413789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:04:21.255088848 +0000 UTC m=+542.579994994" watchObservedRunningTime="2026-09-08 04:04:21.257381745 +0000 UTC m=+542.582287890" Sep 08 04:04:21.446113 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.446064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:21.552872 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:21.552793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:22.004940 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:22.004902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:22.111240 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:22.111201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:22.213484 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:22.213413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:22.238501 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:22.238473 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:04:23.243469 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:23.243440 2575 generic.go:356] "Generic (PLEG): container finished" podID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerID="883b8206c8a1f02b57f7ff9eab876e46920d1cb0eee6096d8208c0f1bcdaaa2b" exitCode=0 Sep 08 04:04:23.243895 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:23.243525 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" event={"ID":"4d9cd091-02fd-4545-8f4b-6144b39ecd89","Type":"ContainerDied","Data":"883b8206c8a1f02b57f7ff9eab876e46920d1cb0eee6096d8208c0f1bcdaaa2b"} Sep 08 04:04:24.906559 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:24.906526 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:26.261464 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:26.261429 2575 generic.go:356] "Generic (PLEG): container finished" podID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerID="559f07c7dacc028601cccdd210425846d297d1fd76d98df91ad1e635e6655f17" exitCode=0 Sep 08 04:04:26.261880 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:26.261467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" event={"ID":"4d9cd091-02fd-4545-8f4b-6144b39ecd89","Type":"ContainerDied","Data":"559f07c7dacc028601cccdd210425846d297d1fd76d98df91ad1e635e6655f17"} Sep 08 04:04:33.295244 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:33.295203 2575 generic.go:356] "Generic (PLEG): container finished" podID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerID="1c86850648afa3865fa9862f766b0fc85c83b02c9b8494d88d6682afbd64b336" exitCode=0 Sep 08 04:04:33.295638 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:33.295275 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" event={"ID":"4d9cd091-02fd-4545-8f4b-6144b39ecd89","Type":"ContainerDied","Data":"1c86850648afa3865fa9862f766b0fc85c83b02c9b8494d88d6682afbd64b336"} Sep 08 04:04:34.430376 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.430349 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:34.519120 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.519087 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-util\") pod \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " Sep 08 04:04:34.519301 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.519140 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7cr4\" (UniqueName: \"kubernetes.io/projected/4d9cd091-02fd-4545-8f4b-6144b39ecd89-kube-api-access-n7cr4\") pod \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " Sep 08 04:04:34.519301 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.519176 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-bundle\") pod \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\" (UID: \"4d9cd091-02fd-4545-8f4b-6144b39ecd89\") " Sep 08 04:04:34.519599 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.519574 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-bundle" (OuterVolumeSpecName: "bundle") pod "4d9cd091-02fd-4545-8f4b-6144b39ecd89" (UID: "4d9cd091-02fd-4545-8f4b-6144b39ecd89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:34.521385 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.521355 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d9cd091-02fd-4545-8f4b-6144b39ecd89-kube-api-access-n7cr4" (OuterVolumeSpecName: "kube-api-access-n7cr4") pod "4d9cd091-02fd-4545-8f4b-6144b39ecd89" (UID: "4d9cd091-02fd-4545-8f4b-6144b39ecd89"). InnerVolumeSpecName "kube-api-access-n7cr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:34.524047 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.524027 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-util" (OuterVolumeSpecName: "util") pod "4d9cd091-02fd-4545-8f4b-6144b39ecd89" (UID: "4d9cd091-02fd-4545-8f4b-6144b39ecd89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:34.620638 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.620556 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-util\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:04:34.620638 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.620584 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7cr4\" (UniqueName: \"kubernetes.io/projected/4d9cd091-02fd-4545-8f4b-6144b39ecd89-kube-api-access-n7cr4\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:04:34.620638 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:34.620594 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d9cd091-02fd-4545-8f4b-6144b39ecd89-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:04:35.306646 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:35.306614 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" Sep 08 04:04:35.306646 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:35.306613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ef4nds" event={"ID":"4d9cd091-02fd-4545-8f4b-6144b39ecd89","Type":"ContainerDied","Data":"d40d1cd3bd2ee4266c991ca7fc67af501d30a8adef85e3522326eae787772298"} Sep 08 04:04:35.306876 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:35.306707 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d40d1cd3bd2ee4266c991ca7fc67af501d30a8adef85e3522326eae787772298" Sep 08 04:04:39.305118 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:39.305076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:39.402353 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:39.402321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:47.242821 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:47.242778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:51.828351 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:51.828308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:54.514912 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:54.514877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:55.128298 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:55.128267 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:55.275538 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:55.275504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:55.386632 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:55.386596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:56.461181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:56.461149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:57.033481 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:57.033444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:57.377508 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:57.377423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:57.642645 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:57.642614 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:57.757786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:57.757751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:57.975474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:57.975395 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:04:58.556570 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:04:58.556538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:01.734050 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:01.734017 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:01.848743 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:01.848703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:03.637457 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:03.637419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:03.830560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:03.830524 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:04.262082 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:04.262047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:04.356480 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:04.356449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:04.459009 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:04.458977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.055174 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.055140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.150309 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.150272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.214609 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.214580 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7"] Sep 08 04:05:05.214995 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.214968 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="extract" Sep 08 04:05:05.214995 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.214996 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="extract" Sep 08 04:05:05.215171 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.215011 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="pull" Sep 08 04:05:05.215171 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.215017 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="pull" Sep 08 04:05:05.215171 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.215034 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="util" Sep 08 04:05:05.215171 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.215039 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="util" Sep 08 04:05:05.215171 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.215109 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d9cd091-02fd-4545-8f4b-6144b39ecd89" containerName="extract" Sep 08 04:05:05.218127 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.218111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.220894 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.220871 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 08 04:05:05.225896 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.225867 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 08 04:05:05.226080 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.226064 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wdq29\"" Sep 08 04:05:05.226156 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.226076 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 04:05:05.226156 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.226096 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 08 04:05:05.226342 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.226326 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 08 04:05:05.250127 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.250094 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7"] Sep 08 04:05:05.284916 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.284883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-manifests\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.285083 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.284943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.285083 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.284975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-metrics-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.285083 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.284993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-tmp\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.285083 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.285045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.285269 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.285087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps9mz\" (UniqueName: \"kubernetes.io/projected/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-kube-api-access-ps9mz\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.319946 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.319858 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.386415 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-manifests\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.386623 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.386623 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386459 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-metrics-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.386623 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-tmp\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.386623 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.386874 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps9mz\" (UniqueName: \"kubernetes.io/projected/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-kube-api-access-ps9mz\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.386874 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.386864 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-manifests\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.388955 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.388928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-tmp\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.389139 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.389119 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.389185 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.389155 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.389185 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.389119 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-metrics-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.400723 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.400690 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps9mz\" (UniqueName: \"kubernetes.io/projected/bc92f0e8-ea52-48cb-bbb7-e4acc5526e38-kube-api-access-ps9mz\") pod \"opendatahub-operator-controller-manager-b8484c5b8-5x8g7\" (UID: \"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.440668 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.440622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.528235 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.528195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:05.551758 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.551723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.651868 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.651831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:05.811747 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:05.811681 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7"] Sep 08 04:05:05.813974 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:05:05.813944 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc92f0e8_ea52_48cb_bbb7_e4acc5526e38.slice/crio-0a29d096be164301b85b45c50c10f7d35bce69614bc4cec2e8c5ab49a987a3f7 WatchSource:0}: Error finding container 0a29d096be164301b85b45c50c10f7d35bce69614bc4cec2e8c5ab49a987a3f7: Status 404 returned error can't find the container with id 0a29d096be164301b85b45c50c10f7d35bce69614bc4cec2e8c5ab49a987a3f7 Sep 08 04:05:06.296557 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:06.296508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:06.390597 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:06.390299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:06.439114 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:06.439058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" event={"ID":"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38","Type":"ContainerStarted","Data":"0a29d096be164301b85b45c50c10f7d35bce69614bc4cec2e8c5ab49a987a3f7"} Sep 08 04:05:07.464339 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:07.464299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:09.230766 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:09.230731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:09.454185 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:09.454154 2575 generic.go:356] "Generic (PLEG): container finished" podID="bc92f0e8-ea52-48cb-bbb7-e4acc5526e38" containerID="ddf852bd6934ff73805eabc635683de5b301dc4d29d5ad0c66512e7506115965" exitCode=0 Sep 08 04:05:09.454344 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:09.454206 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" event={"ID":"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38","Type":"ContainerDied","Data":"ddf852bd6934ff73805eabc635683de5b301dc4d29d5ad0c66512e7506115965"} Sep 08 04:05:10.275144 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:10.275063 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:10.460957 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:10.460917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" event={"ID":"bc92f0e8-ea52-48cb-bbb7-e4acc5526e38","Type":"ContainerStarted","Data":"40a61f9cd49d3170f21a343bb6313158214a5af4416012cbd71fa2f7268533ca"} Sep 08 04:05:10.461130 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:10.461037 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:10.488845 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:10.488795 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" podStartSLOduration=1.891121802 podStartE2EDuration="5.488779396s" totalImagesPullingTime="3.160673833s" totalInitContainerRuntime="436.983761ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:10.488322814 +0000 UTC m=+591.813228960" watchObservedRunningTime="2026-09-08 04:05:10.488779396 +0000 UTC m=+591.813685541" Sep 08 04:05:13.260162 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:13.260128 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:13.436211 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:13.436177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:13.834080 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:13.834045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:13.936707 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:13.936649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:18.616094 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:18.616064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:19.132491 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:19.132457 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:05:19.134111 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:19.134090 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:05:19.139409 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:19.139389 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:05:19.141168 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:19.141152 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:05:19.936704 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:19.936641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:21.468473 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:21.468440 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-5x8g7" Sep 08 04:05:27.384748 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:27.384712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:27.510628 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:27.510595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:27.612729 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:27.612693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:30.252301 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:30.252268 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:30.353269 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:30.353236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:32.863398 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:32.863357 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:32.979505 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:32.979475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:34.876452 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:34.876412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:34.941780 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:34.941744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:38.057033 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:38.056999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:38.112500 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:38.112471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:38.253949 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:38.253915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:38.309501 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:38.309423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:38.450595 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:38.450563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:38.511382 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:38.511353 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:41.307609 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.307531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:41.459999 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.459964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:41.580220 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.580134 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:41.705949 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.705911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:41.720191 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.720162 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk"] Sep 08 04:05:41.728089 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.728064 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.731592 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.731552 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 08 04:05:41.731822 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.731797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gf64n\"" Sep 08 04:05:41.732685 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.732647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 08 04:05:41.745157 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.745132 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk"] Sep 08 04:05:41.797114 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.797074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48c03af4-adac-467a-8525-7729306e2c9f-tmp\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.797304 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.797131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c03af4-adac-467a-8525-7729306e2c9f-tls-certs\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.797304 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.797241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89c9h\" (UniqueName: \"kubernetes.io/projected/48c03af4-adac-467a-8525-7729306e2c9f-kube-api-access-89c9h\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.898615 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.898576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48c03af4-adac-467a-8525-7729306e2c9f-tmp\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.898787 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.898647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c03af4-adac-467a-8525-7729306e2c9f-tls-certs\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.898787 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.898735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89c9h\" (UniqueName: \"kubernetes.io/projected/48c03af4-adac-467a-8525-7729306e2c9f-kube-api-access-89c9h\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.898787 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:05:41.898762 2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 08 04:05:41.898899 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:05:41.898845 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c03af4-adac-467a-8525-7729306e2c9f-tls-certs podName:48c03af4-adac-467a-8525-7729306e2c9f nodeName:}" failed. No retries permitted until 2026-09-08 04:05:42.398823783 +0000 UTC m=+623.723729919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/48c03af4-adac-467a-8525-7729306e2c9f-tls-certs") pod "kube-auth-proxy-65bcfbd747-b58qk" (UID: "48c03af4-adac-467a-8525-7729306e2c9f") : secret "kube-auth-proxy-tls" not found Sep 08 04:05:41.900834 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.900811 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48c03af4-adac-467a-8525-7729306e2c9f-tmp\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:41.908281 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.908244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:41.909545 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:41.909522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89c9h\" (UniqueName: \"kubernetes.io/projected/48c03af4-adac-467a-8525-7729306e2c9f-kube-api-access-89c9h\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:42.003346 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.003314 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:42.105244 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.105206 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:42.194609 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.194514 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-94664c8c-5v9hn"] Sep 08 04:05:42.197996 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.197973 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.213383 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.213358 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94664c8c-5v9hn"] Sep 08 04:05:42.302972 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.302922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-oauth-serving-cert\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.302972 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.302973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-serving-cert\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.303216 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.303005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-trusted-ca-bundle\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.303276 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.303224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-config\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.303276 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.303255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-service-ca\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.303387 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.303289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-oauth-config\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.303387 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.303363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznvv\" (UniqueName: \"kubernetes.io/projected/92e24fd2-4f9a-4ab8-b2df-182d95d40097-kube-api-access-nznvv\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.310721 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.310693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:42.405089 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-config\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405089 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-service-ca\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-oauth-config\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nznvv\" (UniqueName: \"kubernetes.io/projected/92e24fd2-4f9a-4ab8-b2df-182d95d40097-kube-api-access-nznvv\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-oauth-serving-cert\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-serving-cert\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-trusted-ca-bundle\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.405348 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c03af4-adac-467a-8525-7729306e2c9f-tls-certs\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:42.405977 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405946 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-config\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.406078 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-service-ca\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.406078 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.405988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-oauth-serving-cert\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.406273 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.406250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e24fd2-4f9a-4ab8-b2df-182d95d40097-trusted-ca-bundle\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.407881 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.407860 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c03af4-adac-467a-8525-7729306e2c9f-tls-certs\") pod \"kube-auth-proxy-65bcfbd747-b58qk\" (UID: \"48c03af4-adac-467a-8525-7729306e2c9f\") " pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:42.408189 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.408169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-oauth-config\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.408255 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.408228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e24fd2-4f9a-4ab8-b2df-182d95d40097-console-serving-cert\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.437915 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.437885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznvv\" (UniqueName: \"kubernetes.io/projected/92e24fd2-4f9a-4ab8-b2df-182d95d40097-kube-api-access-nznvv\") pod \"console-94664c8c-5v9hn\" (UID: \"92e24fd2-4f9a-4ab8-b2df-182d95d40097\") " pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.507916 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.507826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:42.550866 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.550819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:42.638440 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.638406 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" Sep 08 04:05:42.664480 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.664450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:42.785876 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.785850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94664c8c-5v9hn"] Sep 08 04:05:42.788334 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:05:42.788308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e24fd2_4f9a_4ab8_b2df_182d95d40097.slice/crio-ae383b8d91aeb0d9d8f4cb92b6722d2d0714af3f7bd24999aa67234d85e31869 WatchSource:0}: Error finding container ae383b8d91aeb0d9d8f4cb92b6722d2d0714af3f7bd24999aa67234d85e31869: Status 404 returned error can't find the container with id ae383b8d91aeb0d9d8f4cb92b6722d2d0714af3f7bd24999aa67234d85e31869 Sep 08 04:05:42.914181 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.914156 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk"] Sep 08 04:05:42.916574 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:05:42.916530 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c03af4_adac_467a_8525_7729306e2c9f.slice/crio-0c62ac13c3ab9fecb3f68b6b4ba9e8508e714991c3391815ef43afa5c42dd370 WatchSource:0}: Error finding container 0c62ac13c3ab9fecb3f68b6b4ba9e8508e714991c3391815ef43afa5c42dd370: Status 404 returned error can't find the container with id 0c62ac13c3ab9fecb3f68b6b4ba9e8508e714991c3391815ef43afa5c42dd370 Sep 08 04:05:42.918908 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.918889 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 04:05:42.982927 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.982895 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx"] Sep 08 04:05:42.986361 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.986345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:42.989199 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.989174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qwwfp\"" Sep 08 04:05:42.989199 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.989174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 08 04:05:42.989524 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.989488 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 08 04:05:42.989826 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:42.989810 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 08 04:05:43.003050 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.003024 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx"] Sep 08 04:05:43.055858 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.055781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:43.110321 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.110269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k95c9\" (UniqueName: \"kubernetes.io/projected/a25640bd-ef5e-4583-9c0d-7a161ee1d069-kube-api-access-k95c9\") pod \"postgres-69fb4594cf-tm5qx\" (UID: \"a25640bd-ef5e-4583-9c0d-7a161ee1d069\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.110321 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.110317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a25640bd-ef5e-4583-9c0d-7a161ee1d069-data\") pod \"postgres-69fb4594cf-tm5qx\" (UID: \"a25640bd-ef5e-4583-9c0d-7a161ee1d069\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.211572 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.211542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a25640bd-ef5e-4583-9c0d-7a161ee1d069-data\") pod \"postgres-69fb4594cf-tm5qx\" (UID: \"a25640bd-ef5e-4583-9c0d-7a161ee1d069\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.211759 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.211652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95c9\" (UniqueName: \"kubernetes.io/projected/a25640bd-ef5e-4583-9c0d-7a161ee1d069-kube-api-access-k95c9\") pod \"postgres-69fb4594cf-tm5qx\" (UID: \"a25640bd-ef5e-4583-9c0d-7a161ee1d069\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.211940 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.211922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a25640bd-ef5e-4583-9c0d-7a161ee1d069-data\") pod \"postgres-69fb4594cf-tm5qx\" (UID: \"a25640bd-ef5e-4583-9c0d-7a161ee1d069\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.223015 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.222988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k95c9\" (UniqueName: \"kubernetes.io/projected/a25640bd-ef5e-4583-9c0d-7a161ee1d069-kube-api-access-k95c9\") pod \"postgres-69fb4594cf-tm5qx\" (UID: \"a25640bd-ef5e-4583-9c0d-7a161ee1d069\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.242776 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.242741 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk"] Sep 08 04:05:43.245970 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.245955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.248619 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.248596 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 08 04:05:43.249125 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.249106 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 08 04:05:43.249296 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.249277 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-lq8pt\"" Sep 08 04:05:43.253918 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.253898 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Sep 08 04:05:43.259536 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.259505 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk"] Sep 08 04:05:43.296899 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.296861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:43.313116 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.313087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5cb9aa3-8c7a-459c-a92c-b316616e5739-tmp\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.313463 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.313141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb9aa3-8c7a-459c-a92c-b316616e5739-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.313463 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.313286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5cb9aa3-8c7a-459c-a92c-b316616e5739-manifests\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.313463 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.313389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9f4d\" (UniqueName: \"kubernetes.io/projected/b5cb9aa3-8c7a-459c-a92c-b316616e5739-kube-api-access-x9f4d\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.414914 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.414875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5cb9aa3-8c7a-459c-a92c-b316616e5739-manifests\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.415094 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.414936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9f4d\" (UniqueName: \"kubernetes.io/projected/b5cb9aa3-8c7a-459c-a92c-b316616e5739-kube-api-access-x9f4d\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.415094 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.414967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5cb9aa3-8c7a-459c-a92c-b316616e5739-tmp\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.415094 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.414998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb9aa3-8c7a-459c-a92c-b316616e5739-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.415283 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.415263 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5cb9aa3-8c7a-459c-a92c-b316616e5739-manifests\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.415393 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.415368 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5cb9aa3-8c7a-459c-a92c-b316616e5739-tmp\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.415842 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.415827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5cb9aa3-8c7a-459c-a92c-b316616e5739-trusted-ca\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.426308 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.426275 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9f4d\" (UniqueName: \"kubernetes.io/projected/b5cb9aa3-8c7a-459c-a92c-b316616e5739-kube-api-access-x9f4d\") pod \"kserve-module-controller-manager-54765d59fd-nwzvk\" (UID: \"b5cb9aa3-8c7a-459c-a92c-b316616e5739\") " pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.434864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.434836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:43.506532 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.506494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:43.564691 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.564595 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:43.605188 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.604892 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx"] Sep 08 04:05:43.609010 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:05:43.608977 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25640bd_ef5e_4583_9c0d_7a161ee1d069.slice/crio-a161a0dbb49be18ec0cda498f63c7d3ba4f156c83c9070b6318cfb2549bcffee WatchSource:0}: Error finding container a161a0dbb49be18ec0cda498f63c7d3ba4f156c83c9070b6318cfb2549bcffee: Status 404 returned error can't find the container with id a161a0dbb49be18ec0cda498f63c7d3ba4f156c83c9070b6318cfb2549bcffee Sep 08 04:05:43.610971 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.610944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:43.613591 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.613473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94664c8c-5v9hn" event={"ID":"92e24fd2-4f9a-4ab8-b2df-182d95d40097","Type":"ContainerStarted","Data":"8507656d4a82b9e483b68cbef09d0366261d25ec7eeb7050c36ae1cecbb91dde"} Sep 08 04:05:43.613591 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.613530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94664c8c-5v9hn" event={"ID":"92e24fd2-4f9a-4ab8-b2df-182d95d40097","Type":"ContainerStarted","Data":"ae383b8d91aeb0d9d8f4cb92b6722d2d0714af3f7bd24999aa67234d85e31869"} Sep 08 04:05:43.616864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.616833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" event={"ID":"48c03af4-adac-467a-8525-7729306e2c9f","Type":"ContainerStarted","Data":"0c62ac13c3ab9fecb3f68b6b4ba9e8508e714991c3391815ef43afa5c42dd370"} Sep 08 04:05:43.686488 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.686437 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-94664c8c-5v9hn" podStartSLOduration=1.686420152 podStartE2EDuration="1.686420152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:43.683970963 +0000 UTC m=+625.008877111" watchObservedRunningTime="2026-09-08 04:05:43.686420152 +0000 UTC m=+625.011326297" Sep 08 04:05:43.863864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.863714 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk"] Sep 08 04:05:43.865836 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.865808 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542"] Sep 08 04:05:43.867269 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:05:43.867236 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cb9aa3_8c7a_459c_a92c_b316616e5739.slice/crio-94033472905a4af7af8b26be880f60e912c85c972c67b98ebe88459e63e5a006 WatchSource:0}: Error finding container 94033472905a4af7af8b26be880f60e912c85c972c67b98ebe88459e63e5a006: Status 404 returned error can't find the container with id 94033472905a4af7af8b26be880f60e912c85c972c67b98ebe88459e63e5a006 Sep 08 04:05:43.871026 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.871005 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:43.876324 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.876297 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Sep 08 04:05:43.876324 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.876314 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Sep 08 04:05:43.876495 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.876468 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-5wzh7\"" Sep 08 04:05:43.876792 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.876772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 08 04:05:43.877566 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.877542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Sep 08 04:05:43.877854 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.877834 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 08 04:05:43.892371 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.892336 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542"] Sep 08 04:05:43.918616 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.918584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6151c4d8-6b4b-43b7-a233-8500ac226cd1-manager-config\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:43.918828 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.918643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kg47\" (UniqueName: \"kubernetes.io/projected/6151c4d8-6b4b-43b7-a233-8500ac226cd1-kube-api-access-7kg47\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:43.918828 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.918780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6151c4d8-6b4b-43b7-a233-8500ac226cd1-metrics-certs\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:43.918828 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:43.918823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6151c4d8-6b4b-43b7-a233-8500ac226cd1-cert\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.019349 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.019315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6151c4d8-6b4b-43b7-a233-8500ac226cd1-manager-config\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.019543 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.019361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kg47\" (UniqueName: \"kubernetes.io/projected/6151c4d8-6b4b-43b7-a233-8500ac226cd1-kube-api-access-7kg47\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.019543 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.019424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6151c4d8-6b4b-43b7-a233-8500ac226cd1-metrics-certs\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.019543 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.019463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6151c4d8-6b4b-43b7-a233-8500ac226cd1-cert\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.020138 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.020109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6151c4d8-6b4b-43b7-a233-8500ac226cd1-manager-config\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.022118 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.022088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6151c4d8-6b4b-43b7-a233-8500ac226cd1-metrics-certs\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.022207 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.022141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6151c4d8-6b4b-43b7-a233-8500ac226cd1-cert\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.031621 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.031591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kg47\" (UniqueName: \"kubernetes.io/projected/6151c4d8-6b4b-43b7-a233-8500ac226cd1-kube-api-access-7kg47\") pod \"jobset-controller-manager-7c9c784dff-9d542\" (UID: \"6151c4d8-6b4b-43b7-a233-8500ac226cd1\") " pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.186868 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.186825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:44.338340 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.338304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:44.473329 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.473297 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542"] Sep 08 04:05:44.625248 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.625210 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" event={"ID":"a25640bd-ef5e-4583-9c0d-7a161ee1d069","Type":"ContainerStarted","Data":"a161a0dbb49be18ec0cda498f63c7d3ba4f156c83c9070b6318cfb2549bcffee"} Sep 08 04:05:44.627605 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.627568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" event={"ID":"6151c4d8-6b4b-43b7-a233-8500ac226cd1","Type":"ContainerStarted","Data":"6803c0bce2eb4e9ca6953690c41be58a10afef763917049650632f688af64078"} Sep 08 04:05:44.630932 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:44.630906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" event={"ID":"b5cb9aa3-8c7a-459c-a92c-b316616e5739","Type":"ContainerStarted","Data":"94033472905a4af7af8b26be880f60e912c85c972c67b98ebe88459e63e5a006"} Sep 08 04:05:46.298772 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:46.298734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:46.399153 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:46.399116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:49.301049 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:49.301004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:49.407082 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:49.407044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:50.666125 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.666084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" event={"ID":"48c03af4-adac-467a-8525-7729306e2c9f","Type":"ContainerStarted","Data":"9952399a2aad80ff5cde44578a5ba6c166662470b0c55d681531d01a85a23b68"} Sep 08 04:05:50.667839 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.667805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" event={"ID":"6151c4d8-6b4b-43b7-a233-8500ac226cd1","Type":"ContainerStarted","Data":"95583d614a3765f1b9cd1eae4c1ec3bc9b75945f97cdf74b80bcad3986f190b2"} Sep 08 04:05:50.667968 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.667865 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:05:50.669388 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.669361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" event={"ID":"b5cb9aa3-8c7a-459c-a92c-b316616e5739","Type":"ContainerStarted","Data":"2e2f3d932a68b5e37b5b48f8bfa883b33502a1d1ec0fc5c51ebe84044fb9ed32"} Sep 08 04:05:50.669521 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.669418 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:05:50.671247 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.671224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" event={"ID":"a25640bd-ef5e-4583-9c0d-7a161ee1d069","Type":"ContainerStarted","Data":"37a0421fbad9eef113aaf0467b94324167258054a11b6157907565849b42f4e1"} Sep 08 04:05:50.671389 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.671371 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:05:50.685304 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.685264 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65bcfbd747-b58qk" podStartSLOduration=2.147165582 podStartE2EDuration="9.68525227s" totalImagesPullingTime="7.538086688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:50.683576169 +0000 UTC m=+632.008482315" watchObservedRunningTime="2026-09-08 04:05:50.68525227 +0000 UTC m=+632.010158415" Sep 08 04:05:50.700374 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.700326 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" podStartSLOduration=1.834316504 podStartE2EDuration="8.700313467s" totalImagesPullingTime="6.865996963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:50.698794302 +0000 UTC m=+632.023700447" watchObservedRunningTime="2026-09-08 04:05:50.700313467 +0000 UTC m=+632.025219612" Sep 08 04:05:50.717313 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.717219 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" podStartSLOduration=1.52515839 podStartE2EDuration="7.71719837s" totalImagesPullingTime="6.19203998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:50.715180957 +0000 UTC m=+632.040087103" watchObservedRunningTime="2026-09-08 04:05:50.71719837 +0000 UTC m=+632.042104516" Sep 08 04:05:50.734426 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:50.734368 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" podStartSLOduration=1.736699687 podStartE2EDuration="7.734349239s" totalImagesPullingTime="5.997649552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:50.733548169 +0000 UTC m=+632.058454315" watchObservedRunningTime="2026-09-08 04:05:50.734349239 +0000 UTC m=+632.059255385" Sep 08 04:05:52.508487 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:52.508447 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:52.508890 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:52.508507 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:52.513169 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:52.513143 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:52.689745 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:52.689712 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-94664c8c-5v9hn" Sep 08 04:05:52.736687 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:52.736642 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-555fd5b8bc-x85zb"] Sep 08 04:05:52.843941 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:52.843865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:05:56.706537 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:05:56.706497 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tm5qx" Sep 08 04:06:01.682944 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:01.682911 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7c9c784dff-9d542" Sep 08 04:06:01.702545 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:01.702505 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:01.797885 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:01.797855 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:01.899865 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:01.899831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:01.971826 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:01.971738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:02.148402 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:02.148367 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:04.316922 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:04.316883 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:04.424936 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:04.424902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:11.679634 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:11.679601 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-54765d59fd-nwzvk" Sep 08 04:06:17.759450 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:17.759406 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-555fd5b8bc-x85zb" podUID="5da13415-119e-4e67-a5fc-4ce0e13344b5" containerName="console" containerID="cri-o://d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912" gracePeriod=15 Sep 08 04:06:18.001380 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.001357 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:06:18.039839 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.039753 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-config\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.039839 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.039796 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-trusted-ca-bundle\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.039839 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.039830 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-oauth-config\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.040100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.039882 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-service-ca\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.040100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040018 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt9kt\" (UniqueName: \"kubernetes.io/projected/5da13415-119e-4e67-a5fc-4ce0e13344b5-kube-api-access-tt9kt\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.040212 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-serving-cert\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.040212 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040154 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-oauth-serving-cert\") pod \"5da13415-119e-4e67-a5fc-4ce0e13344b5\" (UID: \"5da13415-119e-4e67-a5fc-4ce0e13344b5\") " Sep 08 04:06:18.040317 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040250 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-config" (OuterVolumeSpecName: "console-config") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:06:18.040317 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040295 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:06:18.040317 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040306 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:06:18.040533 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040508 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-service-ca\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.040533 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040536 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.040728 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040550 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-trusted-ca-bundle\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.040728 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.040588 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:06:18.042223 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.042199 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:06:18.042319 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.042234 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da13415-119e-4e67-a5fc-4ce0e13344b5-kube-api-access-tt9kt" (OuterVolumeSpecName: "kube-api-access-tt9kt") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "kube-api-access-tt9kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:06:18.042600 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.042584 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5da13415-119e-4e67-a5fc-4ce0e13344b5" (UID: "5da13415-119e-4e67-a5fc-4ce0e13344b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:06:18.141384 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.141344 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-oauth-config\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.141384 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.141384 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt9kt\" (UniqueName: \"kubernetes.io/projected/5da13415-119e-4e67-a5fc-4ce0e13344b5-kube-api-access-tt9kt\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.141569 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.141399 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5da13415-119e-4e67-a5fc-4ce0e13344b5-console-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.141569 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.141412 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5da13415-119e-4e67-a5fc-4ce0e13344b5-oauth-serving-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:18.808847 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.808811 2575 generic.go:356] "Generic (PLEG): container finished" podID="5da13415-119e-4e67-a5fc-4ce0e13344b5" containerID="d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912" exitCode=0 Sep 08 04:06:18.809268 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.808857 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-555fd5b8bc-x85zb" Sep 08 04:06:18.809268 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.808897 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-555fd5b8bc-x85zb" event={"ID":"5da13415-119e-4e67-a5fc-4ce0e13344b5","Type":"ContainerDied","Data":"d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912"} Sep 08 04:06:18.809268 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.808942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-555fd5b8bc-x85zb" event={"ID":"5da13415-119e-4e67-a5fc-4ce0e13344b5","Type":"ContainerDied","Data":"69c698e9555b43c799fa74532251ff16511d4e37ebd2ecca7a88ba99b39eeff8"} Sep 08 04:06:18.809268 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.808964 2575 scope.go:117] "RemoveContainer" containerID="d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912" Sep 08 04:06:18.818290 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.818272 2575 scope.go:117] "RemoveContainer" containerID="d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912" Sep 08 04:06:18.818591 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:06:18.818572 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912\": container with ID starting with d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912 not found: ID does not exist" containerID="d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912" Sep 08 04:06:18.818651 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.818599 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912"} err="failed to get container status \"d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912\": rpc error: code = NotFound desc = could not find container \"d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912\": container with ID starting with d876fd4652a2da5fc10f2f8e474c4d2f08a212101ee9440459c7218ccea5f912 not found: ID does not exist" Sep 08 04:06:18.830787 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.830757 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-555fd5b8bc-x85zb"] Sep 08 04:06:18.836553 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:18.836531 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-555fd5b8bc-x85zb"] Sep 08 04:06:19.195728 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:19.195701 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da13415-119e-4e67-a5fc-4ce0e13344b5" path="/var/lib/kubelet/pods/5da13415-119e-4e67-a5fc-4ce0e13344b5/volumes" Sep 08 04:06:35.917686 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:35.917624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:36.016412 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:36.016376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:37.411216 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:37.411176 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:37.512270 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:37.512227 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:37.924547 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:37.924514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:38.026319 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:38.026283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:38.200922 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:38.200839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:38.308850 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:38.308803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:40.440073 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:40.440038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:40.539526 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:40.539485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:40.640499 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:40.640469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:40.780056 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:40.779970 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:40.889988 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:40.889959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.033219 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.033132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.124360 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.124324 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.228366 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.228334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.427381 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.427349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.667899 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.667863 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.770024 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.769929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.861741 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.861705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:41.950609 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:41.950578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:45.236780 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:45.236744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:45.294375 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:45.294346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:46.782237 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:46.782200 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw"] Sep 08 04:06:46.782701 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:46.782434 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" podUID="131d6f53-bb45-43bf-96be-4138751a55f8" containerName="discovery" containerID="cri-o://849e85351723135b43127ad66f58a98c447b5c4ed5b47e018a26559974c74b18" gracePeriod=30 Sep 08 04:06:46.951389 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:46.951362 2575 generic.go:356] "Generic (PLEG): container finished" podID="131d6f53-bb45-43bf-96be-4138751a55f8" containerID="849e85351723135b43127ad66f58a98c447b5c4ed5b47e018a26559974c74b18" exitCode=0 Sep 08 04:06:46.951508 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:46.951439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" event={"ID":"131d6f53-bb45-43bf-96be-4138751a55f8","Type":"ContainerDied","Data":"849e85351723135b43127ad66f58a98c447b5c4ed5b47e018a26559974c74b18"} Sep 08 04:06:47.044111 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.044051 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:06:47.114496 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.114458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:47.206184 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206150 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-ca-configmap\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206355 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206243 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-cacerts\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206355 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206263 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/131d6f53-bb45-43bf-96be-4138751a55f8-local-certs\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206476 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206356 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-dns-cert\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206476 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206410 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-istio-token\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206476 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206445 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-kubeconfig\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206629 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206487 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdwb2\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-kube-api-access-vdwb2\") pod \"131d6f53-bb45-43bf-96be-4138751a55f8\" (UID: \"131d6f53-bb45-43bf-96be-4138751a55f8\") " Sep 08 04:06:47.206694 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206671 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:06:47.206887 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.206853 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-ca-configmap\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.209129 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.209083 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:06:47.209302 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.209285 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131d6f53-bb45-43bf-96be-4138751a55f8-local-certs" (OuterVolumeSpecName: "local-certs") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:06:47.211159 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.211119 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:06:47.211159 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.211119 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:06:47.211426 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.211400 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-kube-api-access-vdwb2" (OuterVolumeSpecName: "kube-api-access-vdwb2") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "kube-api-access-vdwb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:06:47.211524 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.211460 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-cacerts" (OuterVolumeSpecName: "cacerts") pod "131d6f53-bb45-43bf-96be-4138751a55f8" (UID: "131d6f53-bb45-43bf-96be-4138751a55f8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:06:47.307803 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.307717 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-cacerts\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.307803 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.307748 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/131d6f53-bb45-43bf-96be-4138751a55f8-local-certs\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.307803 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.307760 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-csr-dns-cert\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.307803 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.307768 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-istio-token\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.307803 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.307777 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/131d6f53-bb45-43bf-96be-4138751a55f8-istio-kubeconfig\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.307803 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.307786 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdwb2\" (UniqueName: \"kubernetes.io/projected/131d6f53-bb45-43bf-96be-4138751a55f8-kube-api-access-vdwb2\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:47.316742 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.316713 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rmgkw"] Sep 08 04:06:47.317050 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.317038 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131d6f53-bb45-43bf-96be-4138751a55f8" containerName="discovery" Sep 08 04:06:47.317172 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.317051 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="131d6f53-bb45-43bf-96be-4138751a55f8" containerName="discovery" Sep 08 04:06:47.317172 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.317065 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da13415-119e-4e67-a5fc-4ce0e13344b5" containerName="console" Sep 08 04:06:47.317172 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.317070 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da13415-119e-4e67-a5fc-4ce0e13344b5" containerName="console" Sep 08 04:06:47.317172 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.317127 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="131d6f53-bb45-43bf-96be-4138751a55f8" containerName="discovery" Sep 08 04:06:47.317172 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.317139 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da13415-119e-4e67-a5fc-4ce0e13344b5" containerName="console" Sep 08 04:06:47.320302 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.320286 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:47.323163 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.323135 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 08 04:06:47.323163 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.323153 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 08 04:06:47.323473 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.323451 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v8rr6\"" Sep 08 04:06:47.332879 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.332846 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rmgkw"] Sep 08 04:06:47.408844 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.408783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xkpx\" (UniqueName: \"kubernetes.io/projected/1874698a-aed2-44c0-946c-4d1509624b6c-kube-api-access-7xkpx\") pod \"authorino-5dc7ccb5f-rmgkw\" (UID: \"1874698a-aed2-44c0-946c-4d1509624b6c\") " pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:47.479955 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.479922 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l"] Sep 08 04:06:47.483281 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.483263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.488801 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.488777 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 08 04:06:47.489856 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.489837 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 08 04:06:47.491918 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.491747 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6hlmn\"" Sep 08 04:06:47.507631 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.507598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l"] Sep 08 04:06:47.510000 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.509594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xkpx\" (UniqueName: \"kubernetes.io/projected/1874698a-aed2-44c0-946c-4d1509624b6c-kube-api-access-7xkpx\") pod \"authorino-5dc7ccb5f-rmgkw\" (UID: \"1874698a-aed2-44c0-946c-4d1509624b6c\") " pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:47.519425 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.519398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xkpx\" (UniqueName: \"kubernetes.io/projected/1874698a-aed2-44c0-946c-4d1509624b6c-kube-api-access-7xkpx\") pod \"authorino-5dc7ccb5f-rmgkw\" (UID: \"1874698a-aed2-44c0-946c-4d1509624b6c\") " pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:47.531990 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.531945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:47.597902 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.597802 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rmgkw"] Sep 08 04:06:47.598139 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.598121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:47.610227 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.610204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvtjq\" (UniqueName: \"kubernetes.io/projected/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-kube-api-access-xvtjq\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.610306 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.610237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-openshift-service-ca\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.610306 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.610260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-maas-api-tls\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.610374 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.610332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-metrics-certs\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.711480 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.711440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-metrics-certs\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.711741 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.711505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvtjq\" (UniqueName: \"kubernetes.io/projected/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-kube-api-access-xvtjq\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.711741 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.711525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-openshift-service-ca\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.711741 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.711547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-maas-api-tls\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.712342 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.712320 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-openshift-service-ca\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.714040 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.714015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-metrics-certs\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.714144 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.714040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-maas-api-tls\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.721853 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.721832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvtjq\" (UniqueName: \"kubernetes.io/projected/8b1789b9-f57f-4fd4-9674-1a9cdd85b326-kube-api-access-xvtjq\") pod \"maas-api-f7dc5967c-lc85l\" (UID: \"8b1789b9-f57f-4fd4-9674-1a9cdd85b326\") " pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.793930 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.793888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:47.869482 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.869453 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rmgkw"] Sep 08 04:06:47.870408 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:06:47.870384 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1874698a_aed2_44c0_946c_4d1509624b6c.slice/crio-6637ddaa6319d781d366d3723312e0dadbefe222a25ab772a463507a46343313 WatchSource:0}: Error finding container 6637ddaa6319d781d366d3723312e0dadbefe222a25ab772a463507a46343313: Status 404 returned error can't find the container with id 6637ddaa6319d781d366d3723312e0dadbefe222a25ab772a463507a46343313 Sep 08 04:06:47.957718 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.957682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" event={"ID":"1874698a-aed2-44c0-946c-4d1509624b6c","Type":"ContainerStarted","Data":"6637ddaa6319d781d366d3723312e0dadbefe222a25ab772a463507a46343313"} Sep 08 04:06:47.959050 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.959024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" event={"ID":"131d6f53-bb45-43bf-96be-4138751a55f8","Type":"ContainerDied","Data":"04eab5a72d88a77a6dabee55c951092e715e80a98ce63ddf108a791550a82dbf"} Sep 08 04:06:47.959050 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.959040 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw" Sep 08 04:06:47.959219 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.959084 2575 scope.go:117] "RemoveContainer" containerID="849e85351723135b43127ad66f58a98c447b5c4ed5b47e018a26559974c74b18" Sep 08 04:06:47.982440 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.982411 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw"] Sep 08 04:06:47.988214 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:47.988188 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg8qw"] Sep 08 04:06:48.070939 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:48.070886 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l"] Sep 08 04:06:48.073300 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:06:48.073273 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1789b9_f57f_4fd4_9674_1a9cdd85b326.slice/crio-0ba001a5c5e0d1426c51762b964ffbdd89ab26d206e578988aa2736b2ff36f27 WatchSource:0}: Error finding container 0ba001a5c5e0d1426c51762b964ffbdd89ab26d206e578988aa2736b2ff36f27: Status 404 returned error can't find the container with id 0ba001a5c5e0d1426c51762b964ffbdd89ab26d206e578988aa2736b2ff36f27 Sep 08 04:06:48.970817 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:48.970735 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" event={"ID":"8b1789b9-f57f-4fd4-9674-1a9cdd85b326","Type":"ContainerStarted","Data":"0ba001a5c5e0d1426c51762b964ffbdd89ab26d206e578988aa2736b2ff36f27"} Sep 08 04:06:49.197732 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:49.197696 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="131d6f53-bb45-43bf-96be-4138751a55f8" path="/var/lib/kubelet/pods/131d6f53-bb45-43bf-96be-4138751a55f8/volumes" Sep 08 04:06:50.989788 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:50.989752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" event={"ID":"8b1789b9-f57f-4fd4-9674-1a9cdd85b326","Type":"ContainerStarted","Data":"cc425c202c671a0bf86930edd49d43640db04d381fd39855ad5931259e4f2d31"} Sep 08 04:06:50.990255 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:50.989820 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:06:50.991477 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:50.991448 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" event={"ID":"1874698a-aed2-44c0-946c-4d1509624b6c","Type":"ContainerStarted","Data":"2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c"} Sep 08 04:06:50.991585 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:50.991479 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" podUID="1874698a-aed2-44c0-946c-4d1509624b6c" containerName="authorino" containerID="cri-o://2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c" gracePeriod=30 Sep 08 04:06:51.024206 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.024157 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" podStartSLOduration=1.526700927 podStartE2EDuration="4.024138347s" totalImagesPullingTime="2.49743742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:51.022878596 +0000 UTC m=+692.347784742" watchObservedRunningTime="2026-09-08 04:06:51.024138347 +0000 UTC m=+692.349044492" Sep 08 04:06:51.047959 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.047888 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" podStartSLOduration=1.288472592 podStartE2EDuration="4.047864108s" totalImagesPullingTime="2.759391516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:51.046030272 +0000 UTC m=+692.370936420" watchObservedRunningTime="2026-09-08 04:06:51.047864108 +0000 UTC m=+692.372770254" Sep 08 04:06:51.247648 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.247580 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:51.346014 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.345981 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xkpx\" (UniqueName: \"kubernetes.io/projected/1874698a-aed2-44c0-946c-4d1509624b6c-kube-api-access-7xkpx\") pod \"1874698a-aed2-44c0-946c-4d1509624b6c\" (UID: \"1874698a-aed2-44c0-946c-4d1509624b6c\") " Sep 08 04:06:51.348174 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.348147 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1874698a-aed2-44c0-946c-4d1509624b6c-kube-api-access-7xkpx" (OuterVolumeSpecName: "kube-api-access-7xkpx") pod "1874698a-aed2-44c0-946c-4d1509624b6c" (UID: "1874698a-aed2-44c0-946c-4d1509624b6c"). InnerVolumeSpecName "kube-api-access-7xkpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:06:51.446781 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.446741 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xkpx\" (UniqueName: \"kubernetes.io/projected/1874698a-aed2-44c0-946c-4d1509624b6c-kube-api-access-7xkpx\") on node \"ip-10-0-131-231.ec2.internal\" DevicePath \"\"" Sep 08 04:06:51.996859 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.996823 2575 generic.go:356] "Generic (PLEG): container finished" podID="1874698a-aed2-44c0-946c-4d1509624b6c" containerID="2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c" exitCode=0 Sep 08 04:06:51.997336 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.996866 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" Sep 08 04:06:51.997336 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.996909 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" event={"ID":"1874698a-aed2-44c0-946c-4d1509624b6c","Type":"ContainerDied","Data":"2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c"} Sep 08 04:06:51.997336 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.996963 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-rmgkw" event={"ID":"1874698a-aed2-44c0-946c-4d1509624b6c","Type":"ContainerDied","Data":"6637ddaa6319d781d366d3723312e0dadbefe222a25ab772a463507a46343313"} Sep 08 04:06:51.997336 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:51.996998 2575 scope.go:117] "RemoveContainer" containerID="2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c" Sep 08 04:06:52.005779 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:52.005758 2575 scope.go:117] "RemoveContainer" containerID="2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c" Sep 08 04:06:52.006067 ip-10-0-131-231 kubenswrapper[2575]: E0908 04:06:52.006048 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c\": container with ID starting with 2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c not found: ID does not exist" containerID="2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c" Sep 08 04:06:52.006112 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:52.006080 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c"} err="failed to get container status \"2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c\": rpc error: code = NotFound desc = could not find container \"2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c\": container with ID starting with 2b2d70e792d522087f3261d44498bda03a9e3430eb30638acc791fa02e62ad8c not found: ID does not exist" Sep 08 04:06:52.019537 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:52.019515 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rmgkw"] Sep 08 04:06:52.024490 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:52.024467 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-rmgkw"] Sep 08 04:06:52.173375 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:52.173345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:06:53.196809 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:53.196776 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1874698a-aed2-44c0-946c-4d1509624b6c" path="/var/lib/kubelet/pods/1874698a-aed2-44c0-946c-4d1509624b6c/volumes" Sep 08 04:06:57.002786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:06:57.002755 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f7dc5967c-lc85l" Sep 08 04:07:01.096010 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:01.095971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:07:02.953619 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:02.953577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:07:03.051733 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:03.051694 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:07:33.187932 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:33.187898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:07:33.282330 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:33.282296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:07:48.484997 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.484967 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h"] Sep 08 04:07:48.485339 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.485313 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1874698a-aed2-44c0-946c-4d1509624b6c" containerName="authorino" Sep 08 04:07:48.485339 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.485324 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1874698a-aed2-44c0-946c-4d1509624b6c" containerName="authorino" Sep 08 04:07:48.485417 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.485386 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1874698a-aed2-44c0-946c-4d1509624b6c" containerName="authorino" Sep 08 04:07:48.488528 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.488506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.492474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.492348 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 08 04:07:48.492474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.492383 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 08 04:07:48.492474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.492397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-flhsn\"" Sep 08 04:07:48.492474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.492434 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 08 04:07:48.499434 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.499379 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h"] Sep 08 04:07:48.521452 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.521423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:07:48.562551 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.562511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.562551 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.562556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.562811 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.562614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efea17cf-9a21-41ac-a5bb-3a19ac09033e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.562811 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.562724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxxcb\" (UniqueName: \"kubernetes.io/projected/efea17cf-9a21-41ac-a5bb-3a19ac09033e-kube-api-access-cxxcb\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.562811 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.562790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.562954 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.562850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664280 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664280 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664503 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664503 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664324 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efea17cf-9a21-41ac-a5bb-3a19ac09033e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664503 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxxcb\" (UniqueName: \"kubernetes.io/projected/efea17cf-9a21-41ac-a5bb-3a19ac09033e-kube-api-access-cxxcb\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664503 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664749 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664692 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664804 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.664845 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.664799 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.666475 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.666456 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efea17cf-9a21-41ac-a5bb-3a19ac09033e-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.666752 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.666736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efea17cf-9a21-41ac-a5bb-3a19ac09033e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.676649 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.676625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxxcb\" (UniqueName: \"kubernetes.io/projected/efea17cf-9a21-41ac-a5bb-3a19ac09033e-kube-api-access-cxxcb\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h\" (UID: \"efea17cf-9a21-41ac-a5bb-3a19ac09033e\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:48.799969 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:48.799897 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:49.075294 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:49.075268 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h"] Sep 08 04:07:49.077302 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:07:49.077272 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefea17cf_9a21_41ac_a5bb_3a19ac09033e.slice/crio-be790b0fb861d0d2e8cb3c9e19888f1b1a91f805abb5347bb5952b7cfbabed7e WatchSource:0}: Error finding container be790b0fb861d0d2e8cb3c9e19888f1b1a91f805abb5347bb5952b7cfbabed7e: Status 404 returned error can't find the container with id be790b0fb861d0d2e8cb3c9e19888f1b1a91f805abb5347bb5952b7cfbabed7e Sep 08 04:07:49.268827 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:49.268786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" event={"ID":"efea17cf-9a21-41ac-a5bb-3a19ac09033e","Type":"ContainerStarted","Data":"be790b0fb861d0d2e8cb3c9e19888f1b1a91f805abb5347bb5952b7cfbabed7e"} Sep 08 04:07:50.274471 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:50.274434 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" event={"ID":"efea17cf-9a21-41ac-a5bb-3a19ac09033e","Type":"ContainerStarted","Data":"10a30d1479be41fefa5ae7b165612045691cd43ca0ee02bdbbf010e5349eadb4"} Sep 08 04:07:50.293746 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:50.293633 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" podStartSLOduration=1.336510009 podStartE2EDuration="2.293617738s" totalImagesPullingTime="957.107729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:07:50.292319725 +0000 UTC m=+751.617225872" watchObservedRunningTime="2026-09-08 04:07:50.293617738 +0000 UTC m=+751.618523884" Sep 08 04:07:50.800896 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:50.800862 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:58.800506 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:58.800457 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:58.812720 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:58.812698 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:07:59.323974 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:07:59.323944 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h" Sep 08 04:08:00.072865 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.072834 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k"] Sep 08 04:08:00.076554 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.076533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.079477 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.079453 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 08 04:08:00.086192 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.086169 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k"] Sep 08 04:08:00.106082 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.106051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:08:00.155457 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.155417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7rjt\" (UniqueName: \"kubernetes.io/projected/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-kube-api-access-g7rjt\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.155688 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.155463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.155688 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.155482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.155688 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.155544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.155688 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.155620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.155843 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.155708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256119 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rjt\" (UniqueName: \"kubernetes.io/projected/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-kube-api-access-g7rjt\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256275 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256275 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256275 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256275 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256486 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256275 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256644 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256618 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256644 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256634 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.256779 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.256725 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.258443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.258417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.258716 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.258698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.265486 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.265463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7rjt\" (UniqueName: \"kubernetes.io/projected/269d68d4-0cbb-4b42-a640-67fceb6dfd5b-kube-api-access-g7rjt\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-6fm6k\" (UID: \"269d68d4-0cbb-4b42-a640-67fceb6dfd5b\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.388836 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.388804 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:00.661798 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:00.661771 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k"] Sep 08 04:08:00.664428 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:08:00.664402 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269d68d4_0cbb_4b42_a640_67fceb6dfd5b.slice/crio-424015e01668476b13b808f93f02310309d01e1fd62d421fdc0512a6759344a3 WatchSource:0}: Error finding container 424015e01668476b13b808f93f02310309d01e1fd62d421fdc0512a6759344a3: Status 404 returned error can't find the container with id 424015e01668476b13b808f93f02310309d01e1fd62d421fdc0512a6759344a3 Sep 08 04:08:01.323892 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:01.323853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" event={"ID":"269d68d4-0cbb-4b42-a640-67fceb6dfd5b","Type":"ContainerStarted","Data":"dc85f91012ebc80f14758bd708301636fa01ae562a09165796d65bef1fd97d9a"} Sep 08 04:08:01.324375 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:01.323923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" event={"ID":"269d68d4-0cbb-4b42-a640-67fceb6dfd5b","Type":"ContainerStarted","Data":"424015e01668476b13b808f93f02310309d01e1fd62d421fdc0512a6759344a3"} Sep 08 04:08:01.349679 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:01.349610 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" podStartSLOduration=1.166474823 podStartE2EDuration="1.349593249s" totalImagesPullingTime="183.118426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:01.347991271 +0000 UTC m=+762.672897418" watchObservedRunningTime="2026-09-08 04:08:01.349593249 +0000 UTC m=+762.674499395" Sep 08 04:08:01.388929 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:01.388896 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:01.909825 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:01.909783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:08:10.389917 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:10.389882 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:10.402193 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:10.402167 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:11.378749 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:11.378719 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-6fm6k" Sep 08 04:08:13.805769 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:13.805733 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:08:23.124937 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:23.124895 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:08:29.392171 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.392136 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25"] Sep 08 04:08:29.395791 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.395771 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.398437 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.398419 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 08 04:08:29.405244 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.405223 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25"] Sep 08 04:08:29.411289 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.411265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.411387 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.411307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.411387 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.411332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.411467 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.411376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.411467 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.411428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.411467 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.411450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fj57\" (UniqueName: \"kubernetes.io/projected/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-kube-api-access-9fj57\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.416835 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.416811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:08:29.512600 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.512559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.512786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.512614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.512786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.512641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.512786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.512694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.512786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.512739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.512786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.512777 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fj57\" (UniqueName: \"kubernetes.io/projected/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-kube-api-access-9fj57\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.513100 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.513064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.513180 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.513118 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.513180 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.513162 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.514821 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.514794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.515105 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.515086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.521134 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.521111 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fj57\" (UniqueName: \"kubernetes.io/projected/2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9-kube-api-access-9fj57\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25\" (UID: \"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.707134 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.707037 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:29.979728 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:29.979702 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25"] Sep 08 04:08:29.981846 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:08:29.981820 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfb0b11_75b9_449d_8ee2_398f8f9f8ae9.slice/crio-ff7460173d4122cee353197bbe68fbb34cdffea767d6aa24951b6ff4684e9df6 WatchSource:0}: Error finding container ff7460173d4122cee353197bbe68fbb34cdffea767d6aa24951b6ff4684e9df6: Status 404 returned error can't find the container with id ff7460173d4122cee353197bbe68fbb34cdffea767d6aa24951b6ff4684e9df6 Sep 08 04:08:30.457096 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:30.457057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" event={"ID":"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9","Type":"ContainerStarted","Data":"fcfbdbe9f4947bf5c0850cf1db7aa2e613e5c11f6aeb2c8827ebd20c233c05e4"} Sep 08 04:08:30.457472 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:30.457120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" event={"ID":"2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9","Type":"ContainerStarted","Data":"ff7460173d4122cee353197bbe68fbb34cdffea767d6aa24951b6ff4684e9df6"} Sep 08 04:08:30.476078 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:30.476022 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" podStartSLOduration=1.312984728 podStartE2EDuration="1.476007973s" totalImagesPullingTime="163.023245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:30.473323746 +0000 UTC m=+791.798229892" watchObservedRunningTime="2026-09-08 04:08:30.476007973 +0000 UTC m=+791.800914117" Sep 08 04:08:30.707204 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:30.707121 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:38.675438 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.675405 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk"] Sep 08 04:08:38.679064 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.679040 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.681868 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.681842 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 08 04:08:38.689886 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.689860 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk"] Sep 08 04:08:38.711343 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.711315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:08:38.800383 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.800343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.800560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.800401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.800560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.800440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cdea309-0844-4da1-b93c-6f90431420be-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.800560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.800460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqvmv\" (UniqueName: \"kubernetes.io/projected/2cdea309-0844-4da1-b93c-6f90431420be-kube-api-access-cqvmv\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.800560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.800497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.800560 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.800528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.901703 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.901643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.901891 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.901733 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.901891 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.901782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.901891 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.901838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cdea309-0844-4da1-b93c-6f90431420be-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.901891 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.901864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqvmv\" (UniqueName: \"kubernetes.io/projected/2cdea309-0844-4da1-b93c-6f90431420be-kube-api-access-cqvmv\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.902093 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.901989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.902196 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.902173 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.902323 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.902223 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.902383 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.902331 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.903981 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.903961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cdea309-0844-4da1-b93c-6f90431420be-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.904360 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.904340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cdea309-0844-4da1-b93c-6f90431420be-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.910385 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.910358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqvmv\" (UniqueName: \"kubernetes.io/projected/2cdea309-0844-4da1-b93c-6f90431420be-kube-api-access-cqvmv\") pod \"facebook-opt-125m-simulated-kserve-89945f574-kp9tk\" (UID: \"2cdea309-0844-4da1-b93c-6f90431420be\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:38.990384 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:38.990294 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:39.265555 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.265482 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk"] Sep 08 04:08:39.268906 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:08:39.268878 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdea309_0844_4da1_b93c_6f90431420be.slice/crio-923300153df5fe942e99f27eb4f5d9bed9efefe09d0fa110283e33d2ab77ba55 WatchSource:0}: Error finding container 923300153df5fe942e99f27eb4f5d9bed9efefe09d0fa110283e33d2ab77ba55: Status 404 returned error can't find the container with id 923300153df5fe942e99f27eb4f5d9bed9efefe09d0fa110283e33d2ab77ba55 Sep 08 04:08:39.500005 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.499978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" event={"ID":"2cdea309-0844-4da1-b93c-6f90431420be","Type":"ContainerStarted","Data":"8b345d9e3cc3fc04e2810b50b3e6de1c4b16adf04dd506ab9a40096e0a8202d0"} Sep 08 04:08:39.500141 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.500026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" event={"ID":"2cdea309-0844-4da1-b93c-6f90431420be","Type":"ContainerStarted","Data":"923300153df5fe942e99f27eb4f5d9bed9efefe09d0fa110283e33d2ab77ba55"} Sep 08 04:08:39.707792 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.707756 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:39.720738 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.720708 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:39.742786 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.742741 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" podStartSLOduration=1.5798660789999999 podStartE2EDuration="1.742725429s" totalImagesPullingTime="162.85935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:39.539140794 +0000 UTC m=+800.864046938" watchObservedRunningTime="2026-09-08 04:08:39.742725429 +0000 UTC m=+801.067631608" Sep 08 04:08:39.991168 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:39.991071 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:40.516012 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:40.515983 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25" Sep 08 04:08:48.990724 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:48.990630 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:49.003085 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:49.003054 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:08:49.559161 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:08:49.559125 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-kp9tk" Sep 08 04:09:04.403484 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.403446 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx"] Sep 08 04:09:04.407129 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.407110 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.410184 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.410154 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 08 04:09:04.416934 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.416905 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx"] Sep 08 04:09:04.430047 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.430005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:09:04.547883 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.547840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.548062 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.547897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.548062 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.547955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcmjq\" (UniqueName: \"kubernetes.io/projected/7a822902-840f-4ab2-a4a2-827919498bfe-kube-api-access-lcmjq\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.548062 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.548041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a822902-840f-4ab2-a4a2-827919498bfe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.548168 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.548088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.548168 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.548115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649088 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649284 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649284 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649284 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649284 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcmjq\" (UniqueName: \"kubernetes.io/projected/7a822902-840f-4ab2-a4a2-827919498bfe-kube-api-access-lcmjq\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649284 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a822902-840f-4ab2-a4a2-827919498bfe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649587 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649736 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.649787 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.649741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.651507 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.651489 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a822902-840f-4ab2-a4a2-827919498bfe-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.651642 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.651624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a822902-840f-4ab2-a4a2-827919498bfe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.657843 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.657789 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcmjq\" (UniqueName: \"kubernetes.io/projected/7a822902-840f-4ab2-a4a2-827919498bfe-kube-api-access-lcmjq\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx\" (UID: \"7a822902-840f-4ab2-a4a2-827919498bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.723036 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.722990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:04.997488 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:04.997462 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx"] Sep 08 04:09:05.000252 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:09:05.000224 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a822902_840f_4ab2_a4a2_827919498bfe.slice/crio-93a2f98e3bd012c67fe7c03da154f20f39b5f00356717f30072703ee944f8b50 WatchSource:0}: Error finding container 93a2f98e3bd012c67fe7c03da154f20f39b5f00356717f30072703ee944f8b50: Status 404 returned error can't find the container with id 93a2f98e3bd012c67fe7c03da154f20f39b5f00356717f30072703ee944f8b50 Sep 08 04:09:05.629275 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:05.629234 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" event={"ID":"7a822902-840f-4ab2-a4a2-827919498bfe","Type":"ContainerStarted","Data":"ab437b12260b8e595c9f3e3328e528834614aa7337f821cf111e132994b7fbcb"} Sep 08 04:09:05.629695 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:05.629283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" event={"ID":"7a822902-840f-4ab2-a4a2-827919498bfe","Type":"ContainerStarted","Data":"93a2f98e3bd012c67fe7c03da154f20f39b5f00356717f30072703ee944f8b50"} Sep 08 04:09:05.646137 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:05.646077 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" podStartSLOduration=1.468815229 podStartE2EDuration="1.646060338s" totalImagesPullingTime="177.245109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:09:05.645604225 +0000 UTC m=+826.970510371" watchObservedRunningTime="2026-09-08 04:09:05.646060338 +0000 UTC m=+826.970966484" Sep 08 04:09:05.723272 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:05.723235 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:14.724076 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:14.724041 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:14.736542 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:14.736517 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:09:15.692330 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:09:15.692296 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx" Sep 08 04:10:19.162997 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:10:19.162962 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:10:19.165608 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:10:19.165571 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:10:19.170422 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:10:19.170400 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:10:19.172782 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:10:19.172765 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:10:31.121727 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:10:31.121693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:13:17.435706 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:13:17.435603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:13:23.594178 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:13:23.594146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:14:55.202179 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:14:55.202098 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:14:55.290824 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:14:55.290791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:15:19.194901 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:19.194866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:15:19.198716 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:19.198691 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:15:19.202408 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:19.202388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:15:19.205903 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:19.205886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:15:31.634602 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:31.634568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-nwzvk_b5cb9aa3-8c7a-459c-a92c-b316616e5739/manager/0.log" Sep 08 04:15:32.552208 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:32.552175 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f7dc5967c-lc85l_8b1789b9-f57f-4fd4-9674-1a9cdd85b326/maas-api/0.log" Sep 08 04:15:32.797915 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:32.797881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tm5qx_a25640bd-ef5e-4583-9c0d-7a161ee1d069/postgres/0.log" Sep 08 04:15:35.203391 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:35.203360 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcfbd747-b58qk_48c03af4-adac-467a-8525-7729306e2c9f/kube-auth-proxy/0.log" Sep 08 04:15:36.376424 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:36.376393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-5fc5ddd44f-sgm5h_efea17cf-9a21-41ac-a5bb-3a19ac09033e/main/0.log" Sep 08 04:15:36.500161 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:36.500136 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5d57fc946d-6fm6k_269d68d4-0cbb-4b42-a640-67fceb6dfd5b/main/0.log" Sep 08 04:15:36.882791 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:36.882759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfjgl25_2bfb0b11-75b9-449d-8ee2-398f8f9f8ae9/main/0.log" Sep 08 04:15:37.029083 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:37.029051 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-kp9tk_2cdea309-0844-4da1-b93c-6f90431420be/main/0.log" Sep 08 04:15:37.158006 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:37.157930 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-c9jwx_7a822902-840f-4ab2-a4a2-827919498bfe/main/0.log" Sep 08 04:15:42.794921 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.794885 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qbfdx/must-gather-wxx56"] Sep 08 04:15:42.798433 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.798415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:42.801062 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.801034 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qbfdx\"/\"default-dockercfg-qwfzv\"" Sep 08 04:15:42.801170 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.801101 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qbfdx\"/\"kube-root-ca.crt\"" Sep 08 04:15:42.801170 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.801098 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qbfdx\"/\"openshift-service-ca.crt\"" Sep 08 04:15:42.812713 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.812670 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qbfdx/must-gather-wxx56"] Sep 08 04:15:42.817688 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.817636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:15:42.955047 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.955009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/54b315cd-e59c-40b4-9447-25caf530a1cf-must-gather-output\") pod \"must-gather-wxx56\" (UID: \"54b315cd-e59c-40b4-9447-25caf530a1cf\") " pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:42.955233 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:42.955077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlgt\" (UniqueName: \"kubernetes.io/projected/54b315cd-e59c-40b4-9447-25caf530a1cf-kube-api-access-5hlgt\") pod \"must-gather-wxx56\" (UID: \"54b315cd-e59c-40b4-9447-25caf530a1cf\") " pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:43.056519 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.056425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/54b315cd-e59c-40b4-9447-25caf530a1cf-must-gather-output\") pod \"must-gather-wxx56\" (UID: \"54b315cd-e59c-40b4-9447-25caf530a1cf\") " pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:43.056519 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.056484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlgt\" (UniqueName: \"kubernetes.io/projected/54b315cd-e59c-40b4-9447-25caf530a1cf-kube-api-access-5hlgt\") pod \"must-gather-wxx56\" (UID: \"54b315cd-e59c-40b4-9447-25caf530a1cf\") " pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:43.056800 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.056781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/54b315cd-e59c-40b4-9447-25caf530a1cf-must-gather-output\") pod \"must-gather-wxx56\" (UID: \"54b315cd-e59c-40b4-9447-25caf530a1cf\") " pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:43.065679 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.065628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlgt\" (UniqueName: \"kubernetes.io/projected/54b315cd-e59c-40b4-9447-25caf530a1cf-kube-api-access-5hlgt\") pod \"must-gather-wxx56\" (UID: \"54b315cd-e59c-40b4-9447-25caf530a1cf\") " pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:43.107368 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.107328 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qbfdx/must-gather-wxx56" Sep 08 04:15:43.380728 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.380704 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qbfdx/must-gather-wxx56"] Sep 08 04:15:43.382845 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:15:43.382811 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54b315cd_e59c_40b4_9447_25caf530a1cf.slice/crio-e4dbce71d75a4402ece16cc62c3459bc08d0f9ee434b9c795a88ab5ff3b8b32f WatchSource:0}: Error finding container e4dbce71d75a4402ece16cc62c3459bc08d0f9ee434b9c795a88ab5ff3b8b32f: Status 404 returned error can't find the container with id e4dbce71d75a4402ece16cc62c3459bc08d0f9ee434b9c795a88ab5ff3b8b32f Sep 08 04:15:43.384625 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.384608 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 04:15:43.556104 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.556071 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/must-gather-wxx56" event={"ID":"54b315cd-e59c-40b4-9447-25caf530a1cf","Type":"ContainerStarted","Data":"e4dbce71d75a4402ece16cc62c3459bc08d0f9ee434b9c795a88ab5ff3b8b32f"} Sep 08 04:15:43.992454 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:43.992419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" limit=1024 Sep 08 04:15:44.565301 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:44.565199 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/must-gather-wxx56" event={"ID":"54b315cd-e59c-40b4-9447-25caf530a1cf","Type":"ContainerStarted","Data":"8126beb6134df79c14b93cff2b652ab9faba5748c975a9beb6985c36d5a58ce9"} Sep 08 04:15:44.565301 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:44.565254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/must-gather-wxx56" event={"ID":"54b315cd-e59c-40b4-9447-25caf530a1cf","Type":"ContainerStarted","Data":"718130f5750befebe22ddff0233f8b6cc58f2732970d6495c5cf11ab2a73266d"} Sep 08 04:15:44.583250 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:44.583193 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qbfdx/must-gather-wxx56" podStartSLOduration=1.867396205 podStartE2EDuration="2.58317667s" totalImagesPullingTime="715.780465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:44.581457121 +0000 UTC m=+1225.906363269" watchObservedRunningTime="2026-09-08 04:15:44.58317667 +0000 UTC m=+1225.908082850" Sep 08 04:15:45.661543 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:45.661496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2r5kl_18f168d0-4eff-4fff-babb-9ed38bb788bc/global-pull-secret-syncer/0.log" Sep 08 04:15:45.778351 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:45.778320 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2c44c_49c41524-b3c6-482f-8e85-3a0040fa51a6/konnectivity-agent/0.log" Sep 08 04:15:45.882760 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:45.882719 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-231.ec2.internal_1359749daf4e4b7415802bb044b0e39e/haproxy/0.log" Sep 08 04:15:51.887790 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:51.887719 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/alertmanager/0.log" Sep 08 04:15:51.912966 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:51.912929 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/config-reloader/0.log" Sep 08 04:15:51.931450 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:51.931412 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/kube-rbac-proxy-web/0.log" Sep 08 04:15:51.948835 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:51.948802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/kube-rbac-proxy/0.log" Sep 08 04:15:51.969138 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:51.969110 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/kube-rbac-proxy-metric/0.log" Sep 08 04:15:51.990695 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:51.990650 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/prom-label-proxy/0.log" Sep 08 04:15:52.010188 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.010157 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe3eb0a4-7815-472b-993b-b42f9e2b3210/init-config-reloader/0.log" Sep 08 04:15:52.127959 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.127928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-569d4f5cd9-zqlz7_aa644d67-0072-4f07-b83d-17fe05fc61e3/metrics-server/0.log" Sep 08 04:15:52.243639 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.243560 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msm7k_5a9cf5dc-dce3-458f-96a2-85dbacb774e7/node-exporter/0.log" Sep 08 04:15:52.260356 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.260321 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msm7k_5a9cf5dc-dce3-458f-96a2-85dbacb774e7/kube-rbac-proxy/0.log" Sep 08 04:15:52.276842 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.276817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msm7k_5a9cf5dc-dce3-458f-96a2-85dbacb774e7/init-textfile/0.log" Sep 08 04:15:52.603042 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.602938 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9pzjl_442116c0-70b3-481d-bf4d-bbcbbf68e1b6/prometheus-operator/0.log" Sep 08 04:15:52.619959 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.619925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9pzjl_442116c0-70b3-481d-bf4d-bbcbbf68e1b6/kube-rbac-proxy/0.log" Sep 08 04:15:52.682672 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.682534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-l9l4f_3770b90f-7bfc-4f01-ac17-16b5d994220c/prometheus-operator-admission-webhook/0.log" Sep 08 04:15:52.822997 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.822970 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-754cb57bbf-fdppl_a8be6aae-9e9d-40b3-a4d6-238d4b8da295/thanos-query/0.log" Sep 08 04:15:52.842931 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.842900 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-754cb57bbf-fdppl_a8be6aae-9e9d-40b3-a4d6-238d4b8da295/kube-rbac-proxy-web/0.log" Sep 08 04:15:52.874647 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.874591 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-754cb57bbf-fdppl_a8be6aae-9e9d-40b3-a4d6-238d4b8da295/kube-rbac-proxy/0.log" Sep 08 04:15:52.900864 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.900832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-754cb57bbf-fdppl_a8be6aae-9e9d-40b3-a4d6-238d4b8da295/prom-label-proxy/0.log" Sep 08 04:15:52.929415 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.929367 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-754cb57bbf-fdppl_a8be6aae-9e9d-40b3-a4d6-238d4b8da295/kube-rbac-proxy-rules/0.log" Sep 08 04:15:52.959523 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:52.959487 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-754cb57bbf-fdppl_a8be6aae-9e9d-40b3-a4d6-238d4b8da295/kube-rbac-proxy-metrics/0.log" Sep 08 04:15:55.081049 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.081017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/2.log" Sep 08 04:15:55.087631 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.087602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-tzlbw_045d3f60-0435-48ef-8836-8e0233230c96/console-operator/3.log" Sep 08 04:15:55.620598 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.620567 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-94664c8c-5v9hn_92e24fd2-4f9a-4ab8-b2df-182d95d40097/console/0.log" Sep 08 04:15:55.650183 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.650154 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-qdslj_6ad2809a-6385-4f87-969c-c795837d5bec/download-server/0.log" Sep 08 04:15:55.656176 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.656142 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4"] Sep 08 04:15:55.662711 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.662679 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.666556 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.666524 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4"] Sep 08 04:15:55.711119 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.709109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-lib-modules\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.711119 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.709161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-sys\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.711119 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.709277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvnc\" (UniqueName: \"kubernetes.io/projected/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-kube-api-access-pbvnc\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.711119 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.709308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-proc\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.711119 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.709374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-podres\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.810486 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.810438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-proc\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.810697 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.810541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-podres\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.810697 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.810586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-lib-modules\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.810697 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.810614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-sys\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.810897 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.810770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvnc\" (UniqueName: \"kubernetes.io/projected/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-kube-api-access-pbvnc\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.811232 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.811207 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-proc\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.811346 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.811328 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-podres\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.811432 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.811417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-lib-modules\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.811494 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.811468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-sys\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.820998 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.820966 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvnc\" (UniqueName: \"kubernetes.io/projected/66c03d1e-3de0-46b1-8ff7-23fc02e371fd-kube-api-access-pbvnc\") pod \"perf-node-gather-daemonset-vdxp4\" (UID: \"66c03d1e-3de0-46b1-8ff7-23fc02e371fd\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:55.977834 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:55.977785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:56.274182 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:56.274153 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4"] Sep 08 04:15:56.277468 ip-10-0-131-231 kubenswrapper[2575]: W0908 04:15:56.277430 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66c03d1e_3de0_46b1_8ff7_23fc02e371fd.slice/crio-447dcb16b0124e61f1a701c86bd07117e2e713edc8825485fece5efb237179ad WatchSource:0}: Error finding container 447dcb16b0124e61f1a701c86bd07117e2e713edc8825485fece5efb237179ad: Status 404 returned error can't find the container with id 447dcb16b0124e61f1a701c86bd07117e2e713edc8825485fece5efb237179ad Sep 08 04:15:56.657781 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:56.657748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" event={"ID":"66c03d1e-3de0-46b1-8ff7-23fc02e371fd","Type":"ContainerStarted","Data":"ae963aebd7fc79b49e90682604231a0574113023653e00cda6b6d000df37ecf3"} Sep 08 04:15:56.658064 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:56.657801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" event={"ID":"66c03d1e-3de0-46b1-8ff7-23fc02e371fd","Type":"ContainerStarted","Data":"447dcb16b0124e61f1a701c86bd07117e2e713edc8825485fece5efb237179ad"} Sep 08 04:15:56.658064 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:56.657901 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:15:56.676937 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:56.676884 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" podStartSLOduration=1.6768674159999999 podStartE2EDuration="1.676867416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:56.673106612 +0000 UTC m=+1237.998012762" watchObservedRunningTime="2026-09-08 04:15:56.676867416 +0000 UTC m=+1238.001773557" Sep 08 04:15:57.456958 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:57.456922 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hc6t9_127ab4d5-3d69-495a-affe-2503d0061675/dns/0.log" Sep 08 04:15:57.473301 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:57.473276 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hc6t9_127ab4d5-3d69-495a-affe-2503d0061675/kube-rbac-proxy/0.log" Sep 08 04:15:57.528913 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:57.528886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcr5v_1c417235-1d24-4eb4-90e7-b7ac62c2ac3e/dns-node-resolver/0.log" Sep 08 04:15:58.015914 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:58.015883 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-785d654894-dpldt_8e90d328-ba46-4052-b942-9425bf7a5c4b/registry/0.log" Sep 08 04:15:58.053727 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:58.053652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bb7s2_c6b5053a-e0f8-42e8-9447-c8b2ed122699/node-ca/0.log" Sep 08 04:15:59.024825 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:59.024794 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcfbd747-b58qk_48c03af4-adac-467a-8525-7729306e2c9f/kube-auth-proxy/0.log" Sep 08 04:15:59.827289 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:15:59.827256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wktgd_c08abbc2-d329-401d-9a50-c12cd0fad961/serve-healthcheck-canary/0.log" Sep 08 04:16:00.319932 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:00.319875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xvqj_2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e/kube-rbac-proxy/0.log" Sep 08 04:16:00.337953 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:00.337922 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xvqj_2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e/exporter/0.log" Sep 08 04:16:00.356339 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:00.356298 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xvqj_2573afe7-a55f-4ce5-9a1b-4afc95ea3c9e/extractor/0.log" Sep 08 04:16:02.677585 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:02.677546 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-vdxp4" Sep 08 04:16:02.695400 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:02.695368 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-b8484c5b8-5x8g7_bc92f0e8-ea52-48cb-bbb7-e4acc5526e38/manager/0.log" Sep 08 04:16:02.718504 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:02.718478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-b8484c5b8-5x8g7_bc92f0e8-ea52-48cb-bbb7-e4acc5526e38/copy-manifests/0.log" Sep 08 04:16:03.897057 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:03.897010 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7c9c784dff-9d542_6151c4d8-6b4b-43b7-a233-8500ac226cd1/manager/0.log" Sep 08 04:16:04.648256 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:04.648192 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-54765d59fd-nwzvk_b5cb9aa3-8c7a-459c-a92c-b316616e5739/manager/0.log" Sep 08 04:16:04.898936 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:04.898891 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcfbd747-b58qk_48c03af4-adac-467a-8525-7729306e2c9f/kube-auth-proxy/0.log" Sep 08 04:16:06.259718 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:06.259688 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcfbd747-b58qk_48c03af4-adac-467a-8525-7729306e2c9f/kube-auth-proxy/0.log" Sep 08 04:16:11.163765 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.163693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/kube-multus-additional-cni-plugins/0.log" Sep 08 04:16:11.179987 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.179967 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/egress-router-binary-copy/0.log" Sep 08 04:16:11.194617 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.194597 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/cni-plugins/0.log" Sep 08 04:16:11.210151 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.210131 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/bond-cni-plugin/0.log" Sep 08 04:16:11.225598 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.225574 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/routeoverride-cni/0.log" Sep 08 04:16:11.244271 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.244241 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/whereabouts-cni-bincopy/0.log" Sep 08 04:16:11.259474 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.259453 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x46p8_add0be35-d68a-4e03-9f2f-f1c4095e5d05/whereabouts-cni/0.log" Sep 08 04:16:11.344500 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.344471 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vgwcg_a7d0814b-6a60-465b-aeb6-cbc2db866eb4/kube-multus/0.log" Sep 08 04:16:11.363436 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.363409 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qcndh_53110014-8f58-4ce0-820b-20aeba80aa90/network-metrics-daemon/0.log" Sep 08 04:16:11.379407 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:11.379381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qcndh_53110014-8f58-4ce0-820b-20aeba80aa90/kube-rbac-proxy/0.log" Sep 08 04:16:12.302394 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.302366 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-controller/0.log" Sep 08 04:16:12.317304 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.317282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/1.log" Sep 08 04:16:12.317443 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.317363 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovn-acl-logging/0.log" Sep 08 04:16:12.335980 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.335957 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/kube-rbac-proxy-node/0.log" Sep 08 04:16:12.353320 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.353301 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 04:16:12.368997 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.368979 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/northd/0.log" Sep 08 04:16:12.384405 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.384387 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/nbdb/0.log" Sep 08 04:16:12.400075 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.400040 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/sbdb/0.log" Sep 08 04:16:12.436398 ip-10-0-131-231 kubenswrapper[2575]: I0908 04:16:12.436369 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zvjr_7970b43e-05ca-481d-be96-a9e804fe0c69/ovnkube-controller/0.log"