Sep 18 03:32:36.086594 ip-10-0-136-38 systemd[1]: Starting Kubernetes Kubelet... Sep 18 03:32:36.515835 ip-10-0-136-38 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:32:36.515835 ip-10-0-136-38 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 03:32:36.515835 ip-10-0-136-38 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:32:36.515835 ip-10-0-136-38 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 03:32:36.515835 ip-10-0-136-38 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:32:36.516948 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.516857 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 03:32:36.520978 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520958 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:36.520978 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520974 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:36.520978 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520979 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:36.520978 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520984 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:36.520978 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520988 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520994 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.520998 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521001 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521005 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521011 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521016 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521021 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521025 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521031 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521036 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521040 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521045 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521049 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521054 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521058 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521061 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521065 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521069 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:36.521395 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521074 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521078 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521082 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521086 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521090 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521094 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521098 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521102 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521106 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521110 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521114 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521118 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521123 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521127 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521133 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521140 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521146 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521150 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521155 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:36.522204 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521159 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521163 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521168 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521172 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521176 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521180 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521184 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521189 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521193 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521199 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521202 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521206 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521209 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521213 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521217 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521221 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521224 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521228 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521233 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521237 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:36.523080 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521242 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521246 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521250 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521254 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521258 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521262 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521266 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521270 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521275 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521280 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521284 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521288 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521292 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521312 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521319 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521323 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521327 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521332 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521336 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521341 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:36.523928 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521345 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521349 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521352 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521357 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521362 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521366 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521370 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521375 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521379 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521383 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521387 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521391 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521395 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521399 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521404 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521408 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.521412 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522573 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522584 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522589 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:36.524799 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522594 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522598 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522603 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522608 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522612 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522617 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522621 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522625 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522630 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522634 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522638 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522642 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522646 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522651 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522655 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522659 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522663 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522668 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522672 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522677 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:36.525738 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522681 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522686 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522689 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522693 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522701 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522707 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522713 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522718 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522724 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522734 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522739 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522744 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522748 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522753 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522766 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522771 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522775 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522779 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:36.526356 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522783 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522788 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522794 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522798 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522802 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522808 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522813 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522818 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522823 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522828 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522833 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522837 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522842 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522846 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522850 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522855 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522859 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522863 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522867 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522872 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:36.526871 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522877 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522881 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522886 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522890 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522894 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522899 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522904 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522908 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522912 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522917 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522921 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522926 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522930 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522934 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522938 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522942 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522946 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522950 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522954 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522960 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:36.527439 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522964 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.522969 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523038 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523045 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523050 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523055 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523059 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523063 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523068 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523072 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523076 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523081 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523087 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523091 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523095 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523099 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523103 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523748 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523757 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:36.527966 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523762 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523766 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523771 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523776 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523780 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523785 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523789 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523794 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523798 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523802 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523806 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523811 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523816 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523820 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523824 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523829 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523832 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523837 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523841 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523845 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:36.528483 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523849 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523857 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523863 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523867 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523873 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523877 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523882 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523887 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523891 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523896 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523900 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523905 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523909 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523914 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523918 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523923 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523927 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523931 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523935 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:36.528977 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523939 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523943 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523947 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523951 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523955 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523964 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523970 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523975 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523980 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523985 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523990 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523994 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.523998 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524003 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524007 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524012 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524016 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524020 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524024 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524028 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:36.529462 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524034 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524038 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524043 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524049 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524054 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524059 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524063 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524067 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524072 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524077 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524081 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524085 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524089 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524093 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524097 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524102 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524106 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524110 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524114 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524118 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:36.529944 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524122 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524126 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524134 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524138 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524142 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524146 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524150 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524155 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524159 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524164 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524168 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524172 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524176 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524180 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524184 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524188 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524192 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.524196 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524317 2576 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524373 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524384 2576 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 03:32:36.530454 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524391 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524398 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524403 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524410 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524419 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524424 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524430 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524435 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524441 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524446 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524451 2576 flags.go:64] FLAG: --cgroup-root="" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524456 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524461 2576 flags.go:64] FLAG: --client-ca-file="" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524467 2576 flags.go:64] FLAG: --cloud-provider="external" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524472 2576 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524478 2576 flags.go:64] FLAG: --cluster-domain="" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524483 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524489 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524494 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524499 2576 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524505 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524510 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524515 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 03:32:36.530955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524520 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524525 2576 flags.go:64] FLAG: --contention-profiling="false" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524530 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524535 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524540 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524545 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524551 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524556 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524561 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524565 2576 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524570 2576 flags.go:64] FLAG: --enable-server="true" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524576 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524584 2576 flags.go:64] FLAG: --event-burst="100" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524589 2576 flags.go:64] FLAG: --event-qps="50" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524593 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524599 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524604 2576 flags.go:64] FLAG: --eviction-hard="" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524610 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524614 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524619 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524624 2576 flags.go:64] FLAG: --eviction-soft="" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524629 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524636 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524640 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524645 2576 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 03:32:36.531539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524650 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524654 2576 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524659 2576 flags.go:64] FLAG: --feature-gates="" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524665 2576 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524670 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524675 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524679 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524685 2576 flags.go:64] FLAG: --healthz-port="10248" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524689 2576 flags.go:64] FLAG: --help="false" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524694 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524699 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524704 2576 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524709 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524714 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524720 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524725 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524729 2576 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524734 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524738 2576 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524744 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524750 2576 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524754 2576 flags.go:64] FLAG: --kube-reserved="" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524759 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524763 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 03:32:36.532190 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524769 2576 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524774 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524779 2576 flags.go:64] FLAG: --lock-file="" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524783 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524788 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524794 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524802 2576 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524807 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524811 2576 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524815 2576 flags.go:64] FLAG: --logging-format="text" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524820 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524826 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524831 2576 flags.go:64] FLAG: --manifest-url="" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524836 2576 flags.go:64] FLAG: --manifest-url-header="" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524842 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524847 2576 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524854 2576 flags.go:64] FLAG: --max-pods="110" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524859 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524864 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524869 2576 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524873 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524878 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524883 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524888 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524900 2576 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 03:32:36.532793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524905 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524910 2576 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524915 2576 flags.go:64] FLAG: --pod-cidr="" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524920 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524929 2576 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524934 2576 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524941 2576 flags.go:64] FLAG: --pods-per-core="0" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524946 2576 flags.go:64] FLAG: --port="10250" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524951 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524955 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bafe85b090b36724" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524960 2576 flags.go:64] FLAG: --qos-reserved="" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524965 2576 flags.go:64] FLAG: --read-only-port="10255" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524971 2576 flags.go:64] FLAG: --register-node="true" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524976 2576 flags.go:64] FLAG: --register-with-taints="" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524982 2576 flags.go:64] FLAG: --registry-burst="10" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524986 2576 flags.go:64] FLAG: --registry-qps="5" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524991 2576 flags.go:64] FLAG: --reserved-cpus="" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.524995 2576 flags.go:64] FLAG: --reserved-memory="" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525001 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525006 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525011 2576 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525016 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525020 2576 flags.go:64] FLAG: --runonce="false" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525025 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525030 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 03:32:36.533591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525035 2576 flags.go:64] FLAG: --seccomp-default="false" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525039 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525044 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525049 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525054 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525060 2576 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525064 2576 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525069 2576 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525074 2576 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525079 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525084 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525089 2576 flags.go:64] FLAG: --system-cgroups="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525094 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525105 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525110 2576 flags.go:64] FLAG: --tls-cert-file="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525115 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525121 2576 flags.go:64] FLAG: --tls-min-version="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525125 2576 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525130 2576 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525135 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525140 2576 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525146 2576 flags.go:64] FLAG: --v="2" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525152 2576 flags.go:64] FLAG: --version="false" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525158 2576 flags.go:64] FLAG: --vmodule="" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525163 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 03:32:36.534694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.525168 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525370 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525378 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525383 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525388 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525392 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525396 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525401 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525406 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525410 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525414 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525419 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525423 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525427 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525431 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525436 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525443 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525449 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525454 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525460 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:36.535677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525467 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525472 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525476 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525480 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525485 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525489 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525494 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525498 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525503 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525509 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525514 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525519 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525523 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525527 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525531 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525536 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525540 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525545 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525549 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:36.536168 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525555 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525560 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525565 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525570 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525574 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525578 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525583 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525588 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525592 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525596 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525600 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525604 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525608 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525615 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525619 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525624 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525629 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525633 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525637 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525642 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:36.536995 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525646 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525650 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525654 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525659 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525663 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525668 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525672 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525676 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525681 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525686 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525690 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525694 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525698 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525703 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525707 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525711 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525715 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525720 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525724 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525728 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:36.537864 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525732 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525736 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525740 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525744 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525747 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525755 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525760 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525764 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525768 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525773 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525777 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525781 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525785 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525789 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525793 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525797 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525801 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525805 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525810 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525814 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:36.538421 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.525818 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.526768 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.535497 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.535514 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.536441 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.536454 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536538 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536547 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536553 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536563 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536569 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536574 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536578 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:36.539155 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536582 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536586 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536590 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536595 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536602 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536606 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536611 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536616 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536622 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536626 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536631 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536636 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536641 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536645 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536649 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536653 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536658 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536662 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536666 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536670 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:36.539759 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536675 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536679 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536683 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536687 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536697 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536701 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536705 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536710 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536714 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536718 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536722 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536727 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536732 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536736 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536740 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536744 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536749 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536753 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536758 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536762 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:36.540493 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536766 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536770 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536775 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536779 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536785 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536790 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536795 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536799 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536804 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536808 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536813 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536817 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536821 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536824 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536829 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536833 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536838 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536842 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536846 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:36.541112 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536850 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536854 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536858 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536863 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536867 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536871 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536875 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536882 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536888 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536893 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536897 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536902 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536906 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536910 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536914 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536919 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536923 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536927 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536931 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:36.541638 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536935 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536939 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536943 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536947 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536952 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536956 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536960 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536964 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536968 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536972 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536977 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536981 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.536985 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.536993 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537171 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:32:36.542140 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537179 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537184 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537188 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537192 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537196 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537203 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537210 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537214 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537218 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537223 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537228 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537232 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537236 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537240 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537245 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537249 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537253 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537257 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537261 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537265 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:32:36.542531 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537269 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537273 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537278 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537282 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537286 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537290 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537294 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537315 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537319 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537324 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537328 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537332 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537336 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537340 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537345 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537349 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537353 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537357 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537365 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:32:36.543083 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537371 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537376 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537380 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537385 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537391 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537395 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537399 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537403 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537407 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537411 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537416 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537420 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537426 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537431 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537436 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537441 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537445 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537449 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537454 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537458 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:32:36.543579 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537462 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537467 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537470 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537475 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537479 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537483 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537487 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537491 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537495 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537500 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537504 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537508 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537513 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537517 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537521 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537525 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537529 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537534 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537538 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:32:36.544157 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537542 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537546 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537550 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537554 2576 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537558 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537562 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537567 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537571 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537575 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537580 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537584 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537588 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537591 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537595 2576 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537599 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537604 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537608 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537615 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537619 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:32:36.544785 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:36.537623 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.537631 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.537775 2576 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.540897 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.542028 2576 server.go:1019] "Starting client certificate rotation" Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.542134 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.542936 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 03:32:36.545559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.545281 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 03:32:36.548848 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.548825 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 03:32:36.556277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.556259 2576 log.go:25] "Validated CRI v1 runtime API" Sep 18 03:32:36.558197 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.558180 2576 log.go:25] "Validated CRI v1 image API" Sep 18 03:32:36.563446 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.563427 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 03:32:36.566744 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.566717 2576 fs.go:135] Filesystem UUIDs: map[3ff2c49c-af9d-47be-a94f-7bd6fe06d198:/dev/nvme0n1p3 652b32d8-bc83-4f30-aaba-825f7e566d2f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 18 03:32:36.566806 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.566743 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 03:32:36.571925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.571815 2576 manager.go:216] Machine: {Timestamp:2026-09-18 03:32:36.570473303 +0000 UTC m=+0.376625144 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3012880 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c4279830d05e042d5c40b47d74221 SystemUUID:ec2c4279-830d-05e0-42d5-c40b47d74221 BootID:f1b6dfd2-51d6-4d60-ac46-ddbd899847ae Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f1:14:ed:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f1:14:ed:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:d6:c5:b6:7a:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 03:32:36.571925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.571918 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 03:32:36.572030 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.571994 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 03:32:36.572608 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.572593 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 03:32:36.575325 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.575286 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 03:32:36.575465 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.575328 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 03:32:36.576143 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.576133 2576 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 03:32:36.576171 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.576146 2576 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 03:32:36.576171 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.576154 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 03:32:36.576998 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.576988 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 03:32:36.577070 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.577061 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 03:32:36.581660 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581648 2576 state_mem.go:36] "Initialized new in-memory state store" Sep 18 03:32:36.581774 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581765 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 03:32:36.581811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581794 2576 kubelet.go:486] "Attempting to sync node with API server" Sep 18 03:32:36.581811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581803 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 03:32:36.581867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581821 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 03:32:36.581867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581831 2576 kubelet.go:398] "Adding apiserver pod source" Sep 18 03:32:36.581867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.581840 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 03:32:36.582182 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.582171 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 03:32:36.582263 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.582189 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 03:32:36.584397 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.584380 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 03:32:36.588401 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.588365 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 03:32:36.588499 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.588431 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 03:32:36.590217 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590196 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590227 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590234 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590240 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590249 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590254 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590269 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590274 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590280 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 03:32:36.590284 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590286 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 03:32:36.590550 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590308 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 03:32:36.590550 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.590314 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 03:32:36.591237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.591226 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 03:32:36.591237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.591235 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 03:32:36.593650 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.593511 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 03:32:36.593731 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.593556 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 03:32:36.593731 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.593584 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 03:32:36.595194 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.595180 2576 server.go:1268] "Started kubelet" Sep 18 03:32:36.595275 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.595239 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 03:32:36.595351 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.595284 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 03:32:36.595408 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.595365 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 03:32:36.595902 ip-10-0-136-38 systemd[1]: Started Kubernetes Kubelet. Sep 18 03:32:36.596962 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.596946 2576 server.go:310] "Adding debug handlers to kubelet server" Sep 18 03:32:36.597049 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.596973 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 03:32:36.601275 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.601256 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 03:32:36.602280 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.601159 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-38.ec2.internal.18d64ccfa2889b46 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-38.ec2.internal,UID:ip-10-0-136-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-38.ec2.internal,},FirstTimestamp:2026-09-18 03:32:36.595153734 +0000 UTC m=+0.401305575,LastTimestamp:2026-09-18 03:32:36.595153734 +0000 UTC m=+0.401305575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-38.ec2.internal,}" Sep 18 03:32:36.606012 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.605994 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 03:32:36.606737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.606717 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 03:32:36.606973 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.606953 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:36.607460 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607434 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 03:32:36.607460 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607453 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 03:32:36.607559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607465 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 03:32:36.607559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607530 2576 reconstruct.go:97] "Volume reconstruction finished" Sep 18 03:32:36.607559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607537 2576 reconciler.go:29] "Reconciler: start to sync state" Sep 18 03:32:36.607643 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607563 2576 factory.go:55] Registering systemd factory Sep 18 03:32:36.607643 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607574 2576 factory.go:223] Registration of the systemd container factory successfully Sep 18 03:32:36.607765 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607752 2576 factory.go:153] Registering CRI-O factory Sep 18 03:32:36.607816 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607769 2576 factory.go:223] Registration of the crio container factory successfully Sep 18 03:32:36.607867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607859 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 03:32:36.607915 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607877 2576 factory.go:103] Registering Raw factory Sep 18 03:32:36.607915 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.607893 2576 manager.go:1196] Started watching for new ooms in manager Sep 18 03:32:36.608276 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.608261 2576 manager.go:349] Starting recovery of all containers Sep 18 03:32:36.610659 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.610633 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 03:32:36.610759 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.610738 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 03:32:36.620322 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.620279 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjgzc" Sep 18 03:32:36.621866 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.621750 2576 manager.go:354] Recovery completed Sep 18 03:32:36.625574 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.625556 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjgzc" Sep 18 03:32:36.627368 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.627355 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.629928 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.629912 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.629991 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.629943 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.629991 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.629960 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.630623 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.630605 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 03:32:36.630623 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.630619 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.630742 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.630621 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 03:32:36.630742 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.630695 2576 state_mem.go:36] "Initialized new in-memory state store" Sep 18 03:32:36.631751 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.631669 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-38.ec2.internal.18d64ccfa49b38ec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-38.ec2.internal,UID:ip-10-0-136-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-38.ec2.internal,},FirstTimestamp:2026-09-18 03:32:36.629928172 +0000 UTC m=+0.436080020,LastTimestamp:2026-09-18 03:32:36.629928172 +0000 UTC m=+0.436080020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-38.ec2.internal,}" Sep 18 03:32:36.632122 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.632106 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.632199 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.632131 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.632199 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.632141 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.632855 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.632841 2576 policy_none.go:49] "None policy: Start" Sep 18 03:32:36.632855 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.632857 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 03:32:36.632966 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.632870 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 03:32:36.634965 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.634955 2576 policy_none.go:47] "Start" Sep 18 03:32:36.665844 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.665829 2576 manager.go:337] "Starting Device Plugin manager" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.665861 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.665871 2576 server.go:87] "Starting device plugin registration server" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.666181 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.666191 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.666270 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.666366 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.666377 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.666803 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 03:32:36.683775 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.666846 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:36.712787 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.712766 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 03:32:36.713881 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.713864 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 03:32:36.713950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.713908 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 03:32:36.713950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.713934 2576 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 03:32:36.714033 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.713986 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 03:32:36.716376 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.716354 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:36.767138 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.767065 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.767940 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.767923 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.768018 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.767955 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.768018 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.767976 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.768018 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.768004 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.777347 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.777330 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.777419 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.777352 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-38.ec2.internal\": node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:36.803125 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.803106 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:36.814548 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.814529 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal"] Sep 18 03:32:36.814618 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.814583 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.815909 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.815894 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.815970 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.815923 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.815970 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.815934 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.818287 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818274 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.818417 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818402 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.818481 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818437 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.818926 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818911 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.818986 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818911 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.818986 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818944 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.818986 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818958 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.819094 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.818944 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.819094 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.819027 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.821292 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.821277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.821396 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.821317 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:32:36.821903 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.821889 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:32:36.821965 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.821913 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:32:36.821965 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:36.821923 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:32:36.837840 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.837817 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-38.ec2.internal\" not found" node="ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.839927 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.839909 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-38.ec2.internal\" not found" node="ip-10-0-136-38.ec2.internal" Sep 18 03:32:36.903647 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:36.903624 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:37.003933 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:37.003895 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:37.009259 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.009241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a1da006789cadfe221cc035b2d280ed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-38.ec2.internal\" (UID: \"1a1da006789cadfe221cc035b2d280ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.009329 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.009292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2fc57d3d67874efb51e88b2e375b19c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"2fc57d3d67874efb51e88b2e375b19c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.009372 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.009337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fc57d3d67874efb51e88b2e375b19c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"2fc57d3d67874efb51e88b2e375b19c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.104613 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:37.104537 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:37.109878 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.109859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fc57d3d67874efb51e88b2e375b19c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"2fc57d3d67874efb51e88b2e375b19c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.109957 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.109893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a1da006789cadfe221cc035b2d280ed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-38.ec2.internal\" (UID: \"1a1da006789cadfe221cc035b2d280ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.109957 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.109920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2fc57d3d67874efb51e88b2e375b19c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"2fc57d3d67874efb51e88b2e375b19c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.110058 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.109975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a1da006789cadfe221cc035b2d280ed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-38.ec2.internal\" (UID: \"1a1da006789cadfe221cc035b2d280ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.110058 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.110008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2fc57d3d67874efb51e88b2e375b19c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"2fc57d3d67874efb51e88b2e375b19c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.110058 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.109975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fc57d3d67874efb51e88b2e375b19c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"2fc57d3d67874efb51e88b2e375b19c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.142035 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.142010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.144137 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:37.144122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:37.205639 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:37.205605 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:37.306094 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:37.306062 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:38.943753 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:38.943690 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:39.003335 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.003309 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:39.044246 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:39.044215 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:39.078593 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.078569 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 03:32:39.078976 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.078694 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 03:32:39.078976 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.078726 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 03:32:39.144938 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:39.144908 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:39.170068 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.170034 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 03:27:38 +0000 UTC" deadline="2028-02-20 03:14:45.581722835 +0000 UTC" Sep 18 03:32:39.170184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.170087 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12479h42m6.411642029s" Sep 18 03:32:39.245493 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:39.245442 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Sep 18 03:32:39.253092 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.253071 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:39.253806 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:39.253777 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1da006789cadfe221cc035b2d280ed.slice/crio-707cf545e61e6f90c0630fdccba65338428e532d9fb0b91fff448317fc9efc54 WatchSource:0}: Error finding container 707cf545e61e6f90c0630fdccba65338428e532d9fb0b91fff448317fc9efc54: Status 404 returned error can't find the container with id 707cf545e61e6f90c0630fdccba65338428e532d9fb0b91fff448317fc9efc54 Sep 18 03:32:39.254677 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:39.254657 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc57d3d67874efb51e88b2e375b19c9.slice/crio-69d9dfc1658b0751f5923a2a5b5c2f1d353cc3784df226d6ad6c170a06e27a3f WatchSource:0}: Error finding container 69d9dfc1658b0751f5923a2a5b5c2f1d353cc3784df226d6ad6c170a06e27a3f: Status 404 returned error can't find the container with id 69d9dfc1658b0751f5923a2a5b5c2f1d353cc3784df226d6ad6c170a06e27a3f Sep 18 03:32:39.259351 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.259337 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:32:39.337343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.337322 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:39.344175 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.344156 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Sep 18 03:32:39.353367 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.353346 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 03:32:39.354236 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.354224 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Sep 18 03:32:39.364053 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:39.364037 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 03:32:40.121173 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.120910 2576 apiserver.go:52] "Watching apiserver" Sep 18 03:32:40.127968 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.127946 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 03:32:40.128413 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.128391 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-942rk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-6zdtq","openshift-ovn-kubernetes/ovnkube-node-jfvbj","kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mb2xz","openshift-dns/node-resolver-vlv2c","openshift-image-registry/node-ca-gxgln","openshift-multus/multus-wqrbx","openshift-multus/network-metrics-daemon-gf592","openshift-network-diagnostics/network-check-target-qq6b2","openshift-network-operator/iptables-alerter-jmvlm","kube-system/global-pull-secret-syncer-vfqzn"] Sep 18 03:32:40.131000 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.130975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.133241 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.133089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.133392 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.133372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.133578 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.133560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.133707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.133691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mzzbs\"" Sep 18 03:32:40.135070 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.135049 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.135581 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.135550 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 03:32:40.136393 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.136370 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.137540 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.136750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.137540 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.136851 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:40.138392 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.137785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7tsm\"" Sep 18 03:32:40.139295 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.138851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.141079 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.141056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.141902 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.141401 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dbck9\"" Sep 18 03:32:40.142375 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.142140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.142602 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.142161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.142688 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.142167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 03:32:40.142688 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.142225 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 03:32:40.142795 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.142251 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 03:32:40.144137 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.144111 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 03:32:40.144275 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.144236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.145119 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.145081 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 03:32:40.145708 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.145689 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t2s2j\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.145938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.145996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.146021 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.146214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.146217 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.146275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.146303 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5k8vl\"" Sep 18 03:32:40.146404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.146365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 03:32:40.147545 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.147025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.149659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.149099 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.149659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.149209 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 03:32:40.149659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.149416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.149659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.149435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zwbdd\"" Sep 18 03:32:40.149659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.149651 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.151622 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.151603 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 03:32:40.152267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.151841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bmjs\"" Sep 18 03:32:40.152267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.151874 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 03:32:40.152267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.151925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.153769 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.153751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.154811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-serviceca\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.154811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-systemd\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.154811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-host\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.154811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-dbus\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.154811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-var-lib-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.154811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-etc-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-ovn\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-cni-bin\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-tmp-dir\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-kubernetes\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysctl-d\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.154985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysctl-conf\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-lib-modules\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpl5z\" (UniqueName: \"kubernetes.io/projected/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-kube-api-access-hpl5z\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-kubelet\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-sys\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-systemd-units\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-run-netns\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-log-socket\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovnkube-script-lib\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmqc7\" (UniqueName: \"kubernetes.io/projected/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-kube-api-access-vmqc7\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/932e0f59-1b36-417e-924b-89959f42d420-iptables-alerter-script\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2wv\" (UniqueName: \"kubernetes.io/projected/932e0f59-1b36-417e-924b-89959f42d420-kube-api-access-lm2wv\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a57cd0d-c42f-4cf0-9345-933695270bc1-tmp\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-system-cni-dir\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cnibin\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovnkube-config\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-host\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-cni-netd\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.155707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-env-overrides\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932e0f59-1b36-417e-924b-89959f42d420-host-slash\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-modprobe-d\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-run\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-var-lib-kubelet\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-tuned\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-slash\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5px9\" (UniqueName: \"kubernetes.io/projected/8a57cd0d-c42f-4cf0-9345-933695270bc1-kube-api-access-m5px9\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkfn\" (UniqueName: \"kubernetes.io/projected/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-kube-api-access-spkfn\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-hosts-file\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfd2\" (UniqueName: \"kubernetes.io/projected/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-kube-api-access-qvfd2\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.155978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysconfig\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-kubelet-config\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.156343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-systemd\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-node-log\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovn-node-metrics-cert\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.156675 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.156916 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ct42r\"" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.157062 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pgk9b\"" Sep 18 03:32:40.157089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.157084 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 03:32:40.157359 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.157222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 03:32:40.157359 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.157272 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 03:32:40.157359 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.157311 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 03:32:40.157528 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.157398 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 03:32:40.158690 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.158664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:40.158776 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.158720 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:40.176718 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.176696 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvpct" Sep 18 03:32:40.184285 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.184266 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvpct" Sep 18 03:32:40.246463 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.246426 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 03:32:40.253062 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.253037 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:40.255934 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.255890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" event={"ID":"1a1da006789cadfe221cc035b2d280ed","Type":"ContainerStarted","Data":"707cf545e61e6f90c0630fdccba65338428e532d9fb0b91fff448317fc9efc54"} Sep 18 03:32:40.256293 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:40.256366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-run\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.256366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.256487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.256487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-slash\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.256487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-hosts-file\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.256487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-k8s-cni-cncf-io\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.256489 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-run\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-kubelet-config\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-systemd\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-hosts-file\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256575 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-systemd\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256613 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-slash\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.256567 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:32:40.756531951 +0000 UTC m=+3.025531910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovn-node-metrics-cert\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-kubelet-config\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170150d8-1619-4f88-9282-cb53a22f3c06-cni-binary-copy\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-systemd\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-ovn\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-cni-bin\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.256800 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256793 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-systemd\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-cni-bin\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-socket-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-ovn\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysctl-d\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-kubelet\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovnkube-script-lib\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256956 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.256975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-registration-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-kubelet\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-sys-fs\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-hostroot\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cde83bf5-532f-449c-801d-9886391e38d2-konnectivity-ca\") pod \"konnectivity-agent-942rk\" (UID: \"cde83bf5-532f-449c-801d-9886391e38d2\") " pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysctl-d\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-sys\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.257423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-log-socket\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/932e0f59-1b36-417e-924b-89959f42d420-iptables-alerter-script\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-sys\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a57cd0d-c42f-4cf0-9345-933695270bc1-tmp\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-log-socket\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cnibin\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257280 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cnibin\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257284 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-host\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170150d8-1619-4f88-9282-cb53a22f3c06-multus-daemon-config\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-etc-kubernetes\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x728\" (UniqueName: \"kubernetes.io/projected/170150d8-1619-4f88-9282-cb53a22f3c06-kube-api-access-8x728\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-cni-netd\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8r25\" (UniqueName: \"kubernetes.io/projected/344f767f-39bc-43d0-b5c9-2a55edc6e277-kube-api-access-l8r25\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.258253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69m6\" (UniqueName: \"kubernetes.io/projected/8db89550-fea8-45bf-b990-609ad2ec5648-kube-api-access-v69m6\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-modprobe-d\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-var-lib-kubelet\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovnkube-script-lib\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-host\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-tuned\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-cni-netd\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-modprobe-d\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-var-lib-kubelet\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spkfn\" (UniqueName: \"kubernetes.io/projected/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-kube-api-access-spkfn\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfd2\" (UniqueName: \"kubernetes.io/projected/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-kube-api-access-qvfd2\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/932e0f59-1b36-417e-924b-89959f42d420-iptables-alerter-script\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-kubelet\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.259061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5px9\" (UniqueName: \"kubernetes.io/projected/8a57cd0d-c42f-4cf0-9345-933695270bc1-kube-api-access-m5px9\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.257979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-device-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-netns\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-conf-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-multus-certs\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysconfig\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-node-log\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysconfig\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-serviceca\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2wv\" (UniqueName: \"kubernetes.io/projected/932e0f59-1b36-417e-924b-89959f42d420-kube-api-access-lm2wv\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-system-cni-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-node-log\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cde83bf5-532f-449c-801d-9886391e38d2-agent-certs\") pod \"konnectivity-agent-942rk\" (UID: \"cde83bf5-532f-449c-801d-9886391e38d2\") " pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-host\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-dbus\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.259898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-var-lib-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258486 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-host\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-etc-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258533 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-dbus\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-var-lib-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-tmp-dir\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258623 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-serviceca\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-socket-dir-parent\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258708 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-etc-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-kubernetes\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysctl-conf\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258814 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-kubernetes\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-tmp-dir\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-lib-modules\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpl5z\" (UniqueName: \"kubernetes.io/projected/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-kube-api-access-hpl5z\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-sysctl-conf\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmqc7\" (UniqueName: \"kubernetes.io/projected/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-kube-api-access-vmqc7\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.260699 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-run-openvswitch\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a57cd0d-c42f-4cf0-9345-933695270bc1-lib-modules\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.258971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-cni-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-systemd-units\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-run-netns\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-system-cni-dir\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259083 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-systemd-units\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovnkube-config\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-host-run-netns\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932e0f59-1b36-417e-924b-89959f42d420-host-slash\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259144 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-system-cni-dir\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-cnibin\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-cni-multus\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-env-overrides\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932e0f59-1b36-417e-924b-89959f42d420-host-slash\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-cni-bin\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.262487 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259532 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovnkube-config\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.263169 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.259580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-env-overrides\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.263169 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.260214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" event={"ID":"2fc57d3d67874efb51e88b2e375b19c9","Type":"ContainerStarted","Data":"69d9dfc1658b0751f5923a2a5b5c2f1d353cc3784df226d6ad6c170a06e27a3f"} Sep 18 03:32:40.263169 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.262199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a57cd0d-c42f-4cf0-9345-933695270bc1-tmp\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.263169 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.262346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-ovn-node-metrics-cert\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.263169 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.263067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a57cd0d-c42f-4cf0-9345-933695270bc1-etc-tuned\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.269194 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.269168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5px9\" (UniqueName: \"kubernetes.io/projected/8a57cd0d-c42f-4cf0-9345-933695270bc1-kube-api-access-m5px9\") pod \"tuned-mb2xz\" (UID: \"8a57cd0d-c42f-4cf0-9345-933695270bc1\") " pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.269288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.269190 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2wv\" (UniqueName: \"kubernetes.io/projected/932e0f59-1b36-417e-924b-89959f42d420-kube-api-access-lm2wv\") pod \"iptables-alerter-jmvlm\" (UID: \"932e0f59-1b36-417e-924b-89959f42d420\") " pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.269288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.269191 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkfn\" (UniqueName: \"kubernetes.io/projected/a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a-kube-api-access-spkfn\") pod \"ovnkube-node-jfvbj\" (UID: \"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.270136 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.270095 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmqc7\" (UniqueName: \"kubernetes.io/projected/c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2-kube-api-access-vmqc7\") pod \"node-resolver-vlv2c\" (UID: \"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2\") " pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.270615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.270592 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpl5z\" (UniqueName: \"kubernetes.io/projected/aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5-kube-api-access-hpl5z\") pod \"multus-additional-cni-plugins-6zdtq\" (UID: \"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5\") " pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.270724 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.270672 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfd2\" (UniqueName: \"kubernetes.io/projected/43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f-kube-api-access-qvfd2\") pod \"node-ca-gxgln\" (UID: \"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f\") " pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.359890 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69m6\" (UniqueName: \"kubernetes.io/projected/8db89550-fea8-45bf-b990-609ad2ec5648-kube-api-access-v69m6\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-kubelet\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-device-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-netns\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-conf-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-kubelet\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.359997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-multus-certs\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-system-cni-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360046 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-netns\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360062 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-device-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cde83bf5-532f-449c-801d-9886391e38d2-agent-certs\") pod \"konnectivity-agent-942rk\" (UID: \"cde83bf5-532f-449c-801d-9886391e38d2\") " pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360071 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-conf-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360090 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-multus-certs\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-system-cni-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-socket-dir-parent\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-cni-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-socket-dir-parent\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-cnibin\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-cni-multus\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-cni-bin\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-cni-bin\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-cnibin\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360278 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-multus-cni-dir\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360280 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-var-lib-cni-multus\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.360502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-k8s-cni-cncf-io\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170150d8-1619-4f88-9282-cb53a22f3c06-cni-binary-copy\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.360426 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-socket-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360479 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-host-run-k8s-cni-cncf-io\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.360513 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:40.860494531 +0000 UTC m=+3.129494470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-registration-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-sys-fs\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360592 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360594 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-socket-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-hostroot\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cde83bf5-532f-449c-801d-9886391e38d2-konnectivity-ca\") pod \"konnectivity-agent-942rk\" (UID: \"cde83bf5-532f-449c-801d-9886391e38d2\") " pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-registration-dir\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/344f767f-39bc-43d0-b5c9-2a55edc6e277-sys-fs\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-hostroot\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.361384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170150d8-1619-4f88-9282-cb53a22f3c06-multus-daemon-config\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-etc-kubernetes\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x728\" (UniqueName: \"kubernetes.io/projected/170150d8-1619-4f88-9282-cb53a22f3c06-kube-api-access-8x728\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8r25\" (UniqueName: \"kubernetes.io/projected/344f767f-39bc-43d0-b5c9-2a55edc6e277-kube-api-access-l8r25\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360844 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170150d8-1619-4f88-9282-cb53a22f3c06-etc-kubernetes\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.360952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170150d8-1619-4f88-9282-cb53a22f3c06-cni-binary-copy\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.361183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170150d8-1619-4f88-9282-cb53a22f3c06-multus-daemon-config\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.362184 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.361220 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cde83bf5-532f-449c-801d-9886391e38d2-konnectivity-ca\") pod \"konnectivity-agent-942rk\" (UID: \"cde83bf5-532f-449c-801d-9886391e38d2\") " pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.363225 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.363199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cde83bf5-532f-449c-801d-9886391e38d2-agent-certs\") pod \"konnectivity-agent-942rk\" (UID: \"cde83bf5-532f-449c-801d-9886391e38d2\") " pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.366723 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.366706 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:40.366723 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.366725 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:40.366863 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.366736 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:40.366863 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.366803 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:40.866786113 +0000 UTC m=+3.135786053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:40.368977 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.368953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x728\" (UniqueName: \"kubernetes.io/projected/170150d8-1619-4f88-9282-cb53a22f3c06-kube-api-access-8x728\") pod \"multus-wqrbx\" (UID: \"170150d8-1619-4f88-9282-cb53a22f3c06\") " pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.369793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.369772 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8r25\" (UniqueName: \"kubernetes.io/projected/344f767f-39bc-43d0-b5c9-2a55edc6e277-kube-api-access-l8r25\") pod \"aws-ebs-csi-driver-node-b2mgl\" (UID: \"344f767f-39bc-43d0-b5c9-2a55edc6e277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.369880 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.369823 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69m6\" (UniqueName: \"kubernetes.io/projected/8db89550-fea8-45bf-b990-609ad2ec5648-kube-api-access-v69m6\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.446187 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.446107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" Sep 18 03:32:40.454544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.454519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jmvlm" Sep 18 03:32:40.464858 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.464836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" Sep 18 03:32:40.472895 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.472869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:32:40.478520 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.478503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vlv2c" Sep 18 03:32:40.485110 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.485089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gxgln" Sep 18 03:32:40.494716 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.494696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-942rk" Sep 18 03:32:40.501478 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.501459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" Sep 18 03:32:40.508230 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.508212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wqrbx" Sep 18 03:32:40.763104 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.763019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:40.763267 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.763177 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:40.763267 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.763248 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:32:41.76322807 +0000 UTC m=+4.032228030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:40.864469 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.864407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:40.864635 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.864532 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:40.864635 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.864596 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:41.864583179 +0000 UTC m=+4.133583119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:40.965360 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:40.965320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:40.965514 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.965495 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:40.965569 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.965520 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:40.965569 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.965530 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:40.965632 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:40.965578 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:41.965565212 +0000 UTC m=+4.234565150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:41.187063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:41.186986 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 03:27:40 +0000 UTC" deadline="2028-06-08 22:50:43.585766276 +0000 UTC" Sep 18 03:32:41.187063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:41.187014 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15115h18m2.398755319s" Sep 18 03:32:41.345588 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:41.345553 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fefb7a_770a_4fc9_b4d9_27b9bb9cb03a.slice/crio-044202ee865eba46b7b9eb693c687f7799bec8d4e9446f6b3a3c32beb4f42a66 WatchSource:0}: Error finding container 044202ee865eba46b7b9eb693c687f7799bec8d4e9446f6b3a3c32beb4f42a66: Status 404 returned error can't find the container with id 044202ee865eba46b7b9eb693c687f7799bec8d4e9446f6b3a3c32beb4f42a66 Sep 18 03:32:41.347432 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:41.347346 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde83bf5_532f_449c_801d_9886391e38d2.slice/crio-4bc06bff36b0f20a1bb1e187c306a024a8c96458d2b7b67bf3dfc979c6064423 WatchSource:0}: Error finding container 4bc06bff36b0f20a1bb1e187c306a024a8c96458d2b7b67bf3dfc979c6064423: Status 404 returned error can't find the container with id 4bc06bff36b0f20a1bb1e187c306a024a8c96458d2b7b67bf3dfc979c6064423 Sep 18 03:32:41.351588 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:32:41.351554 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932e0f59_1b36_417e_924b_89959f42d420.slice/crio-9b8f04fe290ad896cc51c57527d6900208c340ab602a9d364ad008e9f0c9cee8 WatchSource:0}: Error finding container 9b8f04fe290ad896cc51c57527d6900208c340ab602a9d364ad008e9f0c9cee8: Status 404 returned error can't find the container with id 9b8f04fe290ad896cc51c57527d6900208c340ab602a9d364ad008e9f0c9cee8 Sep 18 03:32:41.772618 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:41.772580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:41.772771 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.772723 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:41.772829 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.772789 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:32:43.772769268 +0000 UTC m=+6.041769216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:41.873565 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:41.873483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:41.873722 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.873626 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:41.873722 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.873690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:43.87367263 +0000 UTC m=+6.142672588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:41.964851 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:41.964816 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:32:41.974290 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:41.974259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:41.974437 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.974428 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:41.974522 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.974465 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:41.974522 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.974479 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:41.974628 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:41.974532 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:43.974515767 +0000 UTC m=+6.243515712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:42.187890 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.187773 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 03:27:40 +0000 UTC" deadline="2028-04-12 17:14:17.882075118 +0000 UTC" Sep 18 03:32:42.187890 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.187837 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13741h41m35.694243113s" Sep 18 03:32:42.254928 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.254055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:42.254928 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:42.254205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:42.254928 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.254612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:42.254928 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:42.254706 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:42.254928 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.254766 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:42.254928 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:42.254833 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:42.266530 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.266400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"044202ee865eba46b7b9eb693c687f7799bec8d4e9446f6b3a3c32beb4f42a66"} Sep 18 03:32:42.271819 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.271655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerStarted","Data":"6bc2143129868346267fc245304be2736ec67570d48097349b4f090e4107d145"} Sep 18 03:32:42.275404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.275378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gxgln" event={"ID":"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f","Type":"ContainerStarted","Data":"fd3155c4cd43affeec4c91539bdd7e612424c28ebc34391a4a37bea1fcc4bf3a"} Sep 18 03:32:42.279167 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.279112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vlv2c" event={"ID":"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2","Type":"ContainerStarted","Data":"3f6e4bd4d35e1c80440bd19d37a982146bce71f614dbac8ec162bb00d6365177"} Sep 18 03:32:42.304287 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.304140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" event={"ID":"1a1da006789cadfe221cc035b2d280ed","Type":"ContainerStarted","Data":"85e1a529bec4ac8e3873afe02d9f500c35ad25605d7f5263a831cc2392f3049a"} Sep 18 03:32:42.313064 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.313035 2576 generic.go:356] "Generic (PLEG): container finished" podID="2fc57d3d67874efb51e88b2e375b19c9" containerID="326bcb00c56568b68afce54e05c8881c99429aa5e2ffe157649fe30f28a78df1" exitCode=0 Sep 18 03:32:42.313164 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.313111 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" event={"ID":"2fc57d3d67874efb51e88b2e375b19c9","Type":"ContainerDied","Data":"326bcb00c56568b68afce54e05c8881c99429aa5e2ffe157649fe30f28a78df1"} Sep 18 03:32:42.316315 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.316294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" event={"ID":"344f767f-39bc-43d0-b5c9-2a55edc6e277","Type":"ContainerStarted","Data":"b51ef94bd8f63b1c4845965b2788762ec5fae352c483c0bde5c9e66dbe902475"} Sep 18 03:32:42.319370 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.319016 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" podStartSLOduration=3.319000035 podStartE2EDuration="3.319000035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:42.318726443 +0000 UTC m=+4.587726405" watchObservedRunningTime="2026-09-18 03:32:42.319000035 +0000 UTC m=+4.587999997" Sep 18 03:32:42.337082 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.337008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wqrbx" event={"ID":"170150d8-1619-4f88-9282-cb53a22f3c06","Type":"ContainerStarted","Data":"174057ece9dce4eccde7cbc1eb43d51bf1c33004d39aa5023fe79ae5d82ff5df"} Sep 18 03:32:42.341926 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.341776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" event={"ID":"8a57cd0d-c42f-4cf0-9345-933695270bc1","Type":"ContainerStarted","Data":"6d81336bbd7ec4247865bf3ca0f19755b86f927bb01b181500ff4c213590fde3"} Sep 18 03:32:42.349634 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.349493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jmvlm" event={"ID":"932e0f59-1b36-417e-924b-89959f42d420","Type":"ContainerStarted","Data":"9b8f04fe290ad896cc51c57527d6900208c340ab602a9d364ad008e9f0c9cee8"} Sep 18 03:32:42.369278 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:42.369245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-942rk" event={"ID":"cde83bf5-532f-449c-801d-9886391e38d2","Type":"ContainerStarted","Data":"4bc06bff36b0f20a1bb1e187c306a024a8c96458d2b7b67bf3dfc979c6064423"} Sep 18 03:32:43.387726 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:43.387509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" event={"ID":"2fc57d3d67874efb51e88b2e375b19c9","Type":"ContainerStarted","Data":"69648e04820e133db4fa3cfe27016fa647d3d1c2901c7f990bd91ca0a080a40d"} Sep 18 03:32:43.404478 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:43.404405 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" podStartSLOduration=4.404385051 podStartE2EDuration="4.404385051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:43.404058158 +0000 UTC m=+5.673058125" watchObservedRunningTime="2026-09-18 03:32:43.404385051 +0000 UTC m=+5.673385013" Sep 18 03:32:43.801788 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:43.801667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:43.801947 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:43.801829 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:43.801947 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:43.801888 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:32:47.801870106 +0000 UTC m=+10.070870048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:43.902076 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:43.902039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:43.902269 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:43.902179 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:43.902269 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:43.902237 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:47.90221838 +0000 UTC m=+10.171218332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:44.003209 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:44.002582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:44.003209 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.002761 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:44.003209 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.002780 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:44.003209 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.002795 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:44.003209 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.002847 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:48.002830437 +0000 UTC m=+10.271830378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:44.254753 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:44.253876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:44.254753 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.254015 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:44.254753 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:44.254403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:44.254753 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.254500 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:44.254753 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:44.254559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:44.254753 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:44.254630 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:46.253706 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:46.253649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:46.254070 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:46.253764 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:46.254070 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:46.254063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:46.254158 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:46.254141 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:46.254189 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:46.254166 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:46.254428 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:46.254272 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:47.834994 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:47.834954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:47.835506 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:47.835480 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:47.835576 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:47.835569 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:32:55.835538417 +0000 UTC m=+18.104538372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:47.936348 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:47.935748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:47.936348 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:47.935894 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:47.936348 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:47.935954 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:55.935936406 +0000 UTC m=+18.204936361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:48.036548 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:48.036403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:48.036708 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.036612 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:48.036708 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.036635 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:48.036708 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.036646 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:48.036708 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.036699 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:32:56.036683871 +0000 UTC m=+18.305683823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:48.253414 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:48.252775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:48.253414 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.252908 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:48.253414 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:48.253285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:48.253414 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.253371 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:48.253955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:48.253824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:48.253955 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:48.253909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:50.251500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:50.251468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:50.251929 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:50.251606 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:50.251929 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:50.251726 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:50.251929 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:50.251809 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:50.251929 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:50.251843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:50.251929 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:50.251919 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:52.252401 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:52.252356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:52.252885 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:52.252357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:52.252885 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:52.252511 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:52.252885 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:52.252520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:52.252885 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:52.252588 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:52.252885 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:52.252645 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:54.252283 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:54.252245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:54.252803 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:54.252245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:54.252803 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:54.252255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:54.252803 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:54.252417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:54.252803 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:54.252558 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:54.252803 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:54.252646 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:55.896894 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:55.896846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:55.897384 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:55.897029 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:55.897384 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:55.897113 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:33:11.897092292 +0000 UTC m=+34.166092235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:32:55.997510 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:55.997474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:55.997677 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:55.997608 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:55.997753 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:55.997679 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:11.997659919 +0000 UTC m=+34.266659874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:32:56.098765 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:56.098728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:56.098961 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.098905 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:32:56.098961 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.098932 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:32:56.098961 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.098948 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:56.099115 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.099008 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:12.098994173 +0000 UTC m=+34.367994112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:32:56.252253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:56.252216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:56.252253 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:56.252237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:56.252507 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:56.252216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:56.252507 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.252346 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:56.252507 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.252441 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:56.252661 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:56.252558 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:58.252691 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:58.252662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:32:58.253120 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:58.252762 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:32:58.253120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:58.252848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:32:58.253120 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:58.252967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:32:58.253120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:58.253016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:32:58.253319 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:32:58.253129 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:32:59.419038 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.418783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"16606bad399a89c1ea984694d59dc31ddd7b0e8212781a50d551cbc7ccee33b0"} Sep 18 03:32:59.419749 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.419148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"e6d831aaf08caf2ac51b6dfab423c66da7b70b6683865804e816fba00af73ed9"} Sep 18 03:32:59.419749 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.419207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"6f81583947e25a4daeb10d9e7f92f684b563896a4cf24a5b5ee088fd71288e01"} Sep 18 03:32:59.419749 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.419258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"ccfbdc72d58da811ba2d27ca30237076e269c449be23e3987c81bb20fabd476a"} Sep 18 03:32:59.420439 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.420416 2576 generic.go:356] "Generic (PLEG): container finished" podID="aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5" containerID="0d450fb8ba55c2f7dffa00fbe1e2004be02bd6b6558511183ef8f09b78b5db20" exitCode=0 Sep 18 03:32:59.420529 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.420478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerDied","Data":"0d450fb8ba55c2f7dffa00fbe1e2004be02bd6b6558511183ef8f09b78b5db20"} Sep 18 03:32:59.421978 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.421955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gxgln" event={"ID":"43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f","Type":"ContainerStarted","Data":"ab905bdb7af305efcc049b5df5a2a9f7bd3312150e24ab57e1c4441a6258e55b"} Sep 18 03:32:59.423500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.423477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vlv2c" event={"ID":"c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2","Type":"ContainerStarted","Data":"b235a9fe3ef04eac4b856dd69490056e21745a84301838ae01f99041dbc22b04"} Sep 18 03:32:59.425471 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.425425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" event={"ID":"344f767f-39bc-43d0-b5c9-2a55edc6e277","Type":"ContainerStarted","Data":"79310930d1db59fd60f44e7c4138aa9a618c8ad8d2abad25e5b78ab61949fe22"} Sep 18 03:32:59.426950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.426930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wqrbx" event={"ID":"170150d8-1619-4f88-9282-cb53a22f3c06","Type":"ContainerStarted","Data":"66bbc372df7c02931f95d19e0724801d0f8ef121c819b2d943f0cc404e949722"} Sep 18 03:32:59.428377 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.428359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" event={"ID":"8a57cd0d-c42f-4cf0-9345-933695270bc1","Type":"ContainerStarted","Data":"23a6ab1d895d041a69f24ac4ac7e39506c01f2ba0d1880d91f5dd447320db193"} Sep 18 03:32:59.429960 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.429937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-942rk" event={"ID":"cde83bf5-532f-449c-801d-9886391e38d2","Type":"ContainerStarted","Data":"51c34b728802cbc744ebd392ced5bbd17f2c42ea95cc7199857038fa09e1daba"} Sep 18 03:32:59.466030 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.465918 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wqrbx" podStartSLOduration=3.803740374 podStartE2EDuration="21.465904857s" totalImagesPullingTime="17.662164483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:59.451728751 +0000 UTC m=+21.720728711" watchObservedRunningTime="2026-09-18 03:32:59.465904857 +0000 UTC m=+21.734904839" Sep 18 03:32:59.477870 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.477832 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mb2xz" podStartSLOduration=3.866784544 podStartE2EDuration="21.477819499s" totalImagesPullingTime="17.611034955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:59.465820381 +0000 UTC m=+21.734820342" watchObservedRunningTime="2026-09-18 03:32:59.477819499 +0000 UTC m=+21.746819505" Sep 18 03:32:59.478018 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.477993 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gxgln" podStartSLOduration=3.873924014 podStartE2EDuration="21.477981978s" totalImagesPullingTime="17.604057964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:59.477704381 +0000 UTC m=+21.746704364" watchObservedRunningTime="2026-09-18 03:32:59.477981978 +0000 UTC m=+21.746981940" Sep 18 03:32:59.526466 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.526422 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-942rk" podStartSLOduration=7.606546171 podStartE2EDuration="21.526409304s" totalImagesPullingTime="13.919863133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:59.526280316 +0000 UTC m=+21.795280277" watchObservedRunningTime="2026-09-18 03:32:59.526409304 +0000 UTC m=+21.795409262" Sep 18 03:32:59.526814 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:32:59.526793 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vlv2c" podStartSLOduration=3.918584884 podStartE2EDuration="21.526786255s" totalImagesPullingTime="17.608201371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:32:59.50278728 +0000 UTC m=+21.771787240" watchObservedRunningTime="2026-09-18 03:32:59.526786255 +0000 UTC m=+21.795786216" Sep 18 03:33:00.252207 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.252177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:00.252341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.252185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:00.252341 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:00.252307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:33:00.252341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.252319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:00.252495 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:00.252464 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:33:00.252561 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:00.252537 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:33:00.391124 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.391098 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 03:33:00.434205 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.434173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" event={"ID":"344f767f-39bc-43d0-b5c9-2a55edc6e277","Type":"ContainerStarted","Data":"e6448c8a85943ca26fee3131ed6dd0dabb4028e44a54933d9dbe083a9996fac2"} Sep 18 03:33:00.436138 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.436029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jmvlm" event={"ID":"932e0f59-1b36-417e-924b-89959f42d420","Type":"ContainerStarted","Data":"13aa4405493a8abc2a6818a39ce4940e182145600001bb5ce3e131f9a5101fd7"} Sep 18 03:33:00.439430 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.439399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"78db31782a598187aaa2d4181998459094f3fc8df16c2f0eb1a2515abb543e20"} Sep 18 03:33:00.439539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.439501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"637f68331f2ee26505a3e38a1f8442d615fa79d6f876b8efc374b5682fb099ca"} Sep 18 03:33:00.448632 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:00.448588 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jmvlm" podStartSLOduration=4.837958604 podStartE2EDuration="22.448575204s" totalImagesPullingTime="17.6106166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:00.448342556 +0000 UTC m=+22.717342536" watchObservedRunningTime="2026-09-18 03:33:00.448575204 +0000 UTC m=+22.717575164" Sep 18 03:33:01.215066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:01.214903 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T03:33:00.391118376Z","UUID":"fdf2be9b-dced-42c9-bc98-1663a560034a","Handler":null,"Name":"","Endpoint":""} Sep 18 03:33:01.218659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:01.218633 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 03:33:01.218804 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:01.218670 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 03:33:02.251768 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:02.251685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:02.251768 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:02.251725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:02.252267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:02.251690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:02.252267 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:02.251829 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:33:02.252267 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:02.251937 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:33:02.252267 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:02.252021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:33:02.446420 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:02.446378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" event={"ID":"344f767f-39bc-43d0-b5c9-2a55edc6e277","Type":"ContainerStarted","Data":"9492deae0178efe030c2a3f5777489f2e66813afe605118ebce41e7a11733aba"} Sep 18 03:33:02.450343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:02.450315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"a405804274c77e7fc9d50b5b6863ce1a720dab0d59263a05c4be4df090bc9078"} Sep 18 03:33:02.462189 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:02.462152 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2mgl" podStartSLOduration=4.260152769 podStartE2EDuration="24.462135465s" totalImagesPullingTime="20.201982696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:02.461306079 +0000 UTC m=+24.730306052" watchObservedRunningTime="2026-09-18 03:33:02.462135465 +0000 UTC m=+24.731135427" Sep 18 03:33:03.956464 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:03.956224 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-942rk" Sep 18 03:33:03.956920 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:03.956799 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-942rk" Sep 18 03:33:04.251346 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.251319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:04.251479 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.251386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:04.251479 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.251409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:04.251565 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:04.251521 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:33:04.251618 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:04.251569 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:33:04.251676 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:04.251658 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:33:04.459696 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.459657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" event={"ID":"a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a","Type":"ContainerStarted","Data":"cd416214ea868a6daf694dcf783ed21c9fa73d5ff2bf98a6a64e4e1210022e7e"} Sep 18 03:33:04.460374 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.460342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:33:04.460567 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.460478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:33:04.482565 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.482526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:33:04.482675 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.482635 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:33:04.487603 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:04.487563 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" podStartSLOduration=8.798303869 podStartE2EDuration="26.487549148s" totalImagesPullingTime="17.689245279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:04.485875971 +0000 UTC m=+26.754875932" watchObservedRunningTime="2026-09-18 03:33:04.487549148 +0000 UTC m=+26.756549109" Sep 18 03:33:05.468415 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:05.468369 2576 generic.go:356] "Generic (PLEG): container finished" podID="aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5" containerID="26b43cd7cac8bcc4d86a341824c7e4f5d154055ebc110aa6d3fcf0f8ea0e7278" exitCode=0 Sep 18 03:33:05.469318 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:05.468446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerDied","Data":"26b43cd7cac8bcc4d86a341824c7e4f5d154055ebc110aa6d3fcf0f8ea0e7278"} Sep 18 03:33:05.469318 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:05.468577 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 03:33:05.917242 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:05.917212 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:33:06.040874 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.040842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-942rk" Sep 18 03:33:06.041044 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.040991 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 03:33:06.041469 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.041435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-942rk" Sep 18 03:33:06.153019 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.152976 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vfqzn"] Sep 18 03:33:06.153210 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.153127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:06.153266 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:06.153231 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:33:06.156486 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.156443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qq6b2"] Sep 18 03:33:06.156634 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.156564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:06.156680 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:06.156662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:33:06.157264 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.157229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gf592"] Sep 18 03:33:06.157369 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:06.157328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:06.157437 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:06.157418 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:33:07.474992 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:07.474952 2576 generic.go:356] "Generic (PLEG): container finished" podID="aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5" containerID="527816956dbb79fca7b4b894cca7dd189d67108ce22af17d624b5b31ccbf6938" exitCode=0 Sep 18 03:33:07.475354 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:07.475026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerDied","Data":"527816956dbb79fca7b4b894cca7dd189d67108ce22af17d624b5b31ccbf6938"} Sep 18 03:33:08.252848 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:08.252823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:08.252937 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:08.252870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:08.252975 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:08.252953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:08.252975 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:08.252955 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:33:08.253049 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:08.253026 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:33:08.253130 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:08.253110 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:33:08.479815 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:08.479782 2576 generic.go:356] "Generic (PLEG): container finished" podID="aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5" containerID="10366ab60e789f773c4eda0b6931faff0e6efb73b0256461d2f0d58b2b5c0428" exitCode=0 Sep 18 03:33:08.480169 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:08.479832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerDied","Data":"10366ab60e789f773c4eda0b6931faff0e6efb73b0256461d2f0d58b2b5c0428"} Sep 18 03:33:10.255492 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:10.255275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:10.255917 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:10.255346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:10.255917 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:10.255584 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq6b2" podUID="2e74f686-21a1-4c85-9b16-8dbb40a51020" Sep 18 03:33:10.255917 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:10.255366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:10.255917 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:10.255672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:33:10.255917 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:10.255775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vfqzn" podUID="8a54338f-2334-40f2-b27a-d4acf2a0dd6f" Sep 18 03:33:11.913497 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:11.913401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:11.913971 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:11.913565 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:33:11.913971 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:11.913649 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret podName:8a54338f-2334-40f2-b27a-d4acf2a0dd6f nodeName:}" failed. No retries permitted until 2026-09-18 03:33:43.913624864 +0000 UTC m=+66.182624817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret") pod "global-pull-secret-syncer-vfqzn" (UID: "8a54338f-2334-40f2-b27a-d4acf2a0dd6f") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:33:12.014849 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.014777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:12.015045 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.014917 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:33:12.015045 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.014996 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:44.014975077 +0000 UTC m=+66.283975032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:33:12.070092 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.070059 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeReady" Sep 18 03:33:12.070252 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.070193 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 03:33:12.102468 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.102432 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64567f5b88-sphf6"] Sep 18 03:33:12.115949 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.115914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:12.116114 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.116089 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:33:12.116170 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.116118 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:33:12.116170 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.116128 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nrdns for pod openshift-network-diagnostics/network-check-target-qq6b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:33:12.116273 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.116181 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns podName:2e74f686-21a1-4c85-9b16-8dbb40a51020 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:44.116163374 +0000 UTC m=+66.385163313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrdns" (UniqueName: "kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns") pod "network-check-target-qq6b2" (UID: "2e74f686-21a1-4c85-9b16-8dbb40a51020") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:33:12.131732 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.131706 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64567f5b88-sphf6"] Sep 18 03:33:12.131891 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.131741 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq"] Sep 18 03:33:12.131891 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.131847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.135246 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.135143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 03:33:12.140277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.136255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 03:33:12.140277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.137298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 03:33:12.140277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.138211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jgsps\"" Sep 18 03:33:12.145755 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.145723 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27cqh"] Sep 18 03:33:12.145879 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.145768 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 03:33:12.145937 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.145890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.148042 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.148020 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 18 03:33:12.148226 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.148145 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 18 03:33:12.148226 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.148162 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bt2qr\"" Sep 18 03:33:12.167835 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.167767 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7477s"] Sep 18 03:33:12.167959 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.167843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.170086 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.170066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 03:33:12.170338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.170229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 03:33:12.171019 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.170992 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 03:33:12.171254 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.171238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gb67w\"" Sep 18 03:33:12.189796 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.189772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq"] Sep 18 03:33:12.189926 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.189810 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27cqh"] Sep 18 03:33:12.189926 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.189835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7477s"] Sep 18 03:33:12.190036 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.189945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.192240 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.192216 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 03:33:12.192338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.192294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 03:33:12.192338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.192295 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fvk6\"" Sep 18 03:33:12.217227 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-image-registry-private-configuration\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217342 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-registry-certificates\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217342 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gwgt\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-kube-api-access-8gwgt\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217342 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217534 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a78995-550c-4fdd-8796-229ad75066a4-ca-trust-extracted\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217534 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-bound-sa-token\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217534 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-installation-pull-secrets\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.217534 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.217524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-trusted-ca\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.255245 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.255221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:12.255245 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.255240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:12.255472 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.255221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:12.257700 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.257668 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 03:33:12.257854 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.257717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 03:33:12.257854 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.257750 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 03:33:12.257854 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.257674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 03:33:12.257854 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.257822 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtr95\"" Sep 18 03:33:12.257854 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.257717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6p5fh\"" Sep 18 03:33:12.318316 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.318495 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.318495 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.318495 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.318495 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.318467 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:12.318495 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.318482 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a78995-550c-4fdd-8796-229ad75066a4-ca-trust-extracted\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-bound-sa-token\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.318580 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:12.818558138 +0000 UTC m=+35.087558084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/285cbb37-da1c-4993-869b-1d2d60f3ecdd-tmp-dir\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-installation-pull-secrets\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-trusted-ca\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73f9f56d-7fc8-4f2f-8d68-5843400066a9-cert\") pod \"ingress-canary-27cqh\" (UID: \"73f9f56d-7fc8-4f2f-8d68-5843400066a9\") " pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gcdq\" (UniqueName: \"kubernetes.io/projected/73f9f56d-7fc8-4f2f-8d68-5843400066a9-kube-api-access-5gcdq\") pod \"ingress-canary-27cqh\" (UID: \"73f9f56d-7fc8-4f2f-8d68-5843400066a9\") " pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.318752 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/285cbb37-da1c-4993-869b-1d2d60f3ecdd-config-volume\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.319173 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbbm4\" (UniqueName: \"kubernetes.io/projected/285cbb37-da1c-4993-869b-1d2d60f3ecdd-kube-api-access-gbbm4\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.319173 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-image-registry-private-configuration\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.319173 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-registry-certificates\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.319173 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gwgt\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-kube-api-access-8gwgt\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.319173 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.318947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a78995-550c-4fdd-8796-229ad75066a4-ca-trust-extracted\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.319534 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.319508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-registry-certificates\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.320086 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.320022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-trusted-ca\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.323185 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.323166 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-image-registry-private-configuration\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.323292 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.323193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-installation-pull-secrets\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.326655 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.326635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-bound-sa-token\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.326931 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.326905 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gwgt\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-kube-api-access-8gwgt\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.419497 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73f9f56d-7fc8-4f2f-8d68-5843400066a9-cert\") pod \"ingress-canary-27cqh\" (UID: \"73f9f56d-7fc8-4f2f-8d68-5843400066a9\") " pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.419497 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gcdq\" (UniqueName: \"kubernetes.io/projected/73f9f56d-7fc8-4f2f-8d68-5843400066a9-kube-api-access-5gcdq\") pod \"ingress-canary-27cqh\" (UID: \"73f9f56d-7fc8-4f2f-8d68-5843400066a9\") " pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.419497 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/285cbb37-da1c-4993-869b-1d2d60f3ecdd-config-volume\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbbm4\" (UniqueName: \"kubernetes.io/projected/285cbb37-da1c-4993-869b-1d2d60f3ecdd-kube-api-access-gbbm4\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.419694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/285cbb37-da1c-4993-869b-1d2d60f3ecdd-tmp-dir\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.419748 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:12.419824 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.419812 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:12.91979341 +0000 UTC m=+35.188793363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:12.420164 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.419874 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:12.420164 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.419937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:12.919919479 +0000 UTC m=+35.188919421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:12.420164 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.420012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/285cbb37-da1c-4993-869b-1d2d60f3ecdd-tmp-dir\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.420164 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.420154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/285cbb37-da1c-4993-869b-1d2d60f3ecdd-config-volume\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.420510 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.420488 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.422148 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.422121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73f9f56d-7fc8-4f2f-8d68-5843400066a9-cert\") pod \"ingress-canary-27cqh\" (UID: \"73f9f56d-7fc8-4f2f-8d68-5843400066a9\") " pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.427724 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.427698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gcdq\" (UniqueName: \"kubernetes.io/projected/73f9f56d-7fc8-4f2f-8d68-5843400066a9-kube-api-access-5gcdq\") pod \"ingress-canary-27cqh\" (UID: \"73f9f56d-7fc8-4f2f-8d68-5843400066a9\") " pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.427933 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.427916 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbbm4\" (UniqueName: \"kubernetes.io/projected/285cbb37-da1c-4993-869b-1d2d60f3ecdd-kube-api-access-gbbm4\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.478340 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.478311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27cqh" Sep 18 03:33:12.822715 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.822666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:12.822884 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.822839 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:12.822884 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.822859 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:12.823005 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.822918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:13.822902235 +0000 UTC m=+36.091902197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:12.923223 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.923186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:12.923223 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:12.923225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:12.923878 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.923355 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:12.923878 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.923427 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:13.923412645 +0000 UTC m=+36.192412602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:12.923878 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.923360 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:12.923878 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:12.923513 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:13.92349913 +0000 UTC m=+36.192499069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:13.546440 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:13.546349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27cqh"] Sep 18 03:33:13.550435 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:33:13.550405 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f9f56d_7fc8_4f2f_8d68_5843400066a9.slice/crio-e2af3c1ef4fe8813fa44ccbe57cd3b823b08343b5c19f60c26337097d69ed7e4 WatchSource:0}: Error finding container e2af3c1ef4fe8813fa44ccbe57cd3b823b08343b5c19f60c26337097d69ed7e4: Status 404 returned error can't find the container with id e2af3c1ef4fe8813fa44ccbe57cd3b823b08343b5c19f60c26337097d69ed7e4 Sep 18 03:33:13.831159 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:13.830967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:13.831254 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.831130 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:13.831254 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.831241 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:13.831332 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.831310 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:15.831291055 +0000 UTC m=+38.100290996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:13.931977 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:13.931941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:13.931977 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:13.931976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:13.932596 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.932116 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:13.932596 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.932197 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:15.932180555 +0000 UTC m=+38.201180511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:13.932596 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.932123 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:13.932596 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:13.932254 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:15.932242404 +0000 UTC m=+38.201242343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:14.495759 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:14.495683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27cqh" event={"ID":"73f9f56d-7fc8-4f2f-8d68-5843400066a9","Type":"ContainerStarted","Data":"e2af3c1ef4fe8813fa44ccbe57cd3b823b08343b5c19f60c26337097d69ed7e4"} Sep 18 03:33:14.499017 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:14.498985 2576 generic.go:356] "Generic (PLEG): container finished" podID="aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5" containerID="d323074d06c78712b30bc3498f679aa1df4f47e4207df484781a16fd458f1833" exitCode=0 Sep 18 03:33:14.499124 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:14.499023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerDied","Data":"d323074d06c78712b30bc3498f679aa1df4f47e4207df484781a16fd458f1833"} Sep 18 03:33:15.505575 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:15.505540 2576 generic.go:356] "Generic (PLEG): container finished" podID="aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5" containerID="0370b0430b3106832986342091e8b745d8152783e37362a70a3978be296d3477" exitCode=0 Sep 18 03:33:15.506040 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:15.505612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerDied","Data":"0370b0430b3106832986342091e8b745d8152783e37362a70a3978be296d3477"} Sep 18 03:33:15.848230 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:15.848145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:15.848395 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.848329 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:15.848395 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.848351 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:15.848501 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.848417 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:19.848397673 +0000 UTC m=+42.117397618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:15.948855 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:15.948810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:15.948855 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:15.948858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:15.949084 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.948965 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:15.949084 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.948974 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:15.949084 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.949024 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:19.949010624 +0000 UTC m=+42.218010562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:15.949084 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:15.949043 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:19.949034574 +0000 UTC m=+42.218034513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:16.512020 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:16.511991 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" event={"ID":"aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5","Type":"ContainerStarted","Data":"3efa097cc4a8c0b9ce6e06dd98d24187a2de0fcf2f3703af189719ad6934c7dc"} Sep 18 03:33:16.530776 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:16.530736 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6zdtq" podStartSLOduration=12.784426888 podStartE2EDuration="38.53071953s" totalImagesPullingTime="25.746292642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:16.529583863 +0000 UTC m=+38.798583825" watchObservedRunningTime="2026-09-18 03:33:16.53071953 +0000 UTC m=+38.799719493" Sep 18 03:33:16.677305 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:16.677258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:16.755267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:16.755172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:17.125462 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:17.125383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:17.178708 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:17.178672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:17.516088 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:17.516059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27cqh" event={"ID":"73f9f56d-7fc8-4f2f-8d68-5843400066a9","Type":"ContainerStarted","Data":"36e8d0822e385a6026b49b72edf198bcc70db50c49e53d05a3165f29e2df0411"} Sep 18 03:33:17.530481 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:17.530421 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27cqh" podStartSLOduration=2.619063674 podStartE2EDuration="5.530404981s" totalImagesPullingTime="2.911341307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:17.529734386 +0000 UTC m=+39.798734348" watchObservedRunningTime="2026-09-18 03:33:17.530404981 +0000 UTC m=+39.799404942" Sep 18 03:33:17.873423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:17.873339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:17.973645 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:17.973612 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:18.075017 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:18.074983 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:19.422009 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:19.421975 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:19.877027 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:19.876987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:19.877175 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.877138 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:19.877175 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.877157 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:19.877276 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.877216 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:27.877199673 +0000 UTC m=+50.146199612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:19.977683 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:19.977652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:19.977683 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:19.977685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:19.977871 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.977810 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:19.977905 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.977871 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:27.977857796 +0000 UTC m=+50.246857740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:19.977943 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.977810 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:19.977943 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:19.977938 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:27.977927513 +0000 UTC m=+50.246927452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:26.701651 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:26.701614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:26.756482 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:26.756434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:27.937530 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:27.937490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:27.937913 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:27.937633 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:27.937913 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:27.937650 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:27.937913 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:27.937703 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:33:43.937686163 +0000 UTC m=+66.206686107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:28.038705 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:28.038668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:28.038705 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:28.038707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:28.038887 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:28.038798 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:28.038887 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:28.038799 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:28.038887 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:28.038845 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:33:44.03883309 +0000 UTC m=+66.307833029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:28.038887 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:28.038858 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:33:44.038852591 +0000 UTC m=+66.307852529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:29.181525 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:29.181483 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:29.237061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:29.237013 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:29.337466 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:29.337419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:30.046252 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.046219 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:30.247847 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.247813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:30.299482 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.299381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:30.447911 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.447876 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz"] Sep 18 03:33:30.450596 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.450577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.452904 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.452886 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 03:33:30.453026 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.452893 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 03:33:30.453026 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.452988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 03:33:30.453790 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.453771 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wgg6g\"" Sep 18 03:33:30.453908 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.453893 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 18 03:33:30.455485 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.455447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/757aeccd-aede-4758-b11b-46b0d8d37119-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9499b566-nl9tz\" (UID: \"757aeccd-aede-4758-b11b-46b0d8d37119\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.455575 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.455557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc4zt\" (UniqueName: \"kubernetes.io/projected/757aeccd-aede-4758-b11b-46b0d8d37119-kube-api-access-tc4zt\") pod \"managed-serviceaccount-addon-agent-7f9499b566-nl9tz\" (UID: \"757aeccd-aede-4758-b11b-46b0d8d37119\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.458757 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.458413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz"] Sep 18 03:33:30.556664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.556604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/757aeccd-aede-4758-b11b-46b0d8d37119-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9499b566-nl9tz\" (UID: \"757aeccd-aede-4758-b11b-46b0d8d37119\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.556664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.556645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc4zt\" (UniqueName: \"kubernetes.io/projected/757aeccd-aede-4758-b11b-46b0d8d37119-kube-api-access-tc4zt\") pod \"managed-serviceaccount-addon-agent-7f9499b566-nl9tz\" (UID: \"757aeccd-aede-4758-b11b-46b0d8d37119\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.560122 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.560100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/757aeccd-aede-4758-b11b-46b0d8d37119-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9499b566-nl9tz\" (UID: \"757aeccd-aede-4758-b11b-46b0d8d37119\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.564235 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.564208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc4zt\" (UniqueName: \"kubernetes.io/projected/757aeccd-aede-4758-b11b-46b0d8d37119-kube-api-access-tc4zt\") pod \"managed-serviceaccount-addon-agent-7f9499b566-nl9tz\" (UID: \"757aeccd-aede-4758-b11b-46b0d8d37119\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:30.770989 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:30.770956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:33:31.034950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:31.034913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz"] Sep 18 03:33:31.037831 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:33:31.037805 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod757aeccd_aede_4758_b11b_46b0d8d37119.slice/crio-8fb3a800d396155398f52f7c5107dc17558163947dd2d1637339b4b5ada69983 WatchSource:0}: Error finding container 8fb3a800d396155398f52f7c5107dc17558163947dd2d1637339b4b5ada69983: Status 404 returned error can't find the container with id 8fb3a800d396155398f52f7c5107dc17558163947dd2d1637339b4b5ada69983 Sep 18 03:33:31.190185 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:31.190100 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:31.549892 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:31.549857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" event={"ID":"757aeccd-aede-4758-b11b-46b0d8d37119","Type":"ContainerStarted","Data":"8fb3a800d396155398f52f7c5107dc17558163947dd2d1637339b4b5ada69983"} Sep 18 03:33:33.556550 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:33.556505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" event={"ID":"757aeccd-aede-4758-b11b-46b0d8d37119","Type":"ContainerStarted","Data":"9300da244d36df3504df878110d6f61fb3caac158a8c86135ee0dd9978e23230"} Sep 18 03:33:33.569753 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:33.569682 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" podStartSLOduration=1.167781962 podStartE2EDuration="3.569662962s" totalImagesPullingTime="2.401881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:33.569024895 +0000 UTC m=+55.838024857" watchObservedRunningTime="2026-09-18 03:33:33.569662962 +0000 UTC m=+55.838662922" Sep 18 03:33:37.486149 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:37.486121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfvbj" Sep 18 03:33:37.632927 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:37.632886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:37.685120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:37.685090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:38.861313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:38.861282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:38.911163 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:38.911130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:41.308409 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:41.308372 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:41.410086 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:41.410048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:43.953316 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:43.953265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:33:43.953742 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:43.953337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:43.953742 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:43.953467 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:33:43.953742 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:43.953489 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:33:43.953742 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:43.953551 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:34:15.953536035 +0000 UTC m=+98.222535990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:33:43.955884 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:43.955864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 03:33:43.965887 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:43.965864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a54338f-2334-40f2-b27a-d4acf2a0dd6f-original-pull-secret\") pod \"global-pull-secret-syncer-vfqzn\" (UID: \"8a54338f-2334-40f2-b27a-d4acf2a0dd6f\") " pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:44.054037 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.054002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:33:44.054037 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.054040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:33:44.054224 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.054078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:33:44.054224 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:44.054160 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:33:44.054224 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:44.054166 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:33:44.054224 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:44.054225 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:34:16.054210143 +0000 UTC m=+98.323210087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:33:44.054361 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:44.054242 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:34:16.054232877 +0000 UTC m=+98.323232820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:33:44.056794 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.056778 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 03:33:44.064575 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:44.064555 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:33:44.064686 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:33:44.064600 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:34:48.064587431 +0000 UTC m=+130.333587370 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : secret "metrics-daemon-secret" not found Sep 18 03:33:44.073338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.073316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfqzn" Sep 18 03:33:44.154542 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.154512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:44.156713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.156695 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 03:33:44.167096 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.167080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 03:33:44.178255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.178231 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdns\" (UniqueName: \"kubernetes.io/projected/2e74f686-21a1-4c85-9b16-8dbb40a51020-kube-api-access-nrdns\") pod \"network-check-target-qq6b2\" (UID: \"2e74f686-21a1-4c85-9b16-8dbb40a51020\") " pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:44.341334 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.341306 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vfqzn"] Sep 18 03:33:44.344386 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:33:44.344358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a54338f_2334_40f2_b27a_d4acf2a0dd6f.slice/crio-a423887f70333cfd347aeb5a01bbec10762059debf6ea0a189950ab05e1dea1a WatchSource:0}: Error finding container a423887f70333cfd347aeb5a01bbec10762059debf6ea0a189950ab05e1dea1a: Status 404 returned error can't find the container with id a423887f70333cfd347aeb5a01bbec10762059debf6ea0a189950ab05e1dea1a Sep 18 03:33:44.369011 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.368988 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtr95\"" Sep 18 03:33:44.377508 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.377489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:44.583934 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.583900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vfqzn" event={"ID":"8a54338f-2334-40f2-b27a-d4acf2a0dd6f","Type":"ContainerStarted","Data":"a423887f70333cfd347aeb5a01bbec10762059debf6ea0a189950ab05e1dea1a"} Sep 18 03:33:44.642923 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:44.642852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qq6b2"] Sep 18 03:33:44.648309 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:33:44.648269 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e74f686_21a1_4c85_9b16_8dbb40a51020.slice/crio-dee5ab2b96b743ece75799987a4ff222a5c3d2c7584aacd24c27f9b09c428b5b WatchSource:0}: Error finding container dee5ab2b96b743ece75799987a4ff222a5c3d2c7584aacd24c27f9b09c428b5b: Status 404 returned error can't find the container with id dee5ab2b96b743ece75799987a4ff222a5c3d2c7584aacd24c27f9b09c428b5b Sep 18 03:33:45.171042 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:45.171007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:45.228958 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:45.228923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:45.588474 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:45.588409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qq6b2" event={"ID":"2e74f686-21a1-4c85-9b16-8dbb40a51020","Type":"ContainerStarted","Data":"dee5ab2b96b743ece75799987a4ff222a5c3d2c7584aacd24c27f9b09c428b5b"} Sep 18 03:33:47.348670 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:47.348627 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:47.402363 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:47.402325 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:33:49.600344 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:49.600256 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vfqzn" event={"ID":"8a54338f-2334-40f2-b27a-d4acf2a0dd6f","Type":"ContainerStarted","Data":"03b93afe9ae5ad4c0bd0dfad16b06e7d918bd87340954acf6fd55c3ca2836e5c"} Sep 18 03:33:49.601782 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:49.601758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qq6b2" event={"ID":"2e74f686-21a1-4c85-9b16-8dbb40a51020","Type":"ContainerStarted","Data":"df86261f2a6d1377cb165ae2ec21b96a03ebfe75f7dbf36dd657aac465bbc990"} Sep 18 03:33:49.601882 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:49.601808 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:33:49.613782 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:49.613744 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vfqzn" podStartSLOduration=66.614171026 podStartE2EDuration="1m11.613730417s" totalImagesPullingTime="4.999559391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:49.613031654 +0000 UTC m=+71.882031615" watchObservedRunningTime="2026-09-18 03:33:49.613730417 +0000 UTC m=+71.882730435" Sep 18 03:33:49.625984 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:33:49.625885 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qq6b2" podStartSLOduration=66.935789945 podStartE2EDuration="1m11.625873584s" totalImagesPullingTime="4.690083639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:33:49.625664254 +0000 UTC m=+71.894664215" watchObservedRunningTime="2026-09-18 03:33:49.625873584 +0000 UTC m=+71.894873547" Sep 18 03:34:08.288377 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:08.288218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:34:08.370704 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:08.370659 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:34:15.977988 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:15.977955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:34:15.978339 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:15.978116 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:34:15.978339 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:15.978138 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:34:15.978339 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:15.978205 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:35:19.978186727 +0000 UTC m=+162.247186686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:34:16.078595 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:16.078545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:34:16.078595 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:16.078595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:34:16.078814 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:16.078689 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:34:16.078814 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:16.078691 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:34:16.078814 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:16.078747 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:35:20.078733711 +0000 UTC m=+162.347733651 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:34:16.078814 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:16.078761 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:35:20.078755066 +0000 UTC m=+162.347755005 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:34:20.607278 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:20.607249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qq6b2" Sep 18 03:34:48.110401 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:34:48.110349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:34:48.110837 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:48.110486 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:34:48.110837 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:34:48.110539 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:50.110525608 +0000 UTC m=+252.379525548 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : secret "metrics-daemon-secret" not found Sep 18 03:35:15.146249 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:15.146189 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" podUID="41a78995-550c-4fdd-8796-229ad75066a4" Sep 18 03:35:15.154831 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:15.154808 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" podUID="a3394a4d-dee1-4ad6-ab45-a03ac404ef2e" Sep 18 03:35:15.199569 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:15.199537 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7477s" podUID="285cbb37-da1c-4993-869b-1d2d60f3ecdd" Sep 18 03:35:15.279150 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:15.279117 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:35:15.807620 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:15.807586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:35:20.040222 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:20.040170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:35:20.040675 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.040338 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:35:20.040675 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.040357 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64567f5b88-sphf6: secret "image-registry-tls" not found Sep 18 03:35:20.040675 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.040415 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls podName:41a78995-550c-4fdd-8796-229ad75066a4 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:22.040398958 +0000 UTC m=+284.309398897 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls") pod "image-registry-64567f5b88-sphf6" (UID: "41a78995-550c-4fdd-8796-229ad75066a4") : secret "image-registry-tls" not found Sep 18 03:35:20.140564 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:20.140532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:35:20.140564 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:20.140565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:35:20.140725 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.140683 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 03:35:20.140760 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.140737 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:35:20.140792 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.140758 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert podName:a3394a4d-dee1-4ad6-ab45-a03ac404ef2e nodeName:}" failed. No retries permitted until 2026-09-18 03:37:22.140742014 +0000 UTC m=+284.409741958 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-kq4lq" (UID: "a3394a4d-dee1-4ad6-ab45-a03ac404ef2e") : secret "networking-console-plugin-cert" not found Sep 18 03:35:20.140836 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:35:20.140798 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls podName:285cbb37-da1c-4993-869b-1d2d60f3ecdd nodeName:}" failed. No retries permitted until 2026-09-18 03:37:22.140778166 +0000 UTC m=+284.409778117 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls") pod "dns-default-7477s" (UID: "285cbb37-da1c-4993-869b-1d2d60f3ecdd") : secret "dns-default-metrics-tls" not found Sep 18 03:35:26.251558 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:26.251521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7477s" Sep 18 03:35:29.251367 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:29.251327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:35:30.252293 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:30.252260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:35:33.852968 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:33.852881 2576 generic.go:356] "Generic (PLEG): container finished" podID="757aeccd-aede-4758-b11b-46b0d8d37119" containerID="9300da244d36df3504df878110d6f61fb3caac158a8c86135ee0dd9978e23230" exitCode=255 Sep 18 03:35:33.852968 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:33.852936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" event={"ID":"757aeccd-aede-4758-b11b-46b0d8d37119","Type":"ContainerDied","Data":"9300da244d36df3504df878110d6f61fb3caac158a8c86135ee0dd9978e23230"} Sep 18 03:35:33.858398 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:33.858377 2576 scope.go:117] "RemoveContainer" containerID="9300da244d36df3504df878110d6f61fb3caac158a8c86135ee0dd9978e23230" Sep 18 03:35:34.856971 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:35:34.856932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" event={"ID":"757aeccd-aede-4758-b11b-46b0d8d37119","Type":"ContainerStarted","Data":"ee0426b7211115dce09710568e1893badb869b580a7e86b8daee1da9e05cb743"} Sep 18 03:36:43.655052 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.655016 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v"] Sep 18 03:36:43.657923 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.657897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.658417 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.658359 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-4cqm4"] Sep 18 03:36:43.660023 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.659999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 03:36:43.660560 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.660544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 03:36:43.660953 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.660933 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:36:43.661041 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.660973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 03:36:43.661232 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.661217 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v"] Sep 18 03:36:43.661297 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.661249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ktkh5\"" Sep 18 03:36:43.661359 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.661331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.663657 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.663637 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kjhtx\"" Sep 18 03:36:43.663737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.663714 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 03:36:43.663737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.663722 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 03:36:43.663826 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.663776 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 03:36:43.664014 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.663996 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:36:43.664078 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.664051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.666111 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.666097 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 18 03:36:43.666527 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.666507 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 18 03:36:43.666628 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.666535 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 18 03:36:43.666628 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.666534 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hmbxl\"" Sep 18 03:36:43.666628 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.666582 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:36:43.668769 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.668750 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v"] Sep 18 03:36:43.669922 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.669902 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 03:36:43.673313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.673278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v"] Sep 18 03:36:43.674117 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.674098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-4cqm4"] Sep 18 03:36:43.739238 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.739203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:43.829890 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.829855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:43.831784 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.831765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkm5\" (UniqueName: \"kubernetes.io/projected/d5e96173-c0f3-4b43-8edd-290864ffdf5e-kube-api-access-fkkm5\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.831864 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.831805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a702adf-6b34-4c62-8fdd-1aa639d6701a-serving-cert\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.831864 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.831824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be3dd34e-ddd3-4095-8495-428af0afe2e5-serving-cert\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.831981 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.831943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a702adf-6b34-4c62-8fdd-1aa639d6701a-config\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.832035 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.831974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be3dd34e-ddd3-4095-8495-428af0afe2e5-trusted-ca\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.832088 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.832027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5e96173-c0f3-4b43-8edd-290864ffdf5e-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.832144 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.832089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgvn\" (UniqueName: \"kubernetes.io/projected/4a702adf-6b34-4c62-8fdd-1aa639d6701a-kube-api-access-ktgvn\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.832201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.832154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9gm\" (UniqueName: \"kubernetes.io/projected/be3dd34e-ddd3-4095-8495-428af0afe2e5-kube-api-access-hk9gm\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.832201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.832187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be3dd34e-ddd3-4095-8495-428af0afe2e5-config\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.832287 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.832212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5e96173-c0f3-4b43-8edd-290864ffdf5e-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.933203 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a702adf-6b34-4c62-8fdd-1aa639d6701a-config\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.933203 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be3dd34e-ddd3-4095-8495-428af0afe2e5-trusted-ca\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.933203 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5e96173-c0f3-4b43-8edd-290864ffdf5e-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.933426 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgvn\" (UniqueName: \"kubernetes.io/projected/4a702adf-6b34-4c62-8fdd-1aa639d6701a-kube-api-access-ktgvn\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.933535 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9gm\" (UniqueName: \"kubernetes.io/projected/be3dd34e-ddd3-4095-8495-428af0afe2e5-kube-api-access-hk9gm\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.933535 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be3dd34e-ddd3-4095-8495-428af0afe2e5-config\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.933535 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5e96173-c0f3-4b43-8edd-290864ffdf5e-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.933692 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkm5\" (UniqueName: \"kubernetes.io/projected/d5e96173-c0f3-4b43-8edd-290864ffdf5e-kube-api-access-fkkm5\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.933692 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a702adf-6b34-4c62-8fdd-1aa639d6701a-serving-cert\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.933692 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be3dd34e-ddd3-4095-8495-428af0afe2e5-serving-cert\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.933870 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.933820 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4a702adf-6b34-4c62-8fdd-1aa639d6701a-config\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.934116 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.934086 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be3dd34e-ddd3-4095-8495-428af0afe2e5-trusted-ca\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.934242 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.934199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be3dd34e-ddd3-4095-8495-428af0afe2e5-config\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.934242 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.934230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5e96173-c0f3-4b43-8edd-290864ffdf5e-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.935861 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.935827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be3dd34e-ddd3-4095-8495-428af0afe2e5-serving-cert\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.936064 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.936028 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5e96173-c0f3-4b43-8edd-290864ffdf5e-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.936109 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.936051 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a702adf-6b34-4c62-8fdd-1aa639d6701a-serving-cert\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.942199 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.942169 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkm5\" (UniqueName: \"kubernetes.io/projected/d5e96173-c0f3-4b43-8edd-290864ffdf5e-kube-api-access-fkkm5\") pod \"kube-storage-version-migrator-operator-55889f7b47-q8j7v\" (UID: \"d5e96173-c0f3-4b43-8edd-290864ffdf5e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:43.942351 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.942331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9gm\" (UniqueName: \"kubernetes.io/projected/be3dd34e-ddd3-4095-8495-428af0afe2e5-kube-api-access-hk9gm\") pod \"console-operator-fd4bb46c-4cqm4\" (UID: \"be3dd34e-ddd3-4095-8495-428af0afe2e5\") " pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.942396 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.942382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgvn\" (UniqueName: \"kubernetes.io/projected/4a702adf-6b34-4c62-8fdd-1aa639d6701a-kube-api-access-ktgvn\") pod \"service-ca-operator-57cdc4b768-wpc5v\" (UID: \"4a702adf-6b34-4c62-8fdd-1aa639d6701a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.968207 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.968173 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" Sep 18 03:36:43.975586 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.975565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:43.981382 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:43.981361 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" Sep 18 03:36:44.244300 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:44.244263 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v"] Sep 18 03:36:44.247085 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:36:44.247053 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a702adf_6b34_4c62_8fdd_1aa639d6701a.slice/crio-8760a666ab41eaddca4e9d09dc7c945e5858870fe6af366ea83e6e6041a8ea39 WatchSource:0}: Error finding container 8760a666ab41eaddca4e9d09dc7c945e5858870fe6af366ea83e6e6041a8ea39: Status 404 returned error can't find the container with id 8760a666ab41eaddca4e9d09dc7c945e5858870fe6af366ea83e6e6041a8ea39 Sep 18 03:36:44.247261 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:44.247246 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-4cqm4"] Sep 18 03:36:44.250219 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:36:44.250199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3dd34e_ddd3_4095_8495_428af0afe2e5.slice/crio-9c3f7caa641ea7a9806a4cef215b6584f164fa525a9e4f799525d07eeea1d192 WatchSource:0}: Error finding container 9c3f7caa641ea7a9806a4cef215b6584f164fa525a9e4f799525d07eeea1d192: Status 404 returned error can't find the container with id 9c3f7caa641ea7a9806a4cef215b6584f164fa525a9e4f799525d07eeea1d192 Sep 18 03:36:44.268248 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:44.268224 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v"] Sep 18 03:36:44.270929 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:36:44.270903 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e96173_c0f3_4b43_8edd_290864ffdf5e.slice/crio-616a25e3d9b891dfba45afef783581b3fcf416112614565bfa89079a18482be2 WatchSource:0}: Error finding container 616a25e3d9b891dfba45afef783581b3fcf416112614565bfa89079a18482be2: Status 404 returned error can't find the container with id 616a25e3d9b891dfba45afef783581b3fcf416112614565bfa89079a18482be2 Sep 18 03:36:45.031693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:45.031601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" event={"ID":"4a702adf-6b34-4c62-8fdd-1aa639d6701a","Type":"ContainerStarted","Data":"8760a666ab41eaddca4e9d09dc7c945e5858870fe6af366ea83e6e6041a8ea39"} Sep 18 03:36:45.033439 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:45.033358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" event={"ID":"d5e96173-c0f3-4b43-8edd-290864ffdf5e","Type":"ContainerStarted","Data":"616a25e3d9b891dfba45afef783581b3fcf416112614565bfa89079a18482be2"} Sep 18 03:36:45.034662 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:45.034639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" event={"ID":"be3dd34e-ddd3-4095-8495-428af0afe2e5","Type":"ContainerStarted","Data":"9c3f7caa641ea7a9806a4cef215b6584f164fa525a9e4f799525d07eeea1d192"} Sep 18 03:36:45.722049 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:45.721999 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:45.775063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:45.774995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:47.293806 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.293783 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-br9qd"] Sep 18 03:36:47.296531 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.296514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.299410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.299391 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 03:36:47.299528 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.299392 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 03:36:47.299528 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.299474 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 03:36:47.300321 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.300306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 03:36:47.300406 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.300342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tg5sj\"" Sep 18 03:36:47.312525 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.312500 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-br9qd"] Sep 18 03:36:47.321966 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.321942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:47.360874 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.360827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.360999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.360914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d7bd3d3-057d-4495-ba85-60029e010375-data-volume\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.360999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.360963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjdm\" (UniqueName: \"kubernetes.io/projected/1d7bd3d3-057d-4495-ba85-60029e010375-kube-api-access-xjjdm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.360999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.360990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d7bd3d3-057d-4495-ba85-60029e010375-crio-socket\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.361168 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.361074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.386401 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.386329 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:47.461972 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.461937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.462078 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.461995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.462078 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.462045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d7bd3d3-057d-4495-ba85-60029e010375-data-volume\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.462188 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.462089 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:47.462188 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.462126 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:47.462188 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.462146 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:47.962131024 +0000 UTC m=+250.231130963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:47.462340 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.462191 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:47.962172891 +0000 UTC m=+250.231172858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : configmap "kube-rbac-proxy" not found Sep 18 03:36:47.462340 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.462094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjdm\" (UniqueName: \"kubernetes.io/projected/1d7bd3d3-057d-4495-ba85-60029e010375-kube-api-access-xjjdm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.462340 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.462231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d7bd3d3-057d-4495-ba85-60029e010375-crio-socket\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.462340 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.462330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d7bd3d3-057d-4495-ba85-60029e010375-crio-socket\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.462537 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.462515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d7bd3d3-057d-4495-ba85-60029e010375-data-volume\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.470269 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.470248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjdm\" (UniqueName: \"kubernetes.io/projected/1d7bd3d3-057d-4495-ba85-60029e010375-kube-api-access-xjjdm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.966523 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.966491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.966737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:47.966533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:47.966737 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.966635 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:47.966737 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.966666 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:47.966737 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.966697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:48.966683439 +0000 UTC m=+251.235683382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:47.966737 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:47.966710 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:48.966704586 +0000 UTC m=+251.235704524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : configmap "kube-rbac-proxy" not found Sep 18 03:36:48.046627 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.046587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" event={"ID":"d5e96173-c0f3-4b43-8edd-290864ffdf5e","Type":"ContainerStarted","Data":"8eb7923390248dfb2b77d17a595b4f1625816e086bd44663ea2c63cff4e39d1a"} Sep 18 03:36:48.048255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.048235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/0.log" Sep 18 03:36:48.048402 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.048267 2576 generic.go:356] "Generic (PLEG): container finished" podID="be3dd34e-ddd3-4095-8495-428af0afe2e5" containerID="c5158d737f0dd9150b545eebdaad47930d1598d8e5fb1a95dd2634af0c7dac4f" exitCode=255 Sep 18 03:36:48.048402 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.048305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" event={"ID":"be3dd34e-ddd3-4095-8495-428af0afe2e5","Type":"ContainerDied","Data":"c5158d737f0dd9150b545eebdaad47930d1598d8e5fb1a95dd2634af0c7dac4f"} Sep 18 03:36:48.048575 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.048554 2576 scope.go:117] "RemoveContainer" containerID="c5158d737f0dd9150b545eebdaad47930d1598d8e5fb1a95dd2634af0c7dac4f" Sep 18 03:36:48.049900 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.049880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" event={"ID":"4a702adf-6b34-4c62-8fdd-1aa639d6701a","Type":"ContainerStarted","Data":"c3328ea4aad803fb2ba538cfe1afa28519cf784776a4b1396cbbe785dd71f62e"} Sep 18 03:36:48.060797 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.060757 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" podStartSLOduration=2.015064822 podStartE2EDuration="5.060744824s" totalImagesPullingTime="3.045680002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:36:48.060100409 +0000 UTC m=+250.329100392" watchObservedRunningTime="2026-09-18 03:36:48.060744824 +0000 UTC m=+250.329744775" Sep 18 03:36:48.078154 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.078107 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" podStartSLOduration=2.007086091 podStartE2EDuration="5.078087203s" totalImagesPullingTime="3.071001112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:36:48.076749545 +0000 UTC m=+250.345749507" watchObservedRunningTime="2026-09-18 03:36:48.078087203 +0000 UTC m=+250.347087168" Sep 18 03:36:48.172893 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.172863 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:48.273418 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.273364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:48.599044 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.598960 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:48.700036 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.699994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:48.875600 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.875518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:48.974947 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.974912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:48.975107 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.974955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:48.975107 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:48.975082 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:48.975177 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:48.975118 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:48.975177 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:48.975144 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:50.975127127 +0000 UTC m=+253.244127081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:48.975177 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:48.975166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:50.975153318 +0000 UTC m=+253.244153257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : configmap "kube-rbac-proxy" not found Sep 18 03:36:48.997697 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:48.997669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:49.054643 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.054618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:36:49.055018 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.055003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/0.log" Sep 18 03:36:49.055080 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.055038 2576 generic.go:356] "Generic (PLEG): container finished" podID="be3dd34e-ddd3-4095-8495-428af0afe2e5" containerID="1b5cf411ca7e4c89ec9c116845802ed9649c5896380f0eed82a61fd43f508b37" exitCode=255 Sep 18 03:36:49.055143 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.055119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" event={"ID":"be3dd34e-ddd3-4095-8495-428af0afe2e5","Type":"ContainerDied","Data":"1b5cf411ca7e4c89ec9c116845802ed9649c5896380f0eed82a61fd43f508b37"} Sep 18 03:36:49.055218 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.055208 2576 scope.go:117] "RemoveContainer" containerID="c5158d737f0dd9150b545eebdaad47930d1598d8e5fb1a95dd2634af0c7dac4f" Sep 18 03:36:49.055438 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.055419 2576 scope.go:117] "RemoveContainer" containerID="1b5cf411ca7e4c89ec9c116845802ed9649c5896380f0eed82a61fd43f508b37" Sep 18 03:36:49.055618 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:49.055599 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-4cqm4_openshift-console-operator(be3dd34e-ddd3-4095-8495-428af0afe2e5)\"" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" podUID="be3dd34e-ddd3-4095-8495-428af0afe2e5" Sep 18 03:36:49.075292 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.075272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:49.132538 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.132467 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:49.463785 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:49.463711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vlv2c_c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2/dns-node-resolver/0.log" Sep 18 03:36:50.059543 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.059517 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:36:50.059912 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.059827 2576 scope.go:117] "RemoveContainer" containerID="1b5cf411ca7e4c89ec9c116845802ed9649c5896380f0eed82a61fd43f508b37" Sep 18 03:36:50.059991 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.059972 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-4cqm4_openshift-console-operator(be3dd34e-ddd3-4095-8495-428af0afe2e5)\"" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" podUID="be3dd34e-ddd3-4095-8495-428af0afe2e5" Sep 18 03:36:50.184083 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.184036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:36:50.184298 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.184195 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:36:50.184298 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.184271 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs podName:8db89550-fea8-45bf-b990-609ad2ec5648 nodeName:}" failed. No retries permitted until 2026-09-18 03:38:52.184248648 +0000 UTC m=+374.453248603 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs") pod "network-metrics-daemon-gf592" (UID: "8db89550-fea8-45bf-b990-609ad2ec5648") : secret "metrics-daemon-secret" not found Sep 18 03:36:50.463036 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.462953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gxgln_43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f/node-ca/0.log" Sep 18 03:36:50.474755 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.474727 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-t5lqn"] Sep 18 03:36:50.479009 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.478994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.481274 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.481246 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 03:36:50.481433 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.481317 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 03:36:50.481433 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.481322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mhmfr\"" Sep 18 03:36:50.481433 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.481330 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 03:36:50.482160 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.482145 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 03:36:50.485845 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.485827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ef2ad809-24d4-47d6-b995-06418c0bf3b0-signing-key\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.485948 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.485922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ef2ad809-24d4-47d6-b995-06418c0bf3b0-signing-cabundle\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.485948 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.485942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5nwd\" (UniqueName: \"kubernetes.io/projected/ef2ad809-24d4-47d6-b995-06418c0bf3b0-kube-api-access-m5nwd\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.486498 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.486478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-t5lqn"] Sep 18 03:36:50.517899 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.517861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:50.567937 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.567904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:50.586918 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.586891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ef2ad809-24d4-47d6-b995-06418c0bf3b0-signing-key\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.587014 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.586998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ef2ad809-24d4-47d6-b995-06418c0bf3b0-signing-cabundle\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.587053 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.587027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5nwd\" (UniqueName: \"kubernetes.io/projected/ef2ad809-24d4-47d6-b995-06418c0bf3b0-kube-api-access-m5nwd\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.587674 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.587649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ef2ad809-24d4-47d6-b995-06418c0bf3b0-signing-cabundle\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.589364 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.589345 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ef2ad809-24d4-47d6-b995-06418c0bf3b0-signing-key\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.594361 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.594337 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5nwd\" (UniqueName: \"kubernetes.io/projected/ef2ad809-24d4-47d6-b995-06418c0bf3b0-kube-api-access-m5nwd\") pod \"service-ca-55f6fc7b86-t5lqn\" (UID: \"ef2ad809-24d4-47d6-b995-06418c0bf3b0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.788468 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.788427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" Sep 18 03:36:50.863825 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.863793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27cqh_73f9f56d-7fc8-4f2f-8d68-5843400066a9/serve-healthcheck-canary/0.log" Sep 18 03:36:50.989713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.989666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:50.989918 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:50.989726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:50.989918 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.989818 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:50.989918 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.989851 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:50.989918 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.989897 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:54.989881064 +0000 UTC m=+257.258881003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:50.989918 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:50.989911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:36:54.989905477 +0000 UTC m=+257.258905417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : configmap "kube-rbac-proxy" not found Sep 18 03:36:51.057056 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:51.056975 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-t5lqn"] Sep 18 03:36:51.060649 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:36:51.060622 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2ad809_24d4_47d6_b995_06418c0bf3b0.slice/crio-656c4ca79c0c91a8a893f5e3c1cf916c6edc6396f4bec36bd3e1b96a3f8f5c7c WatchSource:0}: Error finding container 656c4ca79c0c91a8a893f5e3c1cf916c6edc6396f4bec36bd3e1b96a3f8f5c7c: Status 404 returned error can't find the container with id 656c4ca79c0c91a8a893f5e3c1cf916c6edc6396f4bec36bd3e1b96a3f8f5c7c Sep 18 03:36:51.365624 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:51.365547 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:52.048584 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.048549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:52.068128 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.068102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" event={"ID":"ef2ad809-24d4-47d6-b995-06418c0bf3b0","Type":"ContainerStarted","Data":"a4029b515c61cae7f0ff2bed254156493e821cb956e3c75fe38fca99d59c67c9"} Sep 18 03:36:52.068673 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.068633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" event={"ID":"ef2ad809-24d4-47d6-b995-06418c0bf3b0","Type":"ContainerStarted","Data":"656c4ca79c0c91a8a893f5e3c1cf916c6edc6396f4bec36bd3e1b96a3f8f5c7c"} Sep 18 03:36:52.086913 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.086870 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-t5lqn" podStartSLOduration=2.08685289 podStartE2EDuration="2.08685289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:36:52.084959297 +0000 UTC m=+254.353959256" watchObservedRunningTime="2026-09-18 03:36:52.08685289 +0000 UTC m=+254.355852855" Sep 18 03:36:52.337652 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.337563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:52.451205 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.451172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:52.537915 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.537881 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:52.650560 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.650475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:52.756470 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:52.753136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:53.676911 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:53.676865 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:53.777486 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:53.777414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:53.975890 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:53.975861 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:53.976067 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:53.975962 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:36:53.976329 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:53.976313 2576 scope.go:117] "RemoveContainer" containerID="1b5cf411ca7e4c89ec9c116845802ed9649c5896380f0eed82a61fd43f508b37" Sep 18 03:36:53.976535 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:53.976513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-4cqm4_openshift-console-operator(be3dd34e-ddd3-4095-8495-428af0afe2e5)\"" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" podUID="be3dd34e-ddd3-4095-8495-428af0afe2e5" Sep 18 03:36:54.142094 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:54.142048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:54.342982 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:54.342885 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:54.542626 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:54.542582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:54.943339 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:54.943302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:54.998970 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:54.998934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:55.024079 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:55.024045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:55.024209 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:55.024093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:36:55.024209 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:55.024182 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:36:55.024380 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:55.024260 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:03.024244396 +0000 UTC m=+265.293244335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : secret "insights-runtime-extractor-tls" not found Sep 18 03:36:55.024380 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:55.024182 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:36:55.024380 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:36:55.024323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm podName:1d7bd3d3-057d-4495-ba85-60029e010375 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:03.024310201 +0000 UTC m=+265.293310161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-br9qd" (UID: "1d7bd3d3-057d-4495-ba85-60029e010375") : configmap "kube-rbac-proxy" not found Sep 18 03:36:55.340324 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:55.340293 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:55.738824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:55.738790 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:55.919916 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:55.919867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:55.971225 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:55.971187 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:56.537780 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:56.537751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:58.126796 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:58.126758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:58.349604 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:58.349571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:58.523211 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:58.523174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:58.740399 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:58.740364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:59.139290 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:59.139261 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:59.539603 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:59.539570 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:36:59.934672 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:36:59.934591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:00.136809 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:00.136771 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:00.496673 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:00.496641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:00.736304 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:00.736267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:01.134049 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:01.134016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:01.538086 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:01.538052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:01.938809 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:01.938730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:02.148004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:02.147966 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:02.249189 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:02.249157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:02.349130 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:02.349099 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:02.537823 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:02.537748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:02.738834 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:02.738800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:03.093631 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.093592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:37:03.093811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.093654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:37:03.094231 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.094203 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d7bd3d3-057d-4495-ba85-60029e010375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:37:03.096056 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.096039 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d7bd3d3-057d-4495-ba85-60029e010375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-br9qd\" (UID: \"1d7bd3d3-057d-4495-ba85-60029e010375\") " pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:37:03.134364 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.134335 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:03.205719 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.205689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-br9qd" Sep 18 03:37:03.474228 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:03.474192 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-br9qd"] Sep 18 03:37:03.477301 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:03.477274 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7bd3d3_057d_4495_ba85_60029e010375.slice/crio-d344611660358aea00f183a41b63c37de808ef6cb1e0f6fff010d87f9ba6f63a WatchSource:0}: Error finding container d344611660358aea00f183a41b63c37de808ef6cb1e0f6fff010d87f9ba6f63a: Status 404 returned error can't find the container with id d344611660358aea00f183a41b63c37de808ef6cb1e0f6fff010d87f9ba6f63a Sep 18 03:37:04.107562 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:04.107532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br9qd" event={"ID":"1d7bd3d3-057d-4495-ba85-60029e010375","Type":"ContainerStarted","Data":"f82889aa94d25631ab9e579691b9e27156172f138dd1e483e15f1e58e584a900"} Sep 18 03:37:04.107999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:04.107591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br9qd" event={"ID":"1d7bd3d3-057d-4495-ba85-60029e010375","Type":"ContainerStarted","Data":"d344611660358aea00f183a41b63c37de808ef6cb1e0f6fff010d87f9ba6f63a"} Sep 18 03:37:05.112971 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:05.112932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br9qd" event={"ID":"1d7bd3d3-057d-4495-ba85-60029e010375","Type":"ContainerStarted","Data":"ba72af35096273b1feb1d8259bce0e2428e76bb35341a6f03b9a8206a84b60c3"} Sep 18 03:37:06.118656 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:06.118617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-br9qd" event={"ID":"1d7bd3d3-057d-4495-ba85-60029e010375","Type":"ContainerStarted","Data":"007322609af740f644960fd783cd016e570c7a233757f9033b53462cfb07e34f"} Sep 18 03:37:06.135409 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:06.135359 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-br9qd" podStartSLOduration=17.147592396 podStartE2EDuration="19.135341749s" totalImagesPullingTime="1.987749353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:36:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:06.133614293 +0000 UTC m=+268.402614271" watchObservedRunningTime="2026-09-18 03:37:06.135341749 +0000 UTC m=+268.404341709" Sep 18 03:37:06.252313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:06.252279 2576 scope.go:117] "RemoveContainer" containerID="1b5cf411ca7e4c89ec9c116845802ed9649c5896380f0eed82a61fd43f508b37" Sep 18 03:37:07.124525 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.124494 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:37:07.126644 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.125556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" event={"ID":"be3dd34e-ddd3-4095-8495-428af0afe2e5","Type":"ContainerStarted","Data":"e96fa36763eba08f2f9d75c86c9b2a35182bda7759df23bd1b3fa5306a23dca2"} Sep 18 03:37:07.126644 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.126587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:37:07.132418 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.132389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" Sep 18 03:37:07.141488 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.141427 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-4cqm4" podStartSLOduration=21.079504077 podStartE2EDuration="24.141415389s" totalImagesPullingTime="3.061911312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:07.140828444 +0000 UTC m=+269.409828417" watchObservedRunningTime="2026-09-18 03:37:07.141415389 +0000 UTC m=+269.410415349" Sep 18 03:37:07.193913 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.193886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:07.284904 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.284864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:07.345737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.345708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:07.471356 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.471326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:07.642636 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.642607 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:07.696795 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:07.696758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:08.040798 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:08.040768 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:08.092580 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:08.092532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:08.660328 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:08.660298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:08.851750 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:08.851717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:09.255288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.255245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:09.574129 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.574050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:09.690267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.690233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:09.771774 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.771745 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-l59kp"] Sep 18 03:37:09.775041 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.775015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:09.776980 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.776941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:09.777428 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.777403 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d66fq\"" Sep 18 03:37:09.777601 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.777539 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 03:37:09.777693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.777677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 03:37:09.788337 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.788316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-l59kp"] Sep 18 03:37:09.847427 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.847352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rp42\" (UniqueName: \"kubernetes.io/projected/8ddae06c-a5d1-406f-b202-3e9481e95fc9-kube-api-access-4rp42\") pod \"downloads-6594f4c75-l59kp\" (UID: \"8ddae06c-a5d1-406f-b202-3e9481e95fc9\") " pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:09.867833 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.867808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:09.947987 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.947957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rp42\" (UniqueName: \"kubernetes.io/projected/8ddae06c-a5d1-406f-b202-3e9481e95fc9-kube-api-access-4rp42\") pod \"downloads-6594f4c75-l59kp\" (UID: \"8ddae06c-a5d1-406f-b202-3e9481e95fc9\") " pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:09.956082 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.956056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rp42\" (UniqueName: \"kubernetes.io/projected/8ddae06c-a5d1-406f-b202-3e9481e95fc9-kube-api-access-4rp42\") pod \"downloads-6594f4c75-l59kp\" (UID: \"8ddae06c-a5d1-406f-b202-3e9481e95fc9\") " pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:09.962382 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:09.962347 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:10.086304 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:10.086265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:10.353896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:10.353870 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-l59kp"] Sep 18 03:37:10.356248 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:10.356218 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddae06c_a5d1_406f_b202_3e9481e95fc9.slice/crio-c261cbf7ceb86afe2974982a46a3d1300df2eb4e86255f057cae277992f58e2f WatchSource:0}: Error finding container c261cbf7ceb86afe2974982a46a3d1300df2eb4e86255f057cae277992f58e2f: Status 404 returned error can't find the container with id c261cbf7ceb86afe2974982a46a3d1300df2eb4e86255f057cae277992f58e2f Sep 18 03:37:11.141835 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:11.141802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-l59kp" event={"ID":"8ddae06c-a5d1-406f-b202-3e9481e95fc9","Type":"ContainerStarted","Data":"c261cbf7ceb86afe2974982a46a3d1300df2eb4e86255f057cae277992f58e2f"} Sep 18 03:37:11.708863 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:11.708824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:11.780039 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:11.779967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:12.377063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:12.377023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:12.443189 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:12.443145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:12.891283 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:12.891237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:15.149675 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:15.149638 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:15.211727 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:15.211695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:15.267873 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:15.267837 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:17.507181 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.507067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:17.606047 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.606011 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:17.716160 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.716126 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:17.746710 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.746682 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2"] Sep 18 03:37:17.752938 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.752875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:17.757544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.757278 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 03:37:17.757544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.757303 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-46r6j\"" Sep 18 03:37:17.757544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.757329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 03:37:17.757544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.757354 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 03:37:17.757544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.757312 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 03:37:17.757544 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.757278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 03:37:17.773809 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.773738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2"] Sep 18 03:37:17.796419 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.796317 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k9g9d"] Sep 18 03:37:17.803171 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.803146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.806009 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.805988 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 03:37:17.806280 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.806262 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 03:37:17.806483 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.806445 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 03:37:17.806696 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.806661 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kzscl\"" Sep 18 03:37:17.824051 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.824024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:17.898179 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.898142 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:17.918230 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918378 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:17.918378 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:17.918378 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-root\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:17.918570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv9ld\" (UniqueName: \"kubernetes.io/projected/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-kube-api-access-lv9ld\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:17.918570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-metrics-client-ca\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918721 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctkqh\" (UniqueName: \"kubernetes.io/projected/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-kube-api-access-ctkqh\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918721 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-sys\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918721 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-tls\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918721 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-textfile\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918721 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:17.918967 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:17.918739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-wtmp\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019219 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-sys\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019219 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-tls\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019219 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-textfile\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-wtmp\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.019484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.019484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.019484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-root\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv9ld\" (UniqueName: \"kubernetes.io/projected/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-kube-api-access-lv9ld\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-metrics-client-ca\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.019576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctkqh\" (UniqueName: \"kubernetes.io/projected/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-kube-api-access-ctkqh\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.020204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-textfile\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.020275 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-sys\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:18.020352 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:18.020407 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-tls podName:f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf nodeName:}" failed. No retries permitted until 2026-09-18 03:37:18.520387263 +0000 UTC m=+280.789387209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-tls") pod "node-exporter-k9g9d" (UID: "f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf") : secret "node-exporter-tls" not found Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:18.020710 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:18.020753 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-tls podName:29cc7d1f-e6cf-473e-9786-f8c7668f7d89 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:18.520738542 +0000 UTC m=+280.789738487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-krtp2" (UID: "29cc7d1f-e6cf-473e-9786-f8c7668f7d89") : secret "openshift-state-metrics-tls" not found Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.021375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.021439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-root\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.021887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.023693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.022228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-wtmp\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.024881 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.024814 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.025676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.025629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-metrics-client-ca\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.030102 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.030060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctkqh\" (UniqueName: \"kubernetes.io/projected/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-kube-api-access-ctkqh\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.031259 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.031016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv9ld\" (UniqueName: \"kubernetes.io/projected/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-kube-api-access-lv9ld\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.033061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.033023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.034857 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.034834 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.123072 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.123041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.225193 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.225157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.323138 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.323043 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.479089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.479052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.524369 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.524336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.524824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.524393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-tls\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.526942 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.526916 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf-node-exporter-tls\") pod \"node-exporter-k9g9d\" (UID: \"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf\") " pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.527194 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.527173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/29cc7d1f-e6cf-473e-9786-f8c7668f7d89-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-krtp2\" (UID: \"29cc7d1f-e6cf-473e-9786-f8c7668f7d89\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.665055 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.664980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" Sep 18 03:37:18.717386 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.717254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9g9d" Sep 18 03:37:18.740602 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:18.740572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1806ff4_dfc8_4cb8_8eef_5aa505d6efaf.slice/crio-878a264d65a1b8430cf525ab85d4e9a99f8042db6c43a61ba091a32d99ec3f4c WatchSource:0}: Error finding container 878a264d65a1b8430cf525ab85d4e9a99f8042db6c43a61ba091a32d99ec3f4c: Status 404 returned error can't find the container with id 878a264d65a1b8430cf525ab85d4e9a99f8042db6c43a61ba091a32d99ec3f4c Sep 18 03:37:18.744401 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.744376 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.808331 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:18.808275 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" podUID="a3394a4d-dee1-4ad6-ab45-a03ac404ef2e" Sep 18 03:37:18.820294 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.820258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.825321 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.825297 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:37:18.830828 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.830809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.833362 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833339 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 03:37:18.833490 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833407 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 03:37:18.833571 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 03:37:18.833642 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 03:37:18.833898 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 03:37:18.833985 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 03:37:18.834046 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.833873 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 03:37:18.834102 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.834042 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cdglx\"" Sep 18 03:37:18.834153 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.834113 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 03:37:18.834210 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.834159 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 03:37:18.845736 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.845714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:37:18.930565 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmr5h\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-kube-api-access-dmr5h\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930727 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930727 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930727 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930727 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-web-config\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.930925 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.931179 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.930947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-out\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.931179 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.931021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:18.938952 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.938824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:18.951763 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:18.951740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2"] Sep 18 03:37:18.954347 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:18.954319 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cc7d1f_e6cf_473e_9786_f8c7668f7d89.slice/crio-3050a3b3f8411531898c7411efca1d383f6bc1e99ba18c3c4a40791e8021e743 WatchSource:0}: Error finding container 3050a3b3f8411531898c7411efca1d383f6bc1e99ba18c3c4a40791e8021e743: Status 404 returned error can't find the container with id 3050a3b3f8411531898c7411efca1d383f6bc1e99ba18c3c4a40791e8021e743 Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-out\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmr5h\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-kube-api-access-dmr5h\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.032999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.032982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.033407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-web-config\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.033407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.033407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.033407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.033407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.033407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.035313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.033855 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.035313 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:19.033970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle podName:1a66919a-b539-46d3-a7e3-0d3995211fb2 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:19.53395146 +0000 UTC m=+281.802951404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2") : configmap references non-existent config key: ca-bundle.crt Sep 18 03:37:19.035313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.034948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.035313 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:19.035171 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 03:37:19.035313 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:19.035289 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls podName:1a66919a-b539-46d3-a7e3-0d3995211fb2 nodeName:}" failed. No retries permitted until 2026-09-18 03:37:19.535269825 +0000 UTC m=+281.804269784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2") : secret "alertmanager-main-tls" not found Sep 18 03:37:19.038201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.038175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.038857 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.038809 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-web-config\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.038950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.038895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.039226 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.039207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.039324 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.039305 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.039571 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.039534 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-out\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.041585 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.041561 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.043066 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.043005 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.045815 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.045792 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmr5h\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-kube-api-access-dmr5h\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.173205 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.173166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" event={"ID":"29cc7d1f-e6cf-473e-9786-f8c7668f7d89","Type":"ContainerStarted","Data":"7e130bc0254ffeeebf275f9ff836a7956783f4569222ede9d4ff2c2ea2af73c1"} Sep 18 03:37:19.173364 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.173236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" event={"ID":"29cc7d1f-e6cf-473e-9786-f8c7668f7d89","Type":"ContainerStarted","Data":"4667ee3a5f836c8db05bb32e9f2a8dda43701758b19a2b2390f307f669a52736"} Sep 18 03:37:19.173364 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.173266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" event={"ID":"29cc7d1f-e6cf-473e-9786-f8c7668f7d89","Type":"ContainerStarted","Data":"3050a3b3f8411531898c7411efca1d383f6bc1e99ba18c3c4a40791e8021e743"} Sep 18 03:37:19.174520 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.174498 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:37:19.174639 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.174499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9g9d" event={"ID":"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf","Type":"ContainerStarted","Data":"878a264d65a1b8430cf525ab85d4e9a99f8042db6c43a61ba091a32d99ec3f4c"} Sep 18 03:37:19.247999 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.247961 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:19.536933 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.536838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.536933 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.536921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.537845 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.537816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.539850 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.539820 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.739142 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.738402 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7884d565f4-ktsr4"] Sep 18 03:37:19.742700 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.742631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.742700 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.742671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:37:19.746112 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.745985 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bfp3kciev7ju8\"" Sep 18 03:37:19.746465 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.746432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 03:37:19.746570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.746472 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 03:37:19.747274 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.747249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 03:37:19.747728 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.747704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9s5nh\"" Sep 18 03:37:19.748028 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.747976 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 03:37:19.748366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.748339 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 03:37:19.760147 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.760123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7884d565f4-ktsr4"] Sep 18 03:37:19.841070 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.840975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841240 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b47cb37b-288d-47b5-a0c6-484a07ef08e5-metrics-client-ca\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841240 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmcl5\" (UniqueName: \"kubernetes.io/projected/b47cb37b-288d-47b5-a0c6-484a07ef08e5-kube-api-access-nmcl5\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841240 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841240 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841240 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-tls\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.841559 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.841309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-grpc-tls\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.898229 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.898189 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:19.942051 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b47cb37b-288d-47b5-a0c6-484a07ef08e5-metrics-client-ca\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmcl5\" (UniqueName: \"kubernetes.io/projected/b47cb37b-288d-47b5-a0c6-484a07ef08e5-kube-api-access-nmcl5\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942237 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-tls\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942537 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-grpc-tls\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942537 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.942906 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.942847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b47cb37b-288d-47b5-a0c6-484a07ef08e5-metrics-client-ca\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.945655 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.945626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.945754 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.945660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.946941 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.946910 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.947142 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.947121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-tls\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.947396 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.947355 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.947855 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.947825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b47cb37b-288d-47b5-a0c6-484a07ef08e5-secret-grpc-tls\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.951098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.951053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmcl5\" (UniqueName: \"kubernetes.io/projected/b47cb37b-288d-47b5-a0c6-484a07ef08e5-kube-api-access-nmcl5\") pod \"thanos-querier-7884d565f4-ktsr4\" (UID: \"b47cb37b-288d-47b5-a0c6-484a07ef08e5\") " pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:19.957209 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:19.957158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:20.064155 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:20.064118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:20.234707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:20.234680 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:37:20.238920 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:20.238894 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a66919a_b539_46d3_a7e3_0d3995211fb2.slice/crio-deecee48a068a363e22e4255f86045caeb2a599063c7b164b7028bf18930d5e1 WatchSource:0}: Error finding container deecee48a068a363e22e4255f86045caeb2a599063c7b164b7028bf18930d5e1: Status 404 returned error can't find the container with id deecee48a068a363e22e4255f86045caeb2a599063c7b164b7028bf18930d5e1 Sep 18 03:37:20.671711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:20.671608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:20.772356 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:20.772320 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:21.070720 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:21.070687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:21.171290 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:21.171247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:21.183389 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:21.183356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"deecee48a068a363e22e4255f86045caeb2a599063c7b164b7028bf18930d5e1"} Sep 18 03:37:22.062576 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.062535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:37:22.065397 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.065371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"image-registry-64567f5b88-sphf6\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:37:22.065872 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.065837 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76684cdcfd-pzsfm"] Sep 18 03:37:22.101323 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.101285 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76684cdcfd-pzsfm"] Sep 18 03:37:22.101464 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.101379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.104104 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.104082 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 03:37:22.104218 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.104135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8hr2p\"" Sep 18 03:37:22.104218 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.104188 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 03:37:22.104218 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.104193 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 03:37:22.104391 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.104292 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 03:37:22.105331 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.105311 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bfuqh8eg3oqmg\"" Sep 18 03:37:22.155319 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.155297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jgsps\"" Sep 18 03:37:22.163123 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.163101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:37:22.163508 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.163487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:37:22.163600 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.163517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:37:22.166106 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.166079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/285cbb37-da1c-4993-869b-1d2d60f3ecdd-metrics-tls\") pod \"dns-default-7477s\" (UID: \"285cbb37-da1c-4993-869b-1d2d60f3ecdd\") " pod="openshift-dns/dns-default-7477s" Sep 18 03:37:22.166207 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.166175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3394a4d-dee1-4ad6-ab45-a03ac404ef2e-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-kq4lq\" (UID: \"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:37:22.177655 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.177625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bt2qr\"" Sep 18 03:37:22.185784 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.185761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" Sep 18 03:37:22.264269 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-secret-metrics-server-tls\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.264269 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11b6bba-17b0-4e1d-a319-ae4883c16115-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.264523 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-secret-metrics-server-client-certs\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.264523 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b11b6bba-17b0-4e1d-a319-ae4883c16115-audit-log\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.264523 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-client-ca-bundle\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.264688 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kmgg\" (UniqueName: \"kubernetes.io/projected/b11b6bba-17b0-4e1d-a319-ae4883c16115-kube-api-access-5kmgg\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.264688 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.264563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b11b6bba-17b0-4e1d-a319-ae4883c16115-metrics-server-audit-profiles\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.355215 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.355138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fvk6\"" Sep 18 03:37:22.363305 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.363283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7477s" Sep 18 03:37:22.365714 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-secret-metrics-server-client-certs\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.365836 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b11b6bba-17b0-4e1d-a319-ae4883c16115-audit-log\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.365836 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-client-ca-bundle\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.365836 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kmgg\" (UniqueName: \"kubernetes.io/projected/b11b6bba-17b0-4e1d-a319-ae4883c16115-kube-api-access-5kmgg\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.365836 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b11b6bba-17b0-4e1d-a319-ae4883c16115-metrics-server-audit-profiles\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.366072 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-secret-metrics-server-tls\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.366072 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.365886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11b6bba-17b0-4e1d-a319-ae4883c16115-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.366162 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.366139 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b11b6bba-17b0-4e1d-a319-ae4883c16115-audit-log\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.366608 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.366558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11b6bba-17b0-4e1d-a319-ae4883c16115-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.366958 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.366930 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b11b6bba-17b0-4e1d-a319-ae4883c16115-metrics-server-audit-profiles\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.368642 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.368592 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-secret-metrics-server-tls\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.368717 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.368692 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-client-ca-bundle\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.368762 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.368724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b11b6bba-17b0-4e1d-a319-ae4883c16115-secret-metrics-server-client-certs\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.374680 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.374658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kmgg\" (UniqueName: \"kubernetes.io/projected/b11b6bba-17b0-4e1d-a319-ae4883c16115-kube-api-access-5kmgg\") pod \"metrics-server-76684cdcfd-pzsfm\" (UID: \"b11b6bba-17b0-4e1d-a319-ae4883c16115\") " pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.412700 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.412676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:22.532713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.532653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:22.626113 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.626022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:22.901372 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.901287 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:22.978731 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:22.978694 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:23.813465 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:23.813413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:23.917569 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:23.917535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:27.523200 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.523137 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-654fdd864d-g4gs6"] Sep 18 03:37:27.526220 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.526200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.529713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.529502 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 03:37:27.529713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.529516 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 03:37:27.529713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.529529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 03:37:27.529713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.529590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 03:37:27.529713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.529599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 03:37:27.529713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.529648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dbvjk\"" Sep 18 03:37:27.534163 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.533990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 03:37:27.535952 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.535932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654fdd864d-g4gs6"] Sep 18 03:37:27.561344 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.561317 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq"] Sep 18 03:37:27.564926 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:27.564900 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3394a4d_dee1_4ad6_ab45_a03ac404ef2e.slice/crio-25c8fc5641eff3f19bb5db2e7207856d39fc047379822ac9aef690d6c29888b3 WatchSource:0}: Error finding container 25c8fc5641eff3f19bb5db2e7207856d39fc047379822ac9aef690d6c29888b3: Status 404 returned error can't find the container with id 25c8fc5641eff3f19bb5db2e7207856d39fc047379822ac9aef690d6c29888b3 Sep 18 03:37:27.605772 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.605709 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76684cdcfd-pzsfm"] Sep 18 03:37:27.609486 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:27.609430 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11b6bba_17b0_4e1d_a319_ae4883c16115.slice/crio-2db6a4ea48f2b9f0b7da886365505d97667874c9a842b185eb9bd9c06eecacd2 WatchSource:0}: Error finding container 2db6a4ea48f2b9f0b7da886365505d97667874c9a842b185eb9bd9c06eecacd2: Status 404 returned error can't find the container with id 2db6a4ea48f2b9f0b7da886365505d97667874c9a842b185eb9bd9c06eecacd2 Sep 18 03:37:27.612997 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.611405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7477s"] Sep 18 03:37:27.613387 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.613364 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7884d565f4-ktsr4"] Sep 18 03:37:27.614027 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.614011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64567f5b88-sphf6"] Sep 18 03:37:27.616055 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:27.615567 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47cb37b_288d_47b5_a0c6_484a07ef08e5.slice/crio-a3f1d79127e0b45a4156ce22991645b5fd570e2328d1c3f6fb18830136f7af1a WatchSource:0}: Error finding container a3f1d79127e0b45a4156ce22991645b5fd570e2328d1c3f6fb18830136f7af1a: Status 404 returned error can't find the container with id a3f1d79127e0b45a4156ce22991645b5fd570e2328d1c3f6fb18830136f7af1a Sep 18 03:37:27.618778 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:37:27.618589 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a78995_550c_4fdd_8796_229ad75066a4.slice/crio-073d5f248ff6f54d824e2380e9ae7e028f4b502baf3643fd53968df829376246 WatchSource:0}: Error finding container 073d5f248ff6f54d824e2380e9ae7e028f4b502baf3643fd53968df829376246: Status 404 returned error can't find the container with id 073d5f248ff6f54d824e2380e9ae7e028f4b502baf3643fd53968df829376246 Sep 18 03:37:27.714864 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.714713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-service-ca\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.714864 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.714794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-oauth-config\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.714864 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.714832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-oauth-serving-cert\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.715120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.714904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-trusted-ca-bundle\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.715120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.714961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-serving-cert\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.715120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.714987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-config\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.715120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.715040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nfg6\" (UniqueName: \"kubernetes.io/projected/b7f06d1c-2eb5-4347-b83f-9fb62436109a-kube-api-access-7nfg6\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816509 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-oauth-config\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816509 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-oauth-serving-cert\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816509 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-trusted-ca-bundle\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816804 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-serving-cert\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816804 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-config\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816804 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nfg6\" (UniqueName: \"kubernetes.io/projected/b7f06d1c-2eb5-4347-b83f-9fb62436109a-kube-api-access-7nfg6\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.816804 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.816683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-service-ca\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.819251 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.817515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-service-ca\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.819251 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.817984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-trusted-ca-bundle\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.819251 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.818595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-oauth-serving-cert\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.819251 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.819184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-config\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.820564 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.820538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-serving-cert\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.821150 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.820920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-oauth-config\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.827073 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.827026 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nfg6\" (UniqueName: \"kubernetes.io/projected/b7f06d1c-2eb5-4347-b83f-9fb62436109a-kube-api-access-7nfg6\") pod \"console-654fdd864d-g4gs6\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:27.846923 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:27.846824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:28.217314 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.217270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" event={"ID":"41a78995-550c-4fdd-8796-229ad75066a4","Type":"ContainerStarted","Data":"9be711a7ee84a83a828533852b3442019485c7d4c476755112aa115bd4a066f4"} Sep 18 03:37:28.217511 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.217340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" event={"ID":"41a78995-550c-4fdd-8796-229ad75066a4","Type":"ContainerStarted","Data":"073d5f248ff6f54d824e2380e9ae7e028f4b502baf3643fd53968df829376246"} Sep 18 03:37:28.217594 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.217547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:37:28.231884 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.231852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-l59kp" event={"ID":"8ddae06c-a5d1-406f-b202-3e9481e95fc9","Type":"ContainerStarted","Data":"0a53229656ca874157678b362297c6f0d1f532f32818dea324b306b572f3c4de"} Sep 18 03:37:28.232842 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.232816 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:28.236575 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.236240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" event={"ID":"b11b6bba-17b0-4e1d-a319-ae4883c16115","Type":"ContainerStarted","Data":"2db6a4ea48f2b9f0b7da886365505d97667874c9a842b185eb9bd9c06eecacd2"} Sep 18 03:37:28.238393 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.238373 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-l59kp" Sep 18 03:37:28.239738 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.239692 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" podStartSLOduration=290.239673051 podStartE2EDuration="4m50.239673051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:28.237612451 +0000 UTC m=+290.506612437" watchObservedRunningTime="2026-09-18 03:37:28.239673051 +0000 UTC m=+290.508673013" Sep 18 03:37:28.240159 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.240114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" event={"ID":"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e","Type":"ContainerStarted","Data":"25c8fc5641eff3f19bb5db2e7207856d39fc047379822ac9aef690d6c29888b3"} Sep 18 03:37:28.245168 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.245148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" event={"ID":"29cc7d1f-e6cf-473e-9786-f8c7668f7d89","Type":"ContainerStarted","Data":"29ed1999e057c02d7252db23ad657b3f599022de736a1366efc892b5abaa6e0b"} Sep 18 03:37:28.268582 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.262267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"a3f1d79127e0b45a4156ce22991645b5fd570e2328d1c3f6fb18830136f7af1a"} Sep 18 03:37:28.268582 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.263985 2576 generic.go:356] "Generic (PLEG): container finished" podID="f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf" containerID="c4846b19c3a0c9ddb287958dc2c4965bd4cdbf6d7a28637860f05ff8c6eae79f" exitCode=0 Sep 18 03:37:28.268582 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.264673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9g9d" event={"ID":"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf","Type":"ContainerDied","Data":"c4846b19c3a0c9ddb287958dc2c4965bd4cdbf6d7a28637860f05ff8c6eae79f"} Sep 18 03:37:28.270557 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.270533 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4" exitCode=0 Sep 18 03:37:28.270751 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.270733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4"} Sep 18 03:37:28.280133 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.279356 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-krtp2" podStartSLOduration=3.113976901 podStartE2EDuration="11.279333892s" totalImagesPullingTime="8.165356991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:28.279079189 +0000 UTC m=+290.548079151" watchObservedRunningTime="2026-09-18 03:37:28.279333892 +0000 UTC m=+290.548333854" Sep 18 03:37:28.280229 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.280163 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-l59kp" podStartSLOduration=2.302714139 podStartE2EDuration="19.280151165s" totalImagesPullingTime="16.977437026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:28.259482342 +0000 UTC m=+290.528482305" watchObservedRunningTime="2026-09-18 03:37:28.280151165 +0000 UTC m=+290.549151128" Sep 18 03:37:28.283848 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.283826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654fdd864d-g4gs6"] Sep 18 03:37:28.286788 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:28.286767 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7477s" event={"ID":"285cbb37-da1c-4993-869b-1d2d60f3ecdd","Type":"ContainerStarted","Data":"09e05708673fd86e19f7df46ee1db5a41fe988ea4fde0a2823674e0f90a01e2d"} Sep 18 03:37:29.308049 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:29.307124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9g9d" event={"ID":"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf","Type":"ContainerStarted","Data":"9eef6aaa666252f80910a2d53775458c1bd6af60c1eefa995cec0d106e51ca90"} Sep 18 03:37:29.308049 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:29.307190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9g9d" event={"ID":"f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf","Type":"ContainerStarted","Data":"3bb8ed15f1f35692a1484bdfb3d62f76035aefb2ec76fe77e206ff4a13671b5a"} Sep 18 03:37:29.312426 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:29.311912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654fdd864d-g4gs6" event={"ID":"b7f06d1c-2eb5-4347-b83f-9fb62436109a","Type":"ContainerStarted","Data":"d993a19cbbd46e43b88dedeb16e30abfc3ed1a3640faa8908137e7fa0ee15851"} Sep 18 03:37:29.327846 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:29.326025 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k9g9d" podStartSLOduration=10.976159097 podStartE2EDuration="12.326006457s" totalImagesPullingTime="1.255108068s" totalInitContainerRuntime="94.739292ms" isStatefulPod=true podCreationTimestamp="2026-09-18 03:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:29.324836617 +0000 UTC m=+291.593836578" watchObservedRunningTime="2026-09-18 03:37:29.326006457 +0000 UTC m=+291.595006419" Sep 18 03:37:31.106513 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:31.106336 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:31.160526 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:31.160467 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:31.482692 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:31.482657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:32.252777 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:32.252732 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gf592" podUID="8db89550-fea8-45bf-b990-609ad2ec5648" Sep 18 03:37:34.790959 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:34.790876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:34.891353 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:34.891314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:35.345146 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:35.345116 2576 generic.go:356] "Generic (PLEG): container finished" podID="757aeccd-aede-4758-b11b-46b0d8d37119" containerID="ee0426b7211115dce09710568e1893badb869b580a7e86b8daee1da9e05cb743" exitCode=255 Sep 18 03:37:35.345298 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:35.345175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" event={"ID":"757aeccd-aede-4758-b11b-46b0d8d37119","Type":"ContainerDied","Data":"ee0426b7211115dce09710568e1893badb869b580a7e86b8daee1da9e05cb743"} Sep 18 03:37:35.345298 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:35.345223 2576 scope.go:117] "RemoveContainer" containerID="9300da244d36df3504df878110d6f61fb3caac158a8c86135ee0dd9978e23230" Sep 18 03:37:35.352664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:35.352643 2576 scope.go:117] "RemoveContainer" containerID="ee0426b7211115dce09710568e1893badb869b580a7e86b8daee1da9e05cb743" Sep 18 03:37:35.352862 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:35.352842 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f9499b566-nl9tz_open-cluster-management-agent-addon(757aeccd-aede-4758-b11b-46b0d8d37119)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" podUID="757aeccd-aede-4758-b11b-46b0d8d37119" Sep 18 03:37:38.107626 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.107593 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:38.172737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.172713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:37:38.174765 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.174741 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:37:38.185716 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.185698 2576 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.207953 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.309110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.357744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"1f694d16d195a686b3fc485461514d22f29bb9b49a5957bcb98961cfa3bec6ec"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.357823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"60d21f7899c8da9e8f539288bcb7825b5aeb88ca924178c39cf28ecff9fa4569"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.357864 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"c2ab95bdb52b39b4071ae5bd64a4e2d29f5100a1c67eadfb547b8c991ba5a5bb"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.362378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.362438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.362497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.362524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.362549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.364104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7477s" event={"ID":"285cbb37-da1c-4993-869b-1d2d60f3ecdd","Type":"ContainerStarted","Data":"c92dd075c32c07836f38e737c7909393e06124ec864834f95b3b0c05933c8f92"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.364151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7477s" event={"ID":"285cbb37-da1c-4993-869b-1d2d60f3ecdd","Type":"ContainerStarted","Data":"daab8bce00fe8a32e23695d43e90275a1c2c1783dd392fcf11fbb67c0fc96708"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.364221 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7477s" Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.365643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" event={"ID":"b11b6bba-17b0-4e1d-a319-ae4883c16115","Type":"ContainerStarted","Data":"f66a5d1adbb2d0d6a9aebecf943a096abb29398aa526d8e0ba6bdb5be7d6b291"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.372796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" event={"ID":"a3394a4d-dee1-4ad6-ab45-a03ac404ef2e","Type":"ContainerStarted","Data":"3444904745a208006182ec992ee744dbad83bb8156ce46f9757081eae9925a39"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.374999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654fdd864d-g4gs6" event={"ID":"b7f06d1c-2eb5-4347-b83f-9fb62436109a","Type":"ContainerStarted","Data":"327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b"} Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.382384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7477s" podStartSLOduration=257.688462336 podStartE2EDuration="4m26.382373147s" totalImagesPullingTime="8.693910811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:38.380867187 +0000 UTC m=+300.649867147" watchObservedRunningTime="2026-09-18 03:37:38.382373147 +0000 UTC m=+300.651373108" Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.398517 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-654fdd864d-g4gs6" podStartSLOduration=1.809930346 podStartE2EDuration="11.398503825s" totalImagesPullingTime="9.588573479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:38.397401813 +0000 UTC m=+300.666401774" watchObservedRunningTime="2026-09-18 03:37:38.398503825 +0000 UTC m=+300.667503786" Sep 18 03:37:38.821869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.412580 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" podStartSLOduration=6.523867297 podStartE2EDuration="16.412568493s" totalImagesPullingTime="9.888701196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:38.411719445 +0000 UTC m=+300.680719502" watchObservedRunningTime="2026-09-18 03:37:38.412568493 +0000 UTC m=+300.681568450" Sep 18 03:37:38.823817 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.425673 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-kq4lq" podStartSLOduration=285.491938181 podStartE2EDuration="4m55.425661748s" totalImagesPullingTime="9.933723567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:38.424876567 +0000 UTC m=+300.693876529" watchObservedRunningTime="2026-09-18 03:37:38.425661748 +0000 UTC m=+300.694661708" Sep 18 03:37:38.823817 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.513891 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:38.823817 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:38.614267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:40.385581 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.385538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"bdffff02221b7d9a4f826e0daca242b8b43614eb8cfe395d45a5a7894a6bc899"} Sep 18 03:37:40.386035 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.385618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"14f952cb27f12f8a84dedbfb8db6cdcfade91a82b8016065ee6767beeee3904a"} Sep 18 03:37:40.386035 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.385660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" event={"ID":"b47cb37b-288d-47b5-a0c6-484a07ef08e5","Type":"ContainerStarted","Data":"b623c0cfc9c37e1e3949763f2431979cee854098bcfbbf41d19c110e7b19e2f7"} Sep 18 03:37:40.386035 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.385703 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:40.388901 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.388861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerStarted","Data":"4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498"} Sep 18 03:37:40.406778 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.406728 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" podStartSLOduration=9.986063046 podStartE2EDuration="21.406713471s" totalImagesPullingTime="11.420650425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:40.406475359 +0000 UTC m=+302.675475321" watchObservedRunningTime="2026-09-18 03:37:40.406713471 +0000 UTC m=+302.675713454" Sep 18 03:37:40.431375 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.430578 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.180525497 podStartE2EDuration="22.430561772s" totalImagesPullingTime="18.227929316s" totalInitContainerRuntime="22.106959ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:37:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:37:40.429484887 +0000 UTC m=+302.698484845" watchObservedRunningTime="2026-09-18 03:37:40.430561772 +0000 UTC m=+302.699561735" Sep 18 03:37:40.771129 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.771102 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" Sep 18 03:37:40.777245 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:40.777227 2576 scope.go:117] "RemoveContainer" containerID="ee0426b7211115dce09710568e1893badb869b580a7e86b8daee1da9e05cb743" Sep 18 03:37:40.777406 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:37:40.777389 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f9499b566-nl9tz_open-cluster-management-agent-addon(757aeccd-aede-4758-b11b-46b0d8d37119)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" podUID="757aeccd-aede-4758-b11b-46b0d8d37119" Sep 18 03:37:41.704719 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:41.704678 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:41.766282 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:41.766247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:41.792717 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:41.792692 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64567f5b88-sphf6"] Sep 18 03:37:41.861845 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:41.861793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:41.914872 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:41.914839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:42.055871 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:42.055834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:42.116372 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:42.116339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:42.413471 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:42.413375 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:42.413471 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:42.413433 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:37:44.579531 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:44.579490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:45.244584 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:45.244545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:45.251433 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:45.251411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:37:45.302411 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:45.302377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:45.596098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:45.596025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:45.648716 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:45.648687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:46.400292 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:46.400265 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7884d565f4-ktsr4" Sep 18 03:37:47.847961 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:47.847924 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:47.848363 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:47.848022 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:47.852933 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:47.852906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:48.381004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:48.380974 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7477s" Sep 18 03:37:48.426326 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:48.426298 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:37:48.574829 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:48.574789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:48.672891 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:48.672806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:48.774654 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:48.774616 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:51.797756 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:51.797726 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:37:52.049019 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:52.048940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:54.314500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:54.314471 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:54.365905 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:54.365878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:56.252425 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:56.252395 2576 scope.go:117] "RemoveContainer" containerID="ee0426b7211115dce09710568e1893badb869b580a7e86b8daee1da9e05cb743" Sep 18 03:37:56.454416 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:56.454380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9499b566-nl9tz" event={"ID":"757aeccd-aede-4758-b11b-46b0d8d37119","Type":"ContainerStarted","Data":"375605948eb04c0daabe7911c832655b1e1b9aa741a29675244a1617f71b4953"} Sep 18 03:37:56.706548 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:56.706473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:56.808293 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:56.808266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:57.507348 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:57.507311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:37:57.608470 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:37:57.608415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:02.418537 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:02.418504 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:38:02.422350 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:02.422326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76684cdcfd-pzsfm" Sep 18 03:38:03.483263 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:03.483231 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a702adf-6b34-4c62-8fdd-1aa639d6701a" containerID="c3328ea4aad803fb2ba538cfe1afa28519cf784776a4b1396cbbe785dd71f62e" exitCode=0 Sep 18 03:38:03.483652 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:03.483301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" event={"ID":"4a702adf-6b34-4c62-8fdd-1aa639d6701a","Type":"ContainerDied","Data":"c3328ea4aad803fb2ba538cfe1afa28519cf784776a4b1396cbbe785dd71f62e"} Sep 18 03:38:03.483652 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:03.483648 2576 scope.go:117] "RemoveContainer" containerID="c3328ea4aad803fb2ba538cfe1afa28519cf784776a4b1396cbbe785dd71f62e" Sep 18 03:38:04.489486 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:04.489438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wpc5v" event={"ID":"4a702adf-6b34-4c62-8fdd-1aa639d6701a","Type":"ContainerStarted","Data":"71b8894a6df79e5585ad533075068c9e794c9cd4c14a462f9b7d17570076f64f"} Sep 18 03:38:06.811601 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:06.811559 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" podUID="41a78995-550c-4fdd-8796-229ad75066a4" containerName="registry" containerID="cri-o://9be711a7ee84a83a828533852b3442019485c7d4c476755112aa115bd4a066f4" gracePeriod=30 Sep 18 03:38:08.507014 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.506984 2576 generic.go:356] "Generic (PLEG): container finished" podID="41a78995-550c-4fdd-8796-229ad75066a4" containerID="9be711a7ee84a83a828533852b3442019485c7d4c476755112aa115bd4a066f4" exitCode=0 Sep 18 03:38:08.507391 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.507052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" event={"ID":"41a78995-550c-4fdd-8796-229ad75066a4","Type":"ContainerDied","Data":"9be711a7ee84a83a828533852b3442019485c7d4c476755112aa115bd4a066f4"} Sep 18 03:38:08.508833 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.508806 2576 generic.go:356] "Generic (PLEG): container finished" podID="d5e96173-c0f3-4b43-8edd-290864ffdf5e" containerID="8eb7923390248dfb2b77d17a595b4f1625816e086bd44663ea2c63cff4e39d1a" exitCode=0 Sep 18 03:38:08.508973 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.508841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" event={"ID":"d5e96173-c0f3-4b43-8edd-290864ffdf5e","Type":"ContainerDied","Data":"8eb7923390248dfb2b77d17a595b4f1625816e086bd44663ea2c63cff4e39d1a"} Sep 18 03:38:08.509275 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.509188 2576 scope.go:117] "RemoveContainer" containerID="8eb7923390248dfb2b77d17a595b4f1625816e086bd44663ea2c63cff4e39d1a" Sep 18 03:38:08.616238 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.616208 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:38:08.716786 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716708 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.716786 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716782 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-image-registry-private-configuration\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716814 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-registry-certificates\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a78995-550c-4fdd-8796-229ad75066a4-ca-trust-extracted\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716900 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-bound-sa-token\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716937 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-installation-pull-secrets\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716965 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gwgt\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-kube-api-access-8gwgt\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717004 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.716996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-trusted-ca\") pod \"41a78995-550c-4fdd-8796-229ad75066a4\" (UID: \"41a78995-550c-4fdd-8796-229ad75066a4\") " Sep 18 03:38:08.717311 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.717232 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:08.717725 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.717698 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:08.719716 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.719636 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:08.719822 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.719730 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:38:08.719822 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.719770 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-kube-api-access-8gwgt" (OuterVolumeSpecName: "kube-api-access-8gwgt") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "kube-api-access-8gwgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:38:08.719937 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.719856 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:38:08.719937 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.719876 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:08.727751 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.727720 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a78995-550c-4fdd-8796-229ad75066a4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "41a78995-550c-4fdd-8796-229ad75066a4" (UID: "41a78995-550c-4fdd-8796-229ad75066a4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:38:08.817896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817869 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gwgt\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-kube-api-access-8gwgt\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.817896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817893 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-trusted-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.817896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817901 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-registry-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.818098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817909 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-image-registry-private-configuration\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.818098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817919 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a78995-550c-4fdd-8796-229ad75066a4-registry-certificates\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.818098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817927 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a78995-550c-4fdd-8796-229ad75066a4-ca-trust-extracted\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.818098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817935 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a78995-550c-4fdd-8796-229ad75066a4-bound-sa-token\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:08.818098 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:08.817943 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a78995-550c-4fdd-8796-229ad75066a4-installation-pull-secrets\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:09.514620 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:09.514582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-q8j7v" event={"ID":"d5e96173-c0f3-4b43-8edd-290864ffdf5e","Type":"ContainerStarted","Data":"025769f920bdff95ddcfdb51c587dfec671d5e7a3b6a891d8ad984be2e21cbee"} Sep 18 03:38:09.515836 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:09.515813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" event={"ID":"41a78995-550c-4fdd-8796-229ad75066a4","Type":"ContainerDied","Data":"073d5f248ff6f54d824e2380e9ae7e028f4b502baf3643fd53968df829376246"} Sep 18 03:38:09.515920 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:09.515861 2576 scope.go:117] "RemoveContainer" containerID="9be711a7ee84a83a828533852b3442019485c7d4c476755112aa115bd4a066f4" Sep 18 03:38:09.515979 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:09.515862 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64567f5b88-sphf6" Sep 18 03:38:09.545213 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:09.545184 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64567f5b88-sphf6"] Sep 18 03:38:09.551055 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:09.551032 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64567f5b88-sphf6"] Sep 18 03:38:10.257732 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:10.257698 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41a78995-550c-4fdd-8796-229ad75066a4" path="/var/lib/kubelet/pods/41a78995-550c-4fdd-8796-229ad75066a4/volumes" Sep 18 03:38:11.707965 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:11.707934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:11.763417 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:11.763381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:13.080043 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:13.080007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:13.130196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:13.130161 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:30.719182 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:30.719102 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:30.769879 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:30.769848 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:33.826928 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:33.826894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:33.883938 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:33.883903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:36.248760 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:36.248725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:36.300768 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:36.300733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:38.057129 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057093 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:38:38.057579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057369 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="alertmanager" containerID="cri-o://c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c" gracePeriod=120 Sep 18 03:38:38.057579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057436 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-metric" containerID="cri-o://f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39" gracePeriod=120 Sep 18 03:38:38.057579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057469 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-web" containerID="cri-o://e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4" gracePeriod=120 Sep 18 03:38:38.057579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057521 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy" containerID="cri-o://a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0" gracePeriod=120 Sep 18 03:38:38.057579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057515 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="prom-label-proxy" containerID="cri-o://4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498" gracePeriod=120 Sep 18 03:38:38.057579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.057497 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="config-reloader" containerID="cri-o://2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f" gracePeriod=120 Sep 18 03:38:38.640506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640474 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498" exitCode=0 Sep 18 03:38:38.640506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640501 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39" exitCode=0 Sep 18 03:38:38.640506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640508 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0" exitCode=0 Sep 18 03:38:38.640506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640515 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f" exitCode=0 Sep 18 03:38:38.640506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640521 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c" exitCode=0 Sep 18 03:38:38.640877 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498"} Sep 18 03:38:38.640877 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39"} Sep 18 03:38:38.640877 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0"} Sep 18 03:38:38.640877 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f"} Sep 18 03:38:38.640877 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:38.640747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c"} Sep 18 03:38:39.296067 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.296042 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.378063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.377981 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378015 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-web-config\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378134 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-main-db\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378163 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-tls-assets\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378197 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378237 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmr5h\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-kube-api-access-dmr5h\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378259 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-out\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378280 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-cluster-tls-config\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378341 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378322 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-metrics-client-ca\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.378777 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378481 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:39.378777 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378660 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:38:39.379629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378931 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:38:39.379629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.378995 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.379629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.379035 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-volume\") pod \"1a66919a-b539-46d3-a7e3-0d3995211fb2\" (UID: \"1a66919a-b539-46d3-a7e3-0d3995211fb2\") " Sep 18 03:38:39.379629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.379325 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-metrics-client-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.379629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.379343 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.379629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.379357 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-alertmanager-main-db\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.381104 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.381047 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.382308 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.382266 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:38:39.382569 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.382541 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-kube-api-access-dmr5h" (OuterVolumeSpecName: "kube-api-access-dmr5h") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "kube-api-access-dmr5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:38:39.382657 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.382562 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.382720 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.382689 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.382987 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.382962 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.383116 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.383092 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-out" (OuterVolumeSpecName: "config-out") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:38:39.383712 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.383694 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-volume" (OuterVolumeSpecName: "config-volume") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.386950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.386811 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.393359 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.393337 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-web-config" (OuterVolumeSpecName: "web-config") pod "1a66919a-b539-46d3-a7e3-0d3995211fb2" (UID: "1a66919a-b539-46d3-a7e3-0d3995211fb2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:38:39.480196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480148 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-tls-assets\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480188 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480206 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmr5h\" (UniqueName: \"kubernetes.io/projected/1a66919a-b539-46d3-a7e3-0d3995211fb2-kube-api-access-dmr5h\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480216 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-out\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480225 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-cluster-tls-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480233 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480242 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-config-volume\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480250 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-main-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480257 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-web-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.480410 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.480265 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a66919a-b539-46d3-a7e3-0d3995211fb2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:38:39.647115 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.647022 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerID="e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4" exitCode=0 Sep 18 03:38:39.647115 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.647092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4"} Sep 18 03:38:39.647338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.647157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a66919a-b539-46d3-a7e3-0d3995211fb2","Type":"ContainerDied","Data":"deecee48a068a363e22e4255f86045caeb2a599063c7b164b7028bf18930d5e1"} Sep 18 03:38:39.647338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.647102 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.647338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.647188 2576 scope.go:117] "RemoveContainer" containerID="4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498" Sep 18 03:38:39.655889 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.655762 2576 scope.go:117] "RemoveContainer" containerID="f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39" Sep 18 03:38:39.662787 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.662768 2576 scope.go:117] "RemoveContainer" containerID="a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0" Sep 18 03:38:39.669761 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.669719 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:38:39.669839 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.669784 2576 scope.go:117] "RemoveContainer" containerID="e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4" Sep 18 03:38:39.673631 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.673608 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:38:39.676422 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.676403 2576 scope.go:117] "RemoveContainer" containerID="2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f" Sep 18 03:38:39.682818 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.682803 2576 scope.go:117] "RemoveContainer" containerID="c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c" Sep 18 03:38:39.689437 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.689422 2576 scope.go:117] "RemoveContainer" containerID="1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4" Sep 18 03:38:39.696086 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.696055 2576 scope.go:117] "RemoveContainer" containerID="4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498" Sep 18 03:38:39.696380 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.696361 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498\": container with ID starting with 4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498 not found: ID does not exist" containerID="4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498" Sep 18 03:38:39.696468 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.696387 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498"} err="failed to get container status \"4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498\": rpc error: code = NotFound desc = could not find container \"4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498\": container with ID starting with 4727d62262131c8ce8e202ac1935814a2bb470fe79ec7d89cbcb76f8422f9498 not found: ID does not exist" Sep 18 03:38:39.696468 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.696416 2576 scope.go:117] "RemoveContainer" containerID="f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39" Sep 18 03:38:39.696744 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.696725 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39\": container with ID starting with f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39 not found: ID does not exist" containerID="f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39" Sep 18 03:38:39.696793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.696750 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39"} err="failed to get container status \"f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39\": rpc error: code = NotFound desc = could not find container \"f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39\": container with ID starting with f70eb1d9636747581199edb93643e36a79959632ff1668246107fdb810efbf39 not found: ID does not exist" Sep 18 03:38:39.696793 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.696766 2576 scope.go:117] "RemoveContainer" containerID="a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0" Sep 18 03:38:39.697006 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.696992 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0\": container with ID starting with a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0 not found: ID does not exist" containerID="a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0" Sep 18 03:38:39.697042 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697011 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0"} err="failed to get container status \"a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0\": rpc error: code = NotFound desc = could not find container \"a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0\": container with ID starting with a1674f7080a6414afebf43ff49f9b89eede6394807e1d888a216406047bd2bb0 not found: ID does not exist" Sep 18 03:38:39.697042 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697024 2576 scope.go:117] "RemoveContainer" containerID="e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4" Sep 18 03:38:39.697274 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.697253 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4\": container with ID starting with e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4 not found: ID does not exist" containerID="e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4" Sep 18 03:38:39.697312 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697281 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4"} err="failed to get container status \"e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4\": rpc error: code = NotFound desc = could not find container \"e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4\": container with ID starting with e7fba9fc9f39c3616c297a5332d8d64e71e2c226e6494f1458bfc040920f85c4 not found: ID does not exist" Sep 18 03:38:39.697312 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697295 2576 scope.go:117] "RemoveContainer" containerID="2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f" Sep 18 03:38:39.697428 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697413 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:38:39.697572 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.697556 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f\": container with ID starting with 2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f not found: ID does not exist" containerID="2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f" Sep 18 03:38:39.697615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697577 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f"} err="failed to get container status \"2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f\": rpc error: code = NotFound desc = could not find container \"2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f\": container with ID starting with 2eecb7ef7ff7c10093396ec9ac60bbe36e185e5a76123e33881955cfad02567f not found: ID does not exist" Sep 18 03:38:39.697615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697590 2576 scope.go:117] "RemoveContainer" containerID="c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c" Sep 18 03:38:39.697733 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697717 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-web" Sep 18 03:38:39.697774 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697736 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-web" Sep 18 03:38:39.697774 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697750 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-metric" Sep 18 03:38:39.697774 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697759 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-metric" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697781 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="alertmanager" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697789 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="alertmanager" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697798 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="config-reloader" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697804 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="config-reloader" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697814 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="prom-label-proxy" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697819 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="prom-label-proxy" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697826 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="init-config-reloader" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697837 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="init-config-reloader" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697846 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697851 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697859 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a78995-550c-4fdd-8796-229ad75066a4" containerName="registry" Sep 18 03:38:39.697867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697864 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a78995-550c-4fdd-8796-229ad75066a4" containerName="registry" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.697822 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c\": container with ID starting with c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c not found: ID does not exist" containerID="c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697914 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-web" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697913 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c"} err="failed to get container status \"c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c\": rpc error: code = NotFound desc = could not find container \"c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c\": container with ID starting with c812b52ad1b906d7a3771a76bb8cc06ca1c41827a8bd435fcc78351c26718e4c not found: ID does not exist" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697921 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697926 2576 scope.go:117] "RemoveContainer" containerID="1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697928 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="alertmanager" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697977 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="config-reloader" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697986 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="kube-rbac-proxy-metric" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.697994 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" containerName="prom-label-proxy" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.698001 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="41a78995-550c-4fdd-8796-229ad75066a4" containerName="registry" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:38:39.698211 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4\": container with ID starting with 1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4 not found: ID does not exist" containerID="1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4" Sep 18 03:38:39.698270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.698237 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4"} err="failed to get container status \"1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4\": rpc error: code = NotFound desc = could not find container \"1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4\": container with ID starting with 1738c5c1de7ed7f27a9f7edaa88d66380282139ac4d00cff25106011626157b4 not found: ID does not exist" Sep 18 03:38:39.702950 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.702934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.705162 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 03:38:39.705251 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705213 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 03:38:39.705251 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705233 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 03:38:39.705615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705477 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 03:38:39.705615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 03:38:39.705615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705578 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 03:38:39.705615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 03:38:39.705841 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705632 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 03:38:39.705939 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.705922 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cdglx\"" Sep 18 03:38:39.710070 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.710047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 03:38:39.713648 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.713629 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:38:39.782305 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782305 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2vjw\" (UniqueName: \"kubernetes.io/projected/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-kube-api-access-j2vjw\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-web-config\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782813 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782813 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782813 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782813 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-config-out\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782813 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.782813 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.782738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-config-volume\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884129 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-web-config\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-config-out\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884288 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-config-volume\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.884640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2vjw\" (UniqueName: \"kubernetes.io/projected/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-kube-api-access-j2vjw\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.885077 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.884975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.885318 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.885254 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.885417 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.885383 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.887364 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.887340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-web-config\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.887479 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.887395 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-config-out\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.887479 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.887406 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.887570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.887495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.887849 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.887831 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-config-volume\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.887913 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.887864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.888128 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.888107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.888782 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.888764 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.888904 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.888887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:39.891562 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:39.891543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2vjw\" (UniqueName: \"kubernetes.io/projected/054d2a4d-3b52-4da6-b17f-8eb4d0aef54e-kube-api-access-j2vjw\") pod \"alertmanager-main-0\" (UID: \"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:40.012170 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:40.012131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:38:40.256363 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:40.256327 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a66919a-b539-46d3-a7e3-0d3995211fb2" path="/var/lib/kubelet/pods/1a66919a-b539-46d3-a7e3-0d3995211fb2/volumes" Sep 18 03:38:40.288726 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:40.288647 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:38:40.294990 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:38:40.294963 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054d2a4d_3b52_4da6_b17f_8eb4d0aef54e.slice/crio-adadf98504f2636626b7541c1f3f6daa1469e42884a491aa674fd9875082b21a WatchSource:0}: Error finding container adadf98504f2636626b7541c1f3f6daa1469e42884a491aa674fd9875082b21a: Status 404 returned error can't find the container with id adadf98504f2636626b7541c1f3f6daa1469e42884a491aa674fd9875082b21a Sep 18 03:38:40.654188 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:40.654101 2576 generic.go:356] "Generic (PLEG): container finished" podID="054d2a4d-3b52-4da6-b17f-8eb4d0aef54e" containerID="bea8cf8737935ae281d4659fdd155daa8c53ebad3c288d56013baa4c1fa9cbbd" exitCode=0 Sep 18 03:38:40.654547 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:40.654187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerDied","Data":"bea8cf8737935ae281d4659fdd155daa8c53ebad3c288d56013baa4c1fa9cbbd"} Sep 18 03:38:40.654547 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:40.654262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"adadf98504f2636626b7541c1f3f6daa1469e42884a491aa674fd9875082b21a"} Sep 18 03:38:41.662323 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.662288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"ada6ff01f82aeb8820c9a8b3421bfd0961bce0f46e6ac4cfc1bdef9ef569001d"} Sep 18 03:38:41.662711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.662369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"c3cffb50f68263ee6ce7821f4c959ff9741e5731a6de90b7565990ab80038db3"} Sep 18 03:38:41.662711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.662407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"3ae5523fad8e739e08093f950cbe894455500eafd10f6e1a7df62bc83d14af6f"} Sep 18 03:38:41.662711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.662445 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"427937568d1ed9172624a9745943f217e785ecb2b0fc1cf05829de6fc046f675"} Sep 18 03:38:41.662711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.662504 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"8b34d71ef258ca6ab6a8617d53a8564596aa425cdbdd349a2ecbef3ff7ef7507"} Sep 18 03:38:41.662711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.662540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"054d2a4d-3b52-4da6-b17f-8eb4d0aef54e","Type":"ContainerStarted","Data":"07352f91cffb61cea323f9bea88e0c247a96b3a2015944a1575558b47db621c6"} Sep 18 03:38:41.686516 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:41.686468 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.667942821 podStartE2EDuration="2.686436691s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.49387ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:38:41.685565053 +0000 UTC m=+363.954565014" watchObservedRunningTime="2026-09-18 03:38:41.686436691 +0000 UTC m=+363.955436658" Sep 18 03:38:45.626690 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:45.626646 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:45.727127 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:45.727088 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:46.789617 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:46.789581 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654fdd864d-g4gs6"] Sep 18 03:38:46.887640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:46.887599 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:46.942580 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:46.942551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:47.001603 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:47.001573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:48.458201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:48.458151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:52.185579 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:52.185532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:38:52.187926 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:52.187897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8db89550-fea8-45bf-b990-609ad2ec5648-metrics-certs\") pod \"network-metrics-daemon-gf592\" (UID: \"8db89550-fea8-45bf-b990-609ad2ec5648\") " pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:38:52.455612 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:52.455528 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6p5fh\"" Sep 18 03:38:52.463286 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:52.463266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gf592" Sep 18 03:38:52.729723 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:52.729692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gf592"] Sep 18 03:38:52.732992 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:38:52.732966 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db89550_fea8_45bf_b990_609ad2ec5648.slice/crio-2ddc2849422944e80e82e677025a2ed88990fc03f1d319b85805892a18d6af50 WatchSource:0}: Error finding container 2ddc2849422944e80e82e677025a2ed88990fc03f1d319b85805892a18d6af50: Status 404 returned error can't find the container with id 2ddc2849422944e80e82e677025a2ed88990fc03f1d319b85805892a18d6af50 Sep 18 03:38:52.735038 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:52.735019 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:38:53.717935 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:53.717897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gf592" event={"ID":"8db89550-fea8-45bf-b990-609ad2ec5648","Type":"ContainerStarted","Data":"2ddc2849422944e80e82e677025a2ed88990fc03f1d319b85805892a18d6af50"} Sep 18 03:38:54.723722 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:54.723683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gf592" event={"ID":"8db89550-fea8-45bf-b990-609ad2ec5648","Type":"ContainerStarted","Data":"843017cf6c89c7ce6fb5bf02bcb5d7fb02193f5a7b36a6fc2ba8f5fa2f9c8f43"} Sep 18 03:38:54.724096 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:54.723744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gf592" event={"ID":"8db89550-fea8-45bf-b990-609ad2ec5648","Type":"ContainerStarted","Data":"babea908e9017cef655a14fc95338613e3c2c89b03d036a3ac0e0647a14e424c"} Sep 18 03:38:54.739761 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:54.739714 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gf592" podStartSLOduration=375.637226638 podStartE2EDuration="6m16.739699132s" totalImagesPullingTime="1.102472494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:38:54.73780355 +0000 UTC m=+377.006803511" watchObservedRunningTime="2026-09-18 03:38:54.739699132 +0000 UTC m=+377.008699092" Sep 18 03:38:54.821331 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:54.821298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:54.879249 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:54.879218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:55.886894 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:55.886858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:55.948134 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:55.948094 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:56.707978 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:56.707941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:38:56.810995 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:38:56.810964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:11.809566 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:11.809521 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-654fdd864d-g4gs6" podUID="b7f06d1c-2eb5-4347-b83f-9fb62436109a" containerName="console" containerID="cri-o://327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b" gracePeriod=15 Sep 18 03:39:12.054828 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.054802 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:39:12.139809 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.139724 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-serving-cert\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.139809 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.139772 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-trusted-ca-bundle\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.139809 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.139816 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nfg6\" (UniqueName: \"kubernetes.io/projected/b7f06d1c-2eb5-4347-b83f-9fb62436109a-kube-api-access-7nfg6\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.140089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.139839 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-config\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.140089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.139856 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-oauth-config\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.140089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.139873 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-service-ca\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.140089 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140049 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-oauth-serving-cert\") pod \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\" (UID: \"b7f06d1c-2eb5-4347-b83f-9fb62436109a\") " Sep 18 03:39:12.140299 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140278 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:39:12.140352 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140297 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-config" (OuterVolumeSpecName: "console-config") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:39:12.140352 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140307 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:39:12.140469 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140373 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-service-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.140469 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140389 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-trusted-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.140469 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140403 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.140644 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.140622 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:39:12.142170 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.142153 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f06d1c-2eb5-4347-b83f-9fb62436109a-kube-api-access-7nfg6" (OuterVolumeSpecName: "kube-api-access-7nfg6") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "kube-api-access-7nfg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:39:12.142352 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.142328 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:39:12.142414 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.142351 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7f06d1c-2eb5-4347-b83f-9fb62436109a" (UID: "b7f06d1c-2eb5-4347-b83f-9fb62436109a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:39:12.241149 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.241111 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nfg6\" (UniqueName: \"kubernetes.io/projected/b7f06d1c-2eb5-4347-b83f-9fb62436109a-kube-api-access-7nfg6\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.241149 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.241140 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-oauth-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.241149 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.241149 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f06d1c-2eb5-4347-b83f-9fb62436109a-oauth-serving-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.241149 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.241157 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f06d1c-2eb5-4347-b83f-9fb62436109a-console-serving-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:39:12.794495 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.794441 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7f06d1c-2eb5-4347-b83f-9fb62436109a" containerID="327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b" exitCode=0 Sep 18 03:39:12.794664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.794507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654fdd864d-g4gs6" event={"ID":"b7f06d1c-2eb5-4347-b83f-9fb62436109a","Type":"ContainerDied","Data":"327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b"} Sep 18 03:39:12.794664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.794548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654fdd864d-g4gs6" event={"ID":"b7f06d1c-2eb5-4347-b83f-9fb62436109a","Type":"ContainerDied","Data":"d993a19cbbd46e43b88dedeb16e30abfc3ed1a3640faa8908137e7fa0ee15851"} Sep 18 03:39:12.794664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.794567 2576 scope.go:117] "RemoveContainer" containerID="327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b" Sep 18 03:39:12.794664 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.794510 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654fdd864d-g4gs6" Sep 18 03:39:12.802671 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.802652 2576 scope.go:117] "RemoveContainer" containerID="327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b" Sep 18 03:39:12.802916 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:39:12.802898 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b\": container with ID starting with 327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b not found: ID does not exist" containerID="327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b" Sep 18 03:39:12.802957 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.802923 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b"} err="failed to get container status \"327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b\": rpc error: code = NotFound desc = could not find container \"327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b\": container with ID starting with 327797ee6a9c91125c635d6ca2ab4903ac55a3511d7484118548d17676f7c73b not found: ID does not exist" Sep 18 03:39:12.809076 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.809055 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654fdd864d-g4gs6"] Sep 18 03:39:12.812876 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:12.812855 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-654fdd864d-g4gs6"] Sep 18 03:39:14.257054 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:14.257011 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7f06d1c-2eb5-4347-b83f-9fb62436109a" path="/var/lib/kubelet/pods/b7f06d1c-2eb5-4347-b83f-9fb62436109a/volumes" Sep 18 03:39:42.986588 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:42.986549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:43.082880 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:43.082846 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:49.846938 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:49.846901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:49.987972 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:49.987940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:50.074827 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.074795 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:50.758943 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.758909 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm"] Sep 18 03:39:50.759216 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.759204 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f06d1c-2eb5-4347-b83f-9fb62436109a" containerName="console" Sep 18 03:39:50.759265 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.759218 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f06d1c-2eb5-4347-b83f-9fb62436109a" containerName="console" Sep 18 03:39:50.759299 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.759267 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7f06d1c-2eb5-4347-b83f-9fb62436109a" containerName="console" Sep 18 03:39:50.763563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.763545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:50.766148 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.766115 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 03:39:50.766271 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.766164 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p89h2\"" Sep 18 03:39:50.766271 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.766242 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 03:39:50.773376 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.773354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm"] Sep 18 03:39:50.946760 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.946724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:50.947129 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.946764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:50.947129 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:50.946807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l64tc\" (UniqueName: \"kubernetes.io/projected/0c9f412a-0a60-41d5-b144-6caf6504ab2e-kube-api-access-l64tc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.048117 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.048026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l64tc\" (UniqueName: \"kubernetes.io/projected/0c9f412a-0a60-41d5-b144-6caf6504ab2e-kube-api-access-l64tc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.048303 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.048192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.048303 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.048221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.048680 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.048659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.048680 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.048674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.055865 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.055843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l64tc\" (UniqueName: \"kubernetes.io/projected/0c9f412a-0a60-41d5-b144-6caf6504ab2e-kube-api-access-l64tc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.072847 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.072823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:39:51.289111 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.289077 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4"] Sep 18 03:39:51.292506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.292489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.295161 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.295136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 18 03:39:51.295161 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.295152 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q4cff\"" Sep 18 03:39:51.295337 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.295163 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 03:39:51.295396 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.295377 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 03:39:51.295550 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.295532 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 03:39:51.296078 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.296060 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 18 03:39:51.296170 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.296063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 18 03:39:51.298386 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.298331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:51.302965 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.302946 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4"] Sep 18 03:39:51.339567 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.339540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm"] Sep 18 03:39:51.342364 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:39:51.342342 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9f412a_0a60_41d5_b144_6caf6504ab2e.slice/crio-d32bcada345aa0bee25aa864767681b9abb35ab2df9b38e5adf8b9bb43f3b44f WatchSource:0}: Error finding container d32bcada345aa0bee25aa864767681b9abb35ab2df9b38e5adf8b9bb43f3b44f: Status 404 returned error can't find the container with id d32bcada345aa0bee25aa864767681b9abb35ab2df9b38e5adf8b9bb43f3b44f Sep 18 03:39:51.384910 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.384871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:51.451868 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.451833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.452027 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.451873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.452027 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.451985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwlt\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-kube-api-access-wjwlt\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.452027 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.452022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.452147 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.452050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.452147 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.452072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.452147 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.452095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.552942 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.552860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.552942 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.552899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.552942 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.552925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.553196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.552968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.553196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.552999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.553196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.553050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwlt\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-kube-api-access-wjwlt\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.553196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.553072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.553594 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.553561 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.555419 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.555394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.555561 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.555496 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.555561 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.555518 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.555648 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.555605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.565266 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.565240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwlt\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-kube-api-access-wjwlt\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.565386 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.565371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-c29v4\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.603105 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.603082 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:51.873525 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.873366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4"] Sep 18 03:39:51.875522 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:39:51.875496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ab1c8f_822d_4f9b_bb06_bd35cc6acc63.slice/crio-7569b6567221532294ada9de39bbf64c20659054ed15821bc953d1334645ad1c WatchSource:0}: Error finding container 7569b6567221532294ada9de39bbf64c20659054ed15821bc953d1334645ad1c: Status 404 returned error can't find the container with id 7569b6567221532294ada9de39bbf64c20659054ed15821bc953d1334645ad1c Sep 18 03:39:51.947659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.947621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" event={"ID":"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63","Type":"ContainerStarted","Data":"7569b6567221532294ada9de39bbf64c20659054ed15821bc953d1334645ad1c"} Sep 18 03:39:51.948959 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:51.948927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" event={"ID":"0c9f412a-0a60-41d5-b144-6caf6504ab2e","Type":"ContainerStarted","Data":"d32bcada345aa0bee25aa864767681b9abb35ab2df9b38e5adf8b9bb43f3b44f"} Sep 18 03:39:52.175413 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:52.175325 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:54.621839 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:54.621787 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 03:39:54.622201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:54.621880 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 03:39:54.966177 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:54.966085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" event={"ID":"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63","Type":"ContainerStarted","Data":"59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389"} Sep 18 03:39:54.966356 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:54.966196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:54.984732 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:54.984673 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" podStartSLOduration=1.241096881 podStartE2EDuration="3.984654708s" totalImagesPullingTime="2.743557827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:39:54.983638068 +0000 UTC m=+437.252638118" watchObservedRunningTime="2026-09-18 03:39:54.984654708 +0000 UTC m=+437.253654670" Sep 18 03:39:55.636318 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:55.636273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:55.737648 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:55.737609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:55.974136 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:55.974097 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-c29v4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 18 03:39:55.974327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:55.974177 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" podUID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 03:39:56.417912 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:56.417858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:56.489909 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:56.489875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:56.551612 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:56.551526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:57.982463 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:57.982416 2576 generic.go:356] "Generic (PLEG): container finished" podID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerID="8aeccc3b4c228d219be1769d0b655c9e2bfd82bc3256c1ccc73a090c68da13d4" exitCode=0 Sep 18 03:39:57.982802 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:57.982507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" event={"ID":"0c9f412a-0a60-41d5-b144-6caf6504ab2e","Type":"ContainerDied","Data":"8aeccc3b4c228d219be1769d0b655c9e2bfd82bc3256c1ccc73a090c68da13d4"} Sep 18 03:39:58.973578 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:58.973544 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:39:59.519500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:59.519441 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:39:59.578698 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:39:59.578651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:00.998021 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:00.997981 2576 generic.go:356] "Generic (PLEG): container finished" podID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerID="395d06dae808d08b4f015ac81f831c6e7e7ed153a99be89cd11952753dfa4f94" exitCode=0 Sep 18 03:40:00.998373 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:00.998028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" event={"ID":"0c9f412a-0a60-41d5-b144-6caf6504ab2e","Type":"ContainerDied","Data":"395d06dae808d08b4f015ac81f831c6e7e7ed153a99be89cd11952753dfa4f94"} Sep 18 03:40:02.841920 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:02.841884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:08.030053 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:08.030019 2576 generic.go:356] "Generic (PLEG): container finished" podID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerID="2cce4c26b75003b361a8613993c13ebc52e467d9d73be53d992038bceca1d3ee" exitCode=0 Sep 18 03:40:08.030444 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:08.030103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" event={"ID":"0c9f412a-0a60-41d5-b144-6caf6504ab2e","Type":"ContainerDied","Data":"2cce4c26b75003b361a8613993c13ebc52e467d9d73be53d992038bceca1d3ee"} Sep 18 03:40:09.215673 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.215637 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:40:09.305270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.305191 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l64tc\" (UniqueName: \"kubernetes.io/projected/0c9f412a-0a60-41d5-b144-6caf6504ab2e-kube-api-access-l64tc\") pod \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " Sep 18 03:40:09.305408 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.305283 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-bundle\") pod \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " Sep 18 03:40:09.305408 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.305324 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-util\") pod \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\" (UID: \"0c9f412a-0a60-41d5-b144-6caf6504ab2e\") " Sep 18 03:40:09.305988 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.305960 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-bundle" (OuterVolumeSpecName: "bundle") pod "0c9f412a-0a60-41d5-b144-6caf6504ab2e" (UID: "0c9f412a-0a60-41d5-b144-6caf6504ab2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:09.307457 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.307429 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9f412a-0a60-41d5-b144-6caf6504ab2e-kube-api-access-l64tc" (OuterVolumeSpecName: "kube-api-access-l64tc") pod "0c9f412a-0a60-41d5-b144-6caf6504ab2e" (UID: "0c9f412a-0a60-41d5-b144-6caf6504ab2e"). InnerVolumeSpecName "kube-api-access-l64tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:40:09.309731 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.309709 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-util" (OuterVolumeSpecName: "util") pod "0c9f412a-0a60-41d5-b144-6caf6504ab2e" (UID: "0c9f412a-0a60-41d5-b144-6caf6504ab2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:40:09.406502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.406469 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:40:09.406502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.406496 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9f412a-0a60-41d5-b144-6caf6504ab2e-util\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:40:09.406502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:09.406506 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l64tc\" (UniqueName: \"kubernetes.io/projected/0c9f412a-0a60-41d5-b144-6caf6504ab2e-kube-api-access-l64tc\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:40:10.040187 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:10.040156 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" Sep 18 03:40:10.040187 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:10.040169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407wqpm" event={"ID":"0c9f412a-0a60-41d5-b144-6caf6504ab2e","Type":"ContainerDied","Data":"d32bcada345aa0bee25aa864767681b9abb35ab2df9b38e5adf8b9bb43f3b44f"} Sep 18 03:40:10.040403 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:10.040212 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d32bcada345aa0bee25aa864767681b9abb35ab2df9b38e5adf8b9bb43f3b44f" Sep 18 03:40:12.181912 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:12.181872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:13.000328 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:13.000295 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:16.797438 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:16.797393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:16.852735 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:16.852703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:19.661135 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:19.661095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:19.767775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:19.767739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:22.042466 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:22.042418 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:22.248570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:22.248532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:22.838496 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:22.838438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:22.937958 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:22.937921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:23.395367 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:23.395340 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:23.548296 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:23.548247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:23.653792 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:23.653709 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:24.521892 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.521861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:24.671742 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.671710 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h"] Sep 18 03:40:24.672194 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672170 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="util" Sep 18 03:40:24.672313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672195 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="util" Sep 18 03:40:24.672313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672217 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="pull" Sep 18 03:40:24.672313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672231 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="pull" Sep 18 03:40:24.672313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672264 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="extract" Sep 18 03:40:24.672313 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672272 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="extract" Sep 18 03:40:24.672562 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.672368 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c9f412a-0a60-41d5-b144-6caf6504ab2e" containerName="extract" Sep 18 03:40:24.676705 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.676689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.679309 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.679274 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-pvhrl\"" Sep 18 03:40:24.679415 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.679275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 18 03:40:24.679415 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.679322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 03:40:24.679415 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.679346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 03:40:24.679415 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.679356 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 03:40:24.679687 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.679673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 18 03:40:24.692352 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.692327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h"] Sep 18 03:40:24.731861 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.731830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgwzz\" (UniqueName: \"kubernetes.io/projected/8ef9f742-2ed7-4299-9361-f162f5240552-kube-api-access-zgwzz\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.731969 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.731865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.731969 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.731884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef9f742-2ed7-4299-9361-f162f5240552-tmp\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.731969 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.731909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ef9f742-2ed7-4299-9361-f162f5240552-manifests\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.732072 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.731965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.732072 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.731998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-metrics-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.822136 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.822065 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:24.833025 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ef9f742-2ed7-4299-9361-f162f5240552-manifests\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.833120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.833120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-metrics-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.833120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgwzz\" (UniqueName: \"kubernetes.io/projected/8ef9f742-2ed7-4299-9361-f162f5240552-kube-api-access-zgwzz\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.833120 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.833295 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef9f742-2ed7-4299-9361-f162f5240552-tmp\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.833434 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.833415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ef9f742-2ed7-4299-9361-f162f5240552-manifests\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.835446 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.835416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef9f742-2ed7-4299-9361-f162f5240552-tmp\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.835669 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.835653 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.835711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.835687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.835761 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.835747 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ef9f742-2ed7-4299-9361-f162f5240552-metrics-cert\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.840766 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.840747 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgwzz\" (UniqueName: \"kubernetes.io/projected/8ef9f742-2ed7-4299-9361-f162f5240552-kube-api-access-zgwzz\") pod \"opendatahub-operator-controller-manager-7b6444b484-bqt7h\" (UID: \"8ef9f742-2ed7-4299-9361-f162f5240552\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:24.919676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.919643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:24.987667 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:24.987642 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:25.021549 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:25.021510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:25.120672 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:25.120589 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:25.269040 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:25.267851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h"] Sep 18 03:40:25.269954 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:40:25.269921 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef9f742_2ed7_4299_9361_f162f5240552.slice/crio-a3ddd25820bde34afc84685e7a27fc20ae45c2ac58a630c8664e3a53dfe5344b WatchSource:0}: Error finding container a3ddd25820bde34afc84685e7a27fc20ae45c2ac58a630c8664e3a53dfe5344b: Status 404 returned error can't find the container with id a3ddd25820bde34afc84685e7a27fc20ae45c2ac58a630c8664e3a53dfe5344b Sep 18 03:40:26.106885 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:26.106801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" event={"ID":"8ef9f742-2ed7-4299-9361-f162f5240552","Type":"ContainerStarted","Data":"a3ddd25820bde34afc84685e7a27fc20ae45c2ac58a630c8664e3a53dfe5344b"} Sep 18 03:40:28.444496 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:28.444390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:28.542929 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:28.542900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:29.122371 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:29.122342 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef9f742-2ed7-4299-9361-f162f5240552" containerID="064e0e641b25c09a6c1fb288195f1f7d1f793077a37397fc1c3c9c989ca011cf" exitCode=0 Sep 18 03:40:29.122575 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:29.122435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" event={"ID":"8ef9f742-2ed7-4299-9361-f162f5240552","Type":"ContainerDied","Data":"064e0e641b25c09a6c1fb288195f1f7d1f793077a37397fc1c3c9c989ca011cf"} Sep 18 03:40:29.457642 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:29.457558 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:29.611617 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:29.611581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:30.129282 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:30.129247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" event={"ID":"8ef9f742-2ed7-4299-9361-f162f5240552","Type":"ContainerStarted","Data":"d076c54e8dada867e9014d79c3d34db62eee999bb6e55894c3934d332506e7ec"} Sep 18 03:40:30.129514 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:30.129368 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:30.157351 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:30.157298 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" podStartSLOduration=2.413198317 podStartE2EDuration="6.157284126s" totalImagesPullingTime="3.189099155s" totalInitContainerRuntime="554.986654ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:30.15544051 +0000 UTC m=+472.424440473" watchObservedRunningTime="2026-09-18 03:40:30.157284126 +0000 UTC m=+472.426284087" Sep 18 03:40:35.985911 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:35.985876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:36.488097 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:36.488056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:36.921853 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:36.921772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:37.022708 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:37.022672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:37.122392 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:37.122354 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:38.914869 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:38.914829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:39.017802 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:39.017768 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:41.136099 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:41.136067 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7b6444b484-bqt7h" Sep 18 03:40:41.591051 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:41.591016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:42.193270 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:42.193237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:42.789182 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:42.789140 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:46.610832 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:46.610796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:47.611356 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:47.611319 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:48.701852 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:48.701808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:48.836894 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:48.836859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:48.961565 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:48.961479 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:49.001790 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.001758 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h"] Sep 18 03:40:49.007878 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.007845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.010412 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.010388 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 03:40:49.010412 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.010390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 03:40:49.011198 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.011183 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qwfpf\"" Sep 18 03:40:49.016006 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.015982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h"] Sep 18 03:40:49.060175 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.060138 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:49.148889 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.148830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634221d0-d3be-400b-91c3-faa19f4bf464-tmp\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.148889 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.148883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634221d0-d3be-400b-91c3-faa19f4bf464-tls-certs\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.149141 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.148938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzcb\" (UniqueName: \"kubernetes.io/projected/634221d0-d3be-400b-91c3-faa19f4bf464-kube-api-access-bxzcb\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.192011 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.191972 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:49.249393 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.249362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634221d0-d3be-400b-91c3-faa19f4bf464-tmp\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.249622 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.249398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634221d0-d3be-400b-91c3-faa19f4bf464-tls-certs\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.249622 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.249439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzcb\" (UniqueName: \"kubernetes.io/projected/634221d0-d3be-400b-91c3-faa19f4bf464-kube-api-access-bxzcb\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.249622 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:40:49.249573 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 18 03:40:49.249838 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:40:49.249661 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634221d0-d3be-400b-91c3-faa19f4bf464-tls-certs podName:634221d0-d3be-400b-91c3-faa19f4bf464 nodeName:}" failed. No retries permitted until 2026-09-18 03:40:49.749639434 +0000 UTC m=+492.018639391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/634221d0-d3be-400b-91c3-faa19f4bf464-tls-certs") pod "kube-auth-proxy-7c6dc6c678-krt6h" (UID: "634221d0-d3be-400b-91c3-faa19f4bf464") : secret "kube-auth-proxy-tls" not found Sep 18 03:40:49.251890 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.251861 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634221d0-d3be-400b-91c3-faa19f4bf464-tmp\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.258407 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.258379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzcb\" (UniqueName: \"kubernetes.io/projected/634221d0-d3be-400b-91c3-faa19f4bf464-kube-api-access-bxzcb\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.401708 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.401663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:49.710052 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.709973 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:49.752901 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.752867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634221d0-d3be-400b-91c3-faa19f4bf464-tls-certs\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.755458 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.755424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634221d0-d3be-400b-91c3-faa19f4bf464-tls-certs\") pod \"kube-auth-proxy-7c6dc6c678-krt6h\" (UID: \"634221d0-d3be-400b-91c3-faa19f4bf464\") " pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.863900 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.863860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:49.918710 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.918673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" Sep 18 03:40:49.940042 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:49.940005 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:50.146563 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.146525 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8btz4"] Sep 18 03:40:50.151151 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.151126 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.153660 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.153639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 18 03:40:50.153782 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.153640 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 18 03:40:50.154478 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.154444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-p7vcn\"" Sep 18 03:40:50.154571 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.154442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 18 03:40:50.155586 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.155562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6x9\" (UniqueName: \"kubernetes.io/projected/5e3d3df2-e819-4799-859d-fd7a6366786c-kube-api-access-4d6x9\") pod \"postgres-69fb4594cf-8btz4\" (UID: \"5e3d3df2-e819-4799-859d-fd7a6366786c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.155690 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.155605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5e3d3df2-e819-4799-859d-fd7a6366786c-data\") pod \"postgres-69fb4594cf-8btz4\" (UID: \"5e3d3df2-e819-4799-859d-fd7a6366786c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.159851 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.159662 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8btz4"] Sep 18 03:40:50.183954 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.183927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:50.193797 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.193775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h"] Sep 18 03:40:50.196182 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:40:50.196156 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634221d0_d3be_400b_91c3_faa19f4bf464.slice/crio-0ae406135a509f21298761ee629fada3d3eefb17fd024ab3b98238e718b2b647 WatchSource:0}: Error finding container 0ae406135a509f21298761ee629fada3d3eefb17fd024ab3b98238e718b2b647: Status 404 returned error can't find the container with id 0ae406135a509f21298761ee629fada3d3eefb17fd024ab3b98238e718b2b647 Sep 18 03:40:50.218663 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.218637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" event={"ID":"634221d0-d3be-400b-91c3-faa19f4bf464","Type":"ContainerStarted","Data":"0ae406135a509f21298761ee629fada3d3eefb17fd024ab3b98238e718b2b647"} Sep 18 03:40:50.256585 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.256550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6x9\" (UniqueName: \"kubernetes.io/projected/5e3d3df2-e819-4799-859d-fd7a6366786c-kube-api-access-4d6x9\") pod \"postgres-69fb4594cf-8btz4\" (UID: \"5e3d3df2-e819-4799-859d-fd7a6366786c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.256756 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.256604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5e3d3df2-e819-4799-859d-fd7a6366786c-data\") pod \"postgres-69fb4594cf-8btz4\" (UID: \"5e3d3df2-e819-4799-859d-fd7a6366786c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.257026 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.257008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5e3d3df2-e819-4799-859d-fd7a6366786c-data\") pod \"postgres-69fb4594cf-8btz4\" (UID: \"5e3d3df2-e819-4799-859d-fd7a6366786c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.269995 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.269963 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6x9\" (UniqueName: \"kubernetes.io/projected/5e3d3df2-e819-4799-859d-fd7a6366786c-kube-api-access-4d6x9\") pod \"postgres-69fb4594cf-8btz4\" (UID: \"5e3d3df2-e819-4799-859d-fd7a6366786c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.323556 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.323521 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:50.464069 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.464031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:50.600504 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.600444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:50.754919 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.754795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8btz4"] Sep 18 03:40:50.757572 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:40:50.757542 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3d3df2_e819_4799_859d_fd7a6366786c.slice/crio-a7b3006fe513e1c32b44df975e43d59ca0c18978191e27adeda8cbb2b16070e4 WatchSource:0}: Error finding container a7b3006fe513e1c32b44df975e43d59ca0c18978191e27adeda8cbb2b16070e4: Status 404 returned error can't find the container with id a7b3006fe513e1c32b44df975e43d59ca0c18978191e27adeda8cbb2b16070e4 Sep 18 03:40:50.888163 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:50.888080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:51.227557 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:51.227470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" event={"ID":"5e3d3df2-e819-4799-859d-fd7a6366786c","Type":"ContainerStarted","Data":"a7b3006fe513e1c32b44df975e43d59ca0c18978191e27adeda8cbb2b16070e4"} Sep 18 03:40:53.240915 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:53.240878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" event={"ID":"634221d0-d3be-400b-91c3-faa19f4bf464","Type":"ContainerStarted","Data":"6c27e2ed4553d004039fa6a8bc38ec7a8f085cb33c416d09d74f7ba4cd33e4bd"} Sep 18 03:40:53.258034 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:53.257979 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c6dc6c678-krt6h" podStartSLOduration=2.851733436 podStartE2EDuration="5.257961228s" totalImagesPullingTime="2.406227792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:53.256660443 +0000 UTC m=+495.525660407" watchObservedRunningTime="2026-09-18 03:40:53.257961228 +0000 UTC m=+495.526961190" Sep 18 03:40:55.109794 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:55.109756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:55.221310 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:55.221256 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:55.310418 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:55.310382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:56.258174 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:56.258139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" event={"ID":"5e3d3df2-e819-4799-859d-fd7a6366786c","Type":"ContainerStarted","Data":"c9556800ad523a107032fdba57bfa996f3ba84b3060f2bfaad6f2f9079456956"} Sep 18 03:40:56.258621 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:56.258279 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:40:56.274723 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:56.274678 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" podStartSLOduration=1.248336949 podStartE2EDuration="6.274665918s" totalImagesPullingTime="5.026328969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:40:56.27246687 +0000 UTC m=+498.541466824" watchObservedRunningTime="2026-09-18 03:40:56.274665918 +0000 UTC m=+498.543665928" Sep 18 03:40:57.237333 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:57.237295 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:57.298638 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:57.298601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:58.228860 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:58.228828 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:59.336203 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:59.336173 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:59.435267 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:59.435230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:40:59.728623 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:40:59.728589 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:01.228575 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:01.228539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:02.290107 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:02.290077 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8btz4" Sep 18 03:41:02.648051 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:02.647961 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:05.116216 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:05.116179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:05.216371 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:05.216327 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:07.009353 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.009315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:07.036492 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.036443 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6779565bf9-dtqlj"] Sep 18 03:41:07.040315 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.040295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.042743 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.042717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 18 03:41:07.042858 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.042739 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 03:41:07.042858 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.042766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 18 03:41:07.043519 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.043503 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 18 03:41:07.043519 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.043516 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5vwf\"" Sep 18 03:41:07.043637 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.043504 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 03:41:07.048667 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.048603 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6779565bf9-dtqlj"] Sep 18 03:41:07.104949 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.104919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjx2f\" (UniqueName: \"kubernetes.io/projected/1ea92f66-a53c-429e-8a56-562b2b4cef3e-kube-api-access-wjx2f\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.105114 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.104962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.105114 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.104997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-webhook-cert\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.113179 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.113151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:07.206208 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.206166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-webhook-cert\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.206414 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.206227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjx2f\" (UniqueName: \"kubernetes.io/projected/1ea92f66-a53c-429e-8a56-562b2b4cef3e-kube-api-access-wjx2f\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.206414 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.206257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.206414 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:41:07.206350 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 18 03:41:07.206414 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:41:07.206412 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs podName:1ea92f66-a53c-429e-8a56-562b2b4cef3e nodeName:}" failed. No retries permitted until 2026-09-18 03:41:07.706395897 +0000 UTC m=+509.975395836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs") pod "maas-controller-6779565bf9-dtqlj" (UID: "1ea92f66-a53c-429e-8a56-562b2b4cef3e") : secret "maas-controller-metrics-tls" not found Sep 18 03:41:07.208919 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.208890 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-webhook-cert\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.210171 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.210148 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55cc95c545-szljv"] Sep 18 03:41:07.212591 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.212565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:07.213423 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.213403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.225073 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.225049 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjx2f\" (UniqueName: \"kubernetes.io/projected/1ea92f66-a53c-429e-8a56-562b2b4cef3e-kube-api-access-wjx2f\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.226525 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.226500 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55cc95c545-szljv"] Sep 18 03:41:07.307028 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.306918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d5a1ade-1c65-49c6-a7e9-b65d07092951-metrics-certs\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.307028 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.306978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d5a1ade-1c65-49c6-a7e9-b65d07092951-webhook-cert\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.307274 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.307098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt6pd\" (UniqueName: \"kubernetes.io/projected/4d5a1ade-1c65-49c6-a7e9-b65d07092951-kube-api-access-wt6pd\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.408551 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.408514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d5a1ade-1c65-49c6-a7e9-b65d07092951-webhook-cert\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.408724 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.408601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt6pd\" (UniqueName: \"kubernetes.io/projected/4d5a1ade-1c65-49c6-a7e9-b65d07092951-kube-api-access-wt6pd\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.408724 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.408648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d5a1ade-1c65-49c6-a7e9-b65d07092951-metrics-certs\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.411009 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.410983 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d5a1ade-1c65-49c6-a7e9-b65d07092951-webhook-cert\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.411130 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.411074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d5a1ade-1c65-49c6-a7e9-b65d07092951-metrics-certs\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.417045 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.417018 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt6pd\" (UniqueName: \"kubernetes.io/projected/4d5a1ade-1c65-49c6-a7e9-b65d07092951-kube-api-access-wt6pd\") pod \"maas-controller-55cc95c545-szljv\" (UID: \"4d5a1ade-1c65-49c6-a7e9-b65d07092951\") " pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.436315 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.436283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:07.526677 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.526643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:07.710703 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.710666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.712997 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.712975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs\") pod \"maas-controller-6779565bf9-dtqlj\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:07.796788 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.796764 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55cc95c545-szljv"] Sep 18 03:41:07.799227 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:07.799202 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5a1ade_1c65_49c6_a7e9_b65d07092951.slice/crio-345b31a8746a56f352d7a6b2b5136ed9cd8d16d94f7e3155f192cae9879109cc WatchSource:0}: Error finding container 345b31a8746a56f352d7a6b2b5136ed9cd8d16d94f7e3155f192cae9879109cc: Status 404 returned error can't find the container with id 345b31a8746a56f352d7a6b2b5136ed9cd8d16d94f7e3155f192cae9879109cc Sep 18 03:41:07.953421 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:07.953337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:08.222255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:08.222232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6779565bf9-dtqlj"] Sep 18 03:41:08.224197 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:08.224170 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea92f66_a53c_429e_8a56_562b2b4cef3e.slice/crio-23b69e3a3a63d466044b146e78dea4df0fea96a4ec6aefbabe354d99a2319886 WatchSource:0}: Error finding container 23b69e3a3a63d466044b146e78dea4df0fea96a4ec6aefbabe354d99a2319886: Status 404 returned error can't find the container with id 23b69e3a3a63d466044b146e78dea4df0fea96a4ec6aefbabe354d99a2319886 Sep 18 03:41:08.316301 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:08.316248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55cc95c545-szljv" event={"ID":"4d5a1ade-1c65-49c6-a7e9-b65d07092951","Type":"ContainerStarted","Data":"345b31a8746a56f352d7a6b2b5136ed9cd8d16d94f7e3155f192cae9879109cc"} Sep 18 03:41:08.317569 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:08.317536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6779565bf9-dtqlj" event={"ID":"1ea92f66-a53c-429e-8a56-562b2b4cef3e","Type":"ContainerStarted","Data":"23b69e3a3a63d466044b146e78dea4df0fea96a4ec6aefbabe354d99a2319886"} Sep 18 03:41:09.603731 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:09.603685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:09.704979 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:09.704938 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:10.562912 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:10.562873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:10.658801 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:10.658707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:11.336130 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:11.336091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6779565bf9-dtqlj" event={"ID":"1ea92f66-a53c-429e-8a56-562b2b4cef3e","Type":"ContainerStarted","Data":"4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5"} Sep 18 03:41:11.336348 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:11.336160 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:11.337689 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:11.337665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55cc95c545-szljv" event={"ID":"4d5a1ade-1c65-49c6-a7e9-b65d07092951","Type":"ContainerStarted","Data":"200d81e88111e3430b2ac4311b71aa33112bebda21a7e50980b30226cce372ee"} Sep 18 03:41:11.337806 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:11.337790 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:11.359615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:11.359569 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6779565bf9-dtqlj" podStartSLOduration=2.213668239 podStartE2EDuration="4.35955605s" totalImagesPullingTime="2.145887811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:11.357425453 +0000 UTC m=+513.626425413" watchObservedRunningTime="2026-09-18 03:41:11.35955605 +0000 UTC m=+513.628556012" Sep 18 03:41:11.380788 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:11.380742 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55cc95c545-szljv" podStartSLOduration=1.8193311429999999 podStartE2EDuration="4.380728551s" totalImagesPullingTime="2.561397408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:11.379491744 +0000 UTC m=+513.648491717" watchObservedRunningTime="2026-09-18 03:41:11.380728551 +0000 UTC m=+513.649728541" Sep 18 03:41:13.607947 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:13.607912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:13.710831 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:13.710801 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:16.197741 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:16.197709 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:16.301602 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:16.301568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:16.638301 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:16.638247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:16.748094 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:16.748058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:21.543477 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:21.543428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:21.642877 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:21.642839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:21.741932 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:21.741896 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:22.343277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.343247 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:22.343507 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.343326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55cc95c545-szljv" Sep 18 03:41:22.407723 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.407688 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6779565bf9-dtqlj"] Sep 18 03:41:22.408246 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.408181 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6779565bf9-dtqlj" podUID="1ea92f66-a53c-429e-8a56-562b2b4cef3e" containerName="manager" containerID="cri-o://4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5" gracePeriod=30 Sep 18 03:41:22.647401 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.647378 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:22.741960 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.741925 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs\") pod \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " Sep 18 03:41:22.741960 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.741962 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjx2f\" (UniqueName: \"kubernetes.io/projected/1ea92f66-a53c-429e-8a56-562b2b4cef3e-kube-api-access-wjx2f\") pod \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " Sep 18 03:41:22.742214 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.741994 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-webhook-cert\") pod \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\" (UID: \"1ea92f66-a53c-429e-8a56-562b2b4cef3e\") " Sep 18 03:41:22.744201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.744167 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1ea92f66-a53c-429e-8a56-562b2b4cef3e" (UID: "1ea92f66-a53c-429e-8a56-562b2b4cef3e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:41:22.744201 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.744184 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ea92f66-a53c-429e-8a56-562b2b4cef3e" (UID: "1ea92f66-a53c-429e-8a56-562b2b4cef3e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:41:22.744349 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.744207 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea92f66-a53c-429e-8a56-562b2b4cef3e-kube-api-access-wjx2f" (OuterVolumeSpecName: "kube-api-access-wjx2f") pod "1ea92f66-a53c-429e-8a56-562b2b4cef3e" (UID: "1ea92f66-a53c-429e-8a56-562b2b4cef3e"). InnerVolumeSpecName "kube-api-access-wjx2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:41:22.843144 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.843112 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-metrics-certs\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:22.843144 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.843139 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjx2f\" (UniqueName: \"kubernetes.io/projected/1ea92f66-a53c-429e-8a56-562b2b4cef3e-kube-api-access-wjx2f\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:22.843144 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:22.843150 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea92f66-a53c-429e-8a56-562b2b4cef3e-webhook-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:23.392061 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.392023 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ea92f66-a53c-429e-8a56-562b2b4cef3e" containerID="4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5" exitCode=0 Sep 18 03:41:23.392255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.392070 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6779565bf9-dtqlj" Sep 18 03:41:23.392255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.392101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6779565bf9-dtqlj" event={"ID":"1ea92f66-a53c-429e-8a56-562b2b4cef3e","Type":"ContainerDied","Data":"4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5"} Sep 18 03:41:23.392255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.392150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6779565bf9-dtqlj" event={"ID":"1ea92f66-a53c-429e-8a56-562b2b4cef3e","Type":"ContainerDied","Data":"23b69e3a3a63d466044b146e78dea4df0fea96a4ec6aefbabe354d99a2319886"} Sep 18 03:41:23.392255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.392172 2576 scope.go:117] "RemoveContainer" containerID="4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5" Sep 18 03:41:23.400947 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.400927 2576 scope.go:117] "RemoveContainer" containerID="4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5" Sep 18 03:41:23.401190 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:41:23.401174 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5\": container with ID starting with 4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5 not found: ID does not exist" containerID="4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5" Sep 18 03:41:23.401241 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.401197 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5"} err="failed to get container status \"4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5\": rpc error: code = NotFound desc = could not find container \"4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5\": container with ID starting with 4d5d954bdb865f7f6d0b761afd8bf16994f99ad9bb4f175fa2344337b81ed5d5 not found: ID does not exist" Sep 18 03:41:23.411592 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.411565 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6779565bf9-dtqlj"] Sep 18 03:41:23.415948 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:23.415924 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6779565bf9-dtqlj"] Sep 18 03:41:24.257188 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:24.257152 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea92f66-a53c-429e-8a56-562b2b4cef3e" path="/var/lib/kubelet/pods/1ea92f66-a53c-429e-8a56-562b2b4cef3e/volumes" Sep 18 03:41:28.023389 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:28.023344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:28.123790 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:28.123755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:32.765286 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:32.765208 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:32.866467 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:32.866424 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:33.586273 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.586211 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:33.645878 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.645841 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz"] Sep 18 03:41:33.646226 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.646210 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea92f66-a53c-429e-8a56-562b2b4cef3e" containerName="manager" Sep 18 03:41:33.646304 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.646227 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea92f66-a53c-429e-8a56-562b2b4cef3e" containerName="manager" Sep 18 03:41:33.646304 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.646294 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea92f66-a53c-429e-8a56-562b2b4cef3e" containerName="manager" Sep 18 03:41:33.649316 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.649294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.651720 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.651691 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 18 03:41:33.651825 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.651699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4cd2s\"" Sep 18 03:41:33.651825 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.651793 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 03:41:33.652443 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.652424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 18 03:41:33.652557 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.652429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 03:41:33.657818 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.657795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz"] Sep 18 03:41:33.661289 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.661267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:33.762747 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.762679 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:33.838510 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.838413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/842593c1-151c-45ea-a617-93eaed6191b2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.838844 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.838511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz7ww\" (UniqueName: \"kubernetes.io/projected/842593c1-151c-45ea-a617-93eaed6191b2-kube-api-access-fz7ww\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.838844 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.838542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/842593c1-151c-45ea-a617-93eaed6191b2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.882917 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.882874 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:41:33.886273 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.886252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:33.888547 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.888525 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 18 03:41:33.894953 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.894931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:41:33.924311 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.924283 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:41:33.939975 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.939946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/842593c1-151c-45ea-a617-93eaed6191b2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.940080 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.940001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz7ww\" (UniqueName: \"kubernetes.io/projected/842593c1-151c-45ea-a617-93eaed6191b2-kube-api-access-fz7ww\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.940080 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.940038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/842593c1-151c-45ea-a617-93eaed6191b2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.940676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.940655 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/842593c1-151c-45ea-a617-93eaed6191b2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.942347 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.942330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/842593c1-151c-45ea-a617-93eaed6191b2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.947143 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.947122 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz7ww\" (UniqueName: \"kubernetes.io/projected/842593c1-151c-45ea-a617-93eaed6191b2-kube-api-access-fz7ww\") pod \"kuadrant-console-plugin-fbdd4f445-llzhz\" (UID: \"842593c1-151c-45ea-a617-93eaed6191b2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.960607 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.960586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" Sep 18 03:41:33.969466 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:33.969431 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:34.041242 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.041194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0ef4c223-20b9-4102-b0c5-250f1cc361c5-config-file\") pod \"limitador-limitador-84994f7ffc-z2k7x\" (UID: \"0ef4c223-20b9-4102-b0c5-250f1cc361c5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.041504 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.041422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns4w7\" (UniqueName: \"kubernetes.io/projected/0ef4c223-20b9-4102-b0c5-250f1cc361c5-kube-api-access-ns4w7\") pod \"limitador-limitador-84994f7ffc-z2k7x\" (UID: \"0ef4c223-20b9-4102-b0c5-250f1cc361c5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.142936 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.142848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns4w7\" (UniqueName: \"kubernetes.io/projected/0ef4c223-20b9-4102-b0c5-250f1cc361c5-kube-api-access-ns4w7\") pod \"limitador-limitador-84994f7ffc-z2k7x\" (UID: \"0ef4c223-20b9-4102-b0c5-250f1cc361c5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.142936 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.142904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0ef4c223-20b9-4102-b0c5-250f1cc361c5-config-file\") pod \"limitador-limitador-84994f7ffc-z2k7x\" (UID: \"0ef4c223-20b9-4102-b0c5-250f1cc361c5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.143511 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.143492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0ef4c223-20b9-4102-b0c5-250f1cc361c5-config-file\") pod \"limitador-limitador-84994f7ffc-z2k7x\" (UID: \"0ef4c223-20b9-4102-b0c5-250f1cc361c5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.150437 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.150418 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns4w7\" (UniqueName: \"kubernetes.io/projected/0ef4c223-20b9-4102-b0c5-250f1cc361c5-kube-api-access-ns4w7\") pod \"limitador-limitador-84994f7ffc-z2k7x\" (UID: \"0ef4c223-20b9-4102-b0c5-250f1cc361c5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.197243 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.197215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:34.238542 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.238514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz"] Sep 18 03:41:34.240187 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:34.240160 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod842593c1_151c_45ea_a617_93eaed6191b2.slice/crio-ec2c8cb62be6caf806c9fd4d3b59f1706bbef1ea5ec9dcc9b9d3ee229e471f51 WatchSource:0}: Error finding container ec2c8cb62be6caf806c9fd4d3b59f1706bbef1ea5ec9dcc9b9d3ee229e471f51: Status 404 returned error can't find the container with id ec2c8cb62be6caf806c9fd4d3b59f1706bbef1ea5ec9dcc9b9d3ee229e471f51 Sep 18 03:41:34.384763 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.384730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:34.448899 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.448817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" event={"ID":"842593c1-151c-45ea-a617-93eaed6191b2","Type":"ContainerStarted","Data":"ec2c8cb62be6caf806c9fd4d3b59f1706bbef1ea5ec9dcc9b9d3ee229e471f51"} Sep 18 03:41:34.453555 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.453521 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:34.457585 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.457561 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-w85dc"] Sep 18 03:41:34.462159 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.462140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:34.464666 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.464640 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l28gj\"" Sep 18 03:41:34.468194 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.468105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-w85dc"] Sep 18 03:41:34.470942 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.470743 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:41:34.474349 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:34.474321 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef4c223_20b9_4102_b0c5_250f1cc361c5.slice/crio-d18c6e7d091b2adff38cdbcf700d12773ce2613919977f0e5bef4d6931aa60c4 WatchSource:0}: Error finding container d18c6e7d091b2adff38cdbcf700d12773ce2613919977f0e5bef4d6931aa60c4: Status 404 returned error can't find the container with id d18c6e7d091b2adff38cdbcf700d12773ce2613919977f0e5bef4d6931aa60c4 Sep 18 03:41:34.647829 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.647793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvg2\" (UniqueName: \"kubernetes.io/projected/580608da-4e0f-4869-aef3-9327b46893ac-kube-api-access-6pvg2\") pod \"authorino-59c974bd48-w85dc\" (UID: \"580608da-4e0f-4869-aef3-9327b46893ac\") " pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:34.749154 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.749115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvg2\" (UniqueName: \"kubernetes.io/projected/580608da-4e0f-4869-aef3-9327b46893ac-kube-api-access-6pvg2\") pod \"authorino-59c974bd48-w85dc\" (UID: \"580608da-4e0f-4869-aef3-9327b46893ac\") " pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:34.756945 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.756911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvg2\" (UniqueName: \"kubernetes.io/projected/580608da-4e0f-4869-aef3-9327b46893ac-kube-api-access-6pvg2\") pod \"authorino-59c974bd48-w85dc\" (UID: \"580608da-4e0f-4869-aef3-9327b46893ac\") " pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:34.775693 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:34.775669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:35.046321 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:35.046192 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-w85dc"] Sep 18 03:41:35.058050 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:35.058011 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod580608da_4e0f_4869_aef3_9327b46893ac.slice/crio-a18f5f39bdfb6ae5e19494c30c9f6884893d3c6dff6010348b435f673d566ae6 WatchSource:0}: Error finding container a18f5f39bdfb6ae5e19494c30c9f6884893d3c6dff6010348b435f673d566ae6: Status 404 returned error can't find the container with id a18f5f39bdfb6ae5e19494c30c9f6884893d3c6dff6010348b435f673d566ae6 Sep 18 03:41:35.456598 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:35.456489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-w85dc" event={"ID":"580608da-4e0f-4869-aef3-9327b46893ac","Type":"ContainerStarted","Data":"a18f5f39bdfb6ae5e19494c30c9f6884893d3c6dff6010348b435f673d566ae6"} Sep 18 03:41:35.458205 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:35.458170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" event={"ID":"0ef4c223-20b9-4102-b0c5-250f1cc361c5","Type":"ContainerStarted","Data":"d18c6e7d091b2adff38cdbcf700d12773ce2613919977f0e5bef4d6931aa60c4"} Sep 18 03:41:36.465919 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:36.465875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" event={"ID":"0ef4c223-20b9-4102-b0c5-250f1cc361c5","Type":"ContainerStarted","Data":"01b56f3a42ad3e7c9d2d8f01dc9f1faf7545a93783ebf5588b49bdaf68074f93"} Sep 18 03:41:36.466360 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:36.466067 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:36.482618 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:36.482564 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" podStartSLOduration=2.33221464 podStartE2EDuration="3.482549498s" totalImagesPullingTime="1.150334858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:36.480830319 +0000 UTC m=+538.749830282" watchObservedRunningTime="2026-09-18 03:41:36.482549498 +0000 UTC m=+538.751549455" Sep 18 03:41:36.569694 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:36.569660 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:36.670194 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:36.670152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:37.170930 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:37.170894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:37.272734 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:37.272697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:37.570414 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:37.570373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:37.663043 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:37.662957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:39.483093 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:39.483068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" event={"ID":"842593c1-151c-45ea-a617-93eaed6191b2","Type":"ContainerStarted","Data":"c041f20987fb992c082872d0a06a823599351e480d556bf7abf6290003d24b2c"} Sep 18 03:41:39.484832 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:39.484802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-w85dc" event={"ID":"580608da-4e0f-4869-aef3-9327b46893ac","Type":"ContainerStarted","Data":"584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a"} Sep 18 03:41:39.520921 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:39.520870 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-llzhz" podStartSLOduration=1.372978061 podStartE2EDuration="6.520853708s" totalImagesPullingTime="5.147875647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:39.51817582 +0000 UTC m=+541.787175796" watchObservedRunningTime="2026-09-18 03:41:39.520853708 +0000 UTC m=+541.789853668" Sep 18 03:41:39.535593 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:39.535553 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:39.696348 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:39.696256 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:41.129746 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:41.129706 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:41.219604 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:41.219563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:42.024279 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:42.024228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:42.196030 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:42.195993 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:42.380466 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:42.380365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:42.480599 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:42.480565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:42.837301 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:42.837266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:42.935551 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:42.935512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:43.134683 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:43.134592 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:43.404994 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:43.404902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:43.759287 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:43.759255 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:43.871255 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:43.871219 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:44.018283 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.018185 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-w85dc" podStartSLOduration=5.77660217 podStartE2EDuration="10.018167449s" totalImagesPullingTime="4.241565279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:39.55551897 +0000 UTC m=+541.824518932" watchObservedRunningTime="2026-09-18 03:41:44.018167449 +0000 UTC m=+546.287167410" Sep 18 03:41:44.018502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.018487 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-rbj6b"] Sep 18 03:41:44.025014 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.024993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.027590 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.027557 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hwtpl\"" Sep 18 03:41:44.028018 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.027997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 18 03:41:44.033713 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.033689 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-rbj6b"] Sep 18 03:41:44.123968 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.123885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8351071a-3d24-48f9-9c83-0af5715a2559-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-rbj6b\" (UID: \"8351071a-3d24-48f9-9c83-0af5715a2559\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.124176 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.124011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rsp\" (UniqueName: \"kubernetes.io/projected/8351071a-3d24-48f9-9c83-0af5715a2559-kube-api-access-t7rsp\") pod \"payload-processing-5b54b7fbb7-rbj6b\" (UID: \"8351071a-3d24-48f9-9c83-0af5715a2559\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.126880 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.126843 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:41:44.129574 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.129548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-z2k7x" Sep 18 03:41:44.224634 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.224584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8351071a-3d24-48f9-9c83-0af5715a2559-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-rbj6b\" (UID: \"8351071a-3d24-48f9-9c83-0af5715a2559\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.224634 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.224631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rsp\" (UniqueName: \"kubernetes.io/projected/8351071a-3d24-48f9-9c83-0af5715a2559-kube-api-access-t7rsp\") pod \"payload-processing-5b54b7fbb7-rbj6b\" (UID: \"8351071a-3d24-48f9-9c83-0af5715a2559\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.225308 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.225283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8351071a-3d24-48f9-9c83-0af5715a2559-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-rbj6b\" (UID: \"8351071a-3d24-48f9-9c83-0af5715a2559\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.246131 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.246103 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rsp\" (UniqueName: \"kubernetes.io/projected/8351071a-3d24-48f9-9c83-0af5715a2559-kube-api-access-t7rsp\") pod \"payload-processing-5b54b7fbb7-rbj6b\" (UID: \"8351071a-3d24-48f9-9c83-0af5715a2559\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.336683 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.336598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:44.615337 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.615311 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-rbj6b"] Sep 18 03:41:44.617316 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:44.617289 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8351071a_3d24_48f9_9c83_0af5715a2559.slice/crio-fdbfa2fba8b75ac557f6408ca6f00a66e1df0184357aa191e19f8ee72a14422c WatchSource:0}: Error finding container fdbfa2fba8b75ac557f6408ca6f00a66e1df0184357aa191e19f8ee72a14422c: Status 404 returned error can't find the container with id fdbfa2fba8b75ac557f6408ca6f00a66e1df0184357aa191e19f8ee72a14422c Sep 18 03:41:44.864522 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.860814 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:44.960691 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:44.960564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:45.002828 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.002787 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h"] Sep 18 03:41:45.009706 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.009679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.016147 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.015921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w2z7f\"" Sep 18 03:41:45.017427 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.017399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 18 03:41:45.040305 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.039859 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h"] Sep 18 03:41:45.048867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.048092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7k8r\" (UniqueName: \"kubernetes.io/projected/32b0a5d6-b4e2-4707-9301-fe483e26b538-kube-api-access-b7k8r\") pod \"llmisvc-controller-manager-78f7d99c47-ddq8h\" (UID: \"32b0a5d6-b4e2-4707-9301-fe483e26b538\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.048867 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.048179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32b0a5d6-b4e2-4707-9301-fe483e26b538-cert\") pod \"llmisvc-controller-manager-78f7d99c47-ddq8h\" (UID: \"32b0a5d6-b4e2-4707-9301-fe483e26b538\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.103747 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.103695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:45.149662 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.149573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7k8r\" (UniqueName: \"kubernetes.io/projected/32b0a5d6-b4e2-4707-9301-fe483e26b538-kube-api-access-b7k8r\") pod \"llmisvc-controller-manager-78f7d99c47-ddq8h\" (UID: \"32b0a5d6-b4e2-4707-9301-fe483e26b538\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.149830 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.149662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32b0a5d6-b4e2-4707-9301-fe483e26b538-cert\") pod \"llmisvc-controller-manager-78f7d99c47-ddq8h\" (UID: \"32b0a5d6-b4e2-4707-9301-fe483e26b538\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.152231 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.152201 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32b0a5d6-b4e2-4707-9301-fe483e26b538-cert\") pod \"llmisvc-controller-manager-78f7d99c47-ddq8h\" (UID: \"32b0a5d6-b4e2-4707-9301-fe483e26b538\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.167430 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.167400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7k8r\" (UniqueName: \"kubernetes.io/projected/32b0a5d6-b4e2-4707-9301-fe483e26b538-kube-api-access-b7k8r\") pod \"llmisvc-controller-manager-78f7d99c47-ddq8h\" (UID: \"32b0a5d6-b4e2-4707-9301-fe483e26b538\") " pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.270995 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.270937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:45.321991 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.321948 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:45.369369 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.369333 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:45.464914 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.464820 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:45.519791 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.519757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" event={"ID":"8351071a-3d24-48f9-9c83-0af5715a2559","Type":"ContainerStarted","Data":"fdbfa2fba8b75ac557f6408ca6f00a66e1df0184357aa191e19f8ee72a14422c"} Sep 18 03:41:45.603896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:45.603864 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h"] Sep 18 03:41:45.853184 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:45.853148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod32b0a5d6_b4e2_4707_9301_fe483e26b538.slice/crio-b1aa17876c241569186cc87186ee58ec7a27c0838e81db369f799ea7ba8510e5 WatchSource:0}: Error finding container b1aa17876c241569186cc87186ee58ec7a27c0838e81db369f799ea7ba8510e5: Status 404 returned error can't find the container with id b1aa17876c241569186cc87186ee58ec7a27c0838e81db369f799ea7ba8510e5 Sep 18 03:41:46.063651 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.063615 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:46.167286 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.167185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:46.307322 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.307275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:46.438060 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.437964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:46.444338 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.444306 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj"] Sep 18 03:41:46.448329 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.448307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.461785 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.461697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj"] Sep 18 03:41:46.526708 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.526668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" event={"ID":"32b0a5d6-b4e2-4707-9301-fe483e26b538","Type":"ContainerStarted","Data":"b1aa17876c241569186cc87186ee58ec7a27c0838e81db369f799ea7ba8510e5"} Sep 18 03:41:46.528540 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.528511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" event={"ID":"8351071a-3d24-48f9-9c83-0af5715a2559","Type":"ContainerStarted","Data":"faad33942f870a1aee40d067ca5394747a7a9ba5eeb5fb1070229487f3471186"} Sep 18 03:41:46.528679 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.528585 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:46.552897 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.552838 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" podStartSLOduration=2.265408308 podStartE2EDuration="3.552821796s" totalImagesPullingTime="1.287413488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:46.551896826 +0000 UTC m=+548.820896787" watchObservedRunningTime="2026-09-18 03:41:46.552821796 +0000 UTC m=+548.821821784" Sep 18 03:41:46.561364 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.561539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ea614-3dc0-492e-8d3e-8ce05bd4255d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.561539 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.561666 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qmxd\" (UniqueName: \"kubernetes.io/projected/043ea614-3dc0-492e-8d3e-8ce05bd4255d-kube-api-access-2qmxd\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.561666 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.561666 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.561819 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.561757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.662938 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.662897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.662938 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.662951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qmxd\" (UniqueName: \"kubernetes.io/projected/043ea614-3dc0-492e-8d3e-8ce05bd4255d-kube-api-access-2qmxd\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.663239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.662986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.663239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.663019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.663239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.663077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.663239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.663129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.663239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.663164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ea614-3dc0-492e-8d3e-8ce05bd4255d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.664162 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.664112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.667180 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.666563 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.667180 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.667128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.668156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.668098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ea614-3dc0-492e-8d3e-8ce05bd4255d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.668520 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.668473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.671432 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.671386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ea614-3dc0-492e-8d3e-8ce05bd4255d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.672357 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.672316 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qmxd\" (UniqueName: \"kubernetes.io/projected/043ea614-3dc0-492e-8d3e-8ce05bd4255d-kube-api-access-2qmxd\") pod \"istiod-openshift-gateway-5677ccb49b-srpgj\" (UID: \"043ea614-3dc0-492e-8d3e-8ce05bd4255d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:46.760668 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:46.760636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:47.057389 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.057273 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj"] Sep 18 03:41:47.060041 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:41:47.060008 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043ea614_3dc0_492e_8d3e_8ce05bd4255d.slice/crio-d2f60a0d424806888819984ec5f905979bb87a5dba713f1042b44914ab528917 WatchSource:0}: Error finding container d2f60a0d424806888819984ec5f905979bb87a5dba713f1042b44914ab528917: Status 404 returned error can't find the container with id d2f60a0d424806888819984ec5f905979bb87a5dba713f1042b44914ab528917 Sep 18 03:41:47.063111 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.063070 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 03:41:47.063411 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.063385 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 18 03:41:47.537327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.537029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" event={"ID":"043ea614-3dc0-492e-8d3e-8ce05bd4255d","Type":"ContainerStarted","Data":"9cd11a1f121a1d6d3b13dc89bbadc0ce7a8e8f5cdcfdcc7dfff6b79a46ad5693"} Sep 18 03:41:47.537327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.537082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" event={"ID":"043ea614-3dc0-492e-8d3e-8ce05bd4255d","Type":"ContainerStarted","Data":"d2f60a0d424806888819984ec5f905979bb87a5dba713f1042b44914ab528917"} Sep 18 03:41:47.537327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.537118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:47.561749 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:47.561684 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" podStartSLOduration=1.56166293 podStartE2EDuration="1.56166293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:47.558722504 +0000 UTC m=+549.827722490" watchObservedRunningTime="2026-09-18 03:41:47.56166293 +0000 UTC m=+549.830662893" Sep 18 03:41:48.105842 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.105773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:48.226123 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.226083 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:48.391015 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.390928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:48.487211 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.487180 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:48.542670 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.542633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" event={"ID":"32b0a5d6-b4e2-4707-9301-fe483e26b538","Type":"ContainerStarted","Data":"a99cf3bfa3848d874208a6710808270fa2b424da42c4d7190ae27ecff102219a"} Sep 18 03:41:48.542828 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.542715 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:41:48.544801 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.544769 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-srpgj" Sep 18 03:41:48.560311 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.560263 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" podStartSLOduration=2.176919615 podStartE2EDuration="4.560228895s" totalImagesPullingTime="2.38330928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:41:48.559291919 +0000 UTC m=+550.828291881" watchObservedRunningTime="2026-09-18 03:41:48.560228895 +0000 UTC m=+550.829228855" Sep 18 03:41:48.610967 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.610935 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4"] Sep 18 03:41:48.611183 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.611151 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" podUID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" containerName="discovery" containerID="cri-o://59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389" gracePeriod=30 Sep 18 03:41:48.872360 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.872330 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:41:48.986786 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986703 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjwlt\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-kube-api-access-wjwlt\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.986786 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986760 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-ca-configmap\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.987008 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986797 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-dns-cert\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.987008 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986813 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-token\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.987008 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986859 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-local-certs\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.987008 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986914 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-kubeconfig\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.987008 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.986931 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-cacerts\") pod \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\" (UID: \"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63\") " Sep 18 03:41:48.987291 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.987259 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:41:48.989444 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.989383 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:41:48.989595 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.989431 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-cacerts" (OuterVolumeSpecName: "cacerts") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:41:48.989595 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.989498 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:41:48.989595 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.989551 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-local-certs" (OuterVolumeSpecName: "local-certs") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:41:48.989595 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.989589 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:41:48.989812 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:48.989685 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-kube-api-access-wjwlt" (OuterVolumeSpecName: "kube-api-access-wjwlt") pod "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" (UID: "a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63"). InnerVolumeSpecName "kube-api-access-wjwlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:41:49.088488 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088432 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-ca-configmap\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.088488 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088491 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-csr-dns-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.088654 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088507 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-token\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.088654 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088518 2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-local-certs\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.088654 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088526 2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-istio-kubeconfig\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.088654 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088534 2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-cacerts\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.088654 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.088542 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjwlt\" (UniqueName: \"kubernetes.io/projected/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63-kube-api-access-wjwlt\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:49.548983 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.548943 2576 generic.go:356] "Generic (PLEG): container finished" podID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" containerID="59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389" exitCode=0 Sep 18 03:41:49.549506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.549001 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" Sep 18 03:41:49.549506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.549030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" event={"ID":"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63","Type":"ContainerDied","Data":"59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389"} Sep 18 03:41:49.549506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.549095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4" event={"ID":"a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63","Type":"ContainerDied","Data":"7569b6567221532294ada9de39bbf64c20659054ed15821bc953d1334645ad1c"} Sep 18 03:41:49.549506 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.549129 2576 scope.go:117] "RemoveContainer" containerID="59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389" Sep 18 03:41:49.558545 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.558527 2576 scope.go:117] "RemoveContainer" containerID="59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389" Sep 18 03:41:49.558823 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:41:49.558797 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389\": container with ID starting with 59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389 not found: ID does not exist" containerID="59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389" Sep 18 03:41:49.558872 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.558831 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389"} err="failed to get container status \"59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389\": rpc error: code = NotFound desc = could not find container \"59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389\": container with ID starting with 59a07b307e28b8c1d13b7c7329e857c90d522d284723fb3d4e078f2a1e05e389 not found: ID does not exist" Sep 18 03:41:49.569377 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.569350 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4"] Sep 18 03:41:49.573023 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:49.573003 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-c29v4"] Sep 18 03:41:50.257805 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:50.257771 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" path="/var/lib/kubelet/pods/a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63/volumes" Sep 18 03:41:52.834689 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:52.834649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:52.936182 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:52.936146 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:53.337476 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:53.337424 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:53.438324 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:53.438284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:41:56.134489 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.134430 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-w85dc"] Sep 18 03:41:56.134962 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.134678 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-w85dc" podUID="580608da-4e0f-4869-aef3-9327b46893ac" containerName="authorino" containerID="cri-o://584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a" gracePeriod=30 Sep 18 03:41:56.377623 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.377601 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:56.450379 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.450292 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pvg2\" (UniqueName: \"kubernetes.io/projected/580608da-4e0f-4869-aef3-9327b46893ac-kube-api-access-6pvg2\") pod \"580608da-4e0f-4869-aef3-9327b46893ac\" (UID: \"580608da-4e0f-4869-aef3-9327b46893ac\") " Sep 18 03:41:56.452461 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.452421 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580608da-4e0f-4869-aef3-9327b46893ac-kube-api-access-6pvg2" (OuterVolumeSpecName: "kube-api-access-6pvg2") pod "580608da-4e0f-4869-aef3-9327b46893ac" (UID: "580608da-4e0f-4869-aef3-9327b46893ac"). InnerVolumeSpecName "kube-api-access-6pvg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:41:56.551156 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.551117 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pvg2\" (UniqueName: \"kubernetes.io/projected/580608da-4e0f-4869-aef3-9327b46893ac-kube-api-access-6pvg2\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Sep 18 03:41:56.584358 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.584319 2576 generic.go:356] "Generic (PLEG): container finished" podID="580608da-4e0f-4869-aef3-9327b46893ac" containerID="584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a" exitCode=0 Sep 18 03:41:56.584500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.584358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-w85dc" event={"ID":"580608da-4e0f-4869-aef3-9327b46893ac","Type":"ContainerDied","Data":"584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a"} Sep 18 03:41:56.584500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.584371 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-w85dc" Sep 18 03:41:56.584500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.584402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-w85dc" event={"ID":"580608da-4e0f-4869-aef3-9327b46893ac","Type":"ContainerDied","Data":"a18f5f39bdfb6ae5e19494c30c9f6884893d3c6dff6010348b435f673d566ae6"} Sep 18 03:41:56.584500 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.584420 2576 scope.go:117] "RemoveContainer" containerID="584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a" Sep 18 03:41:56.593166 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.593151 2576 scope.go:117] "RemoveContainer" containerID="584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a" Sep 18 03:41:56.593434 ip-10-0-136-38 kubenswrapper[2576]: E0918 03:41:56.593415 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a\": container with ID starting with 584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a not found: ID does not exist" containerID="584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a" Sep 18 03:41:56.593530 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.593441 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a"} err="failed to get container status \"584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a\": rpc error: code = NotFound desc = could not find container \"584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a\": container with ID starting with 584b385f8138e12ab7ff8fbb6c2a65dd06f20045eb9fbf9a8cecb9fbdcc4251a not found: ID does not exist" Sep 18 03:41:56.610404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.610381 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-w85dc"] Sep 18 03:41:56.618145 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:56.618119 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-w85dc"] Sep 18 03:41:57.539036 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:57.539003 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-rbj6b" Sep 18 03:41:58.257308 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:41:58.257276 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580608da-4e0f-4869-aef3-9327b46893ac" path="/var/lib/kubelet/pods/580608da-4e0f-4869-aef3-9327b46893ac/volumes" Sep 18 03:42:19.552196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:42:19.552167 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-78f7d99c47-ddq8h" Sep 18 03:42:38.207048 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:42:38.206946 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:42:38.207048 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:42:38.206946 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:42:57.411711 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:42:57.411677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:42:58.834259 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:42:58.834228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:02.859368 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:02.859284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:02.910737 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:02.910702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:03.006065 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:03.006009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:03.105896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:03.105855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:03.601899 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:03.601857 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:03.652185 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:03.652153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:07.466796 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:07.466766 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:07.935516 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:07.935476 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:43:13.287930 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:13.287889 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:13.345933 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:13.345899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:13.399149 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:13.399101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:21.164894 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:21.164858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:22.026697 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:22.026660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:43:38.188707 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:38.188673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:38.924441 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:38.924405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:43:58.242807 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.242773 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6"] Sep 18 03:43:58.243303 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.243283 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580608da-4e0f-4869-aef3-9327b46893ac" containerName="authorino" Sep 18 03:43:58.243384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.243306 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="580608da-4e0f-4869-aef3-9327b46893ac" containerName="authorino" Sep 18 03:43:58.243384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.243338 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" containerName="discovery" Sep 18 03:43:58.243384 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.243348 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" containerName="discovery" Sep 18 03:43:58.243562 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.243463 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="580608da-4e0f-4869-aef3-9327b46893ac" containerName="authorino" Sep 18 03:43:58.243562 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.243479 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7ab1c8f-822d-4f9b-bb06-bd35cc6acc63" containerName="discovery" Sep 18 03:43:58.249529 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.247881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.251504 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.251442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 18 03:43:58.256327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.252574 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 03:43:58.256327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.252618 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 03:43:58.256327 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.254566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hhmv2\"" Sep 18 03:43:58.261914 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.261888 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6"] Sep 18 03:43:58.274955 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.274923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:43:58.305111 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.305079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c8ea63-65c1-43df-a8b2-0b151595c0db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.305111 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.305110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.305291 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.305144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.305291 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.305204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz25n\" (UniqueName: \"kubernetes.io/projected/59c8ea63-65c1-43df-a8b2-0b151595c0db-kube-api-access-zz25n\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.305291 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.305249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.305390 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.305317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406413 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz25n\" (UniqueName: \"kubernetes.io/projected/59c8ea63-65c1-43df-a8b2-0b151595c0db-kube-api-access-zz25n\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406413 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c8ea63-65c1-43df-a8b2-0b151595c0db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406676 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406939 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.406939 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.407091 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.406962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.408698 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.408670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c8ea63-65c1-43df-a8b2-0b151595c0db-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.408961 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.408944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c8ea63-65c1-43df-a8b2-0b151595c0db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.413988 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.413970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz25n\" (UniqueName: \"kubernetes.io/projected/59c8ea63-65c1-43df-a8b2-0b151595c0db-kube-api-access-zz25n\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6\" (UID: \"59c8ea63-65c1-43df-a8b2-0b151595c0db\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.566878 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.566791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:43:58.839241 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.839214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6"] Sep 18 03:43:58.841782 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:43:58.841756 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c8ea63_65c1_43df_a8b2_0b151595c0db.slice/crio-3174f0bd321fd789016f031c96dd37c0cadaf7a2993ef15683af63ef37af1e5d WatchSource:0}: Error finding container 3174f0bd321fd789016f031c96dd37c0cadaf7a2993ef15683af63ef37af1e5d: Status 404 returned error can't find the container with id 3174f0bd321fd789016f031c96dd37c0cadaf7a2993ef15683af63ef37af1e5d Sep 18 03:43:58.843391 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:58.843375 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:43:59.168265 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:43:59.168167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" event={"ID":"59c8ea63-65c1-43df-a8b2-0b151595c0db","Type":"ContainerStarted","Data":"3174f0bd321fd789016f031c96dd37c0cadaf7a2993ef15683af63ef37af1e5d"} Sep 18 03:44:00.131342 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:00.131263 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:44:00.174640 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:00.174601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" event={"ID":"59c8ea63-65c1-43df-a8b2-0b151595c0db","Type":"ContainerStarted","Data":"f47df04fb47531153a4d72eeb72002aa5d74f7d4b5c135a4e82d6ef5760e89c1"} Sep 18 03:44:00.191930 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:00.191877 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" podStartSLOduration=1.208452365 podStartE2EDuration="2.191863163s" totalImagesPullingTime="983.410798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:44:00.189975897 +0000 UTC m=+682.458975859" watchObservedRunningTime="2026-09-18 03:44:00.191863163 +0000 UTC m=+682.460863124" Sep 18 03:44:00.567447 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:00.567413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:44:08.567796 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:08.567758 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:44:08.580564 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:08.580539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:44:09.227846 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:09.227818 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6" Sep 18 03:44:17.264357 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:17.264289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:44:19.434947 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:19.434911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:44:23.234739 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.234704 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9"] Sep 18 03:44:23.240305 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.240280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.242659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.242636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 18 03:44:23.247153 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.247127 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9"] Sep 18 03:44:23.267431 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.267387 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:44:23.327826 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.327791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.328010 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.327830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.328010 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.327899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b97859f-3f95-4775-9450-5a3120330cae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.328010 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.327966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.328140 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.328034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.328140 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.328062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/5b97859f-3f95-4775-9450-5a3120330cae-kube-api-access-gl9f6\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429119 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429119 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b97859f-3f95-4775-9450-5a3120330cae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429366 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/5b97859f-3f95-4775-9450-5a3120330cae-kube-api-access-gl9f6\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429618 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429590 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429680 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.429680 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.429674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.431328 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.431307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b97859f-3f95-4775-9450-5a3120330cae-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.431615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.431597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b97859f-3f95-4775-9450-5a3120330cae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.440515 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.436701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/5b97859f-3f95-4775-9450-5a3120330cae-kube-api-access-gl9f6\") pod \"facebook-opt-125m-simulated-kserve-89945f574-zzfw9\" (UID: \"5b97859f-3f95-4775-9450-5a3120330cae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.552471 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.552357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:23.826183 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:23.826153 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9"] Sep 18 03:44:23.827932 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:44:23.827906 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b97859f_3f95_4775_9450_5a3120330cae.slice/crio-aa88aa60608d59665d12f51a29069e3b1fa1ec0a26556dec713f4a4a41fc7b62 WatchSource:0}: Error finding container aa88aa60608d59665d12f51a29069e3b1fa1ec0a26556dec713f4a4a41fc7b62: Status 404 returned error can't find the container with id aa88aa60608d59665d12f51a29069e3b1fa1ec0a26556dec713f4a4a41fc7b62 Sep 18 03:44:24.294479 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:24.294419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" event={"ID":"5b97859f-3f95-4775-9450-5a3120330cae","Type":"ContainerStarted","Data":"a33c74b8d7e7f9068c89eb566ceaf4132225af49334f5dc6602b0393cfdcce9d"} Sep 18 03:44:24.294857 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:24.294507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" event={"ID":"5b97859f-3f95-4775-9450-5a3120330cae","Type":"ContainerStarted","Data":"aa88aa60608d59665d12f51a29069e3b1fa1ec0a26556dec713f4a4a41fc7b62"} Sep 18 03:44:24.309628 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:24.309568 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" podStartSLOduration=1.068552119 podStartE2EDuration="1.309546928s" totalImagesPullingTime="240.994809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:44:24.309165722 +0000 UTC m=+706.578165694" watchObservedRunningTime="2026-09-18 03:44:24.309546928 +0000 UTC m=+706.578546892" Sep 18 03:44:24.552715 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:24.552681 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:31.324491 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:31.324389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:44:31.873851 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:31.873809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:44:33.552893 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:33.552852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:33.565594 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:33.565560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:34.358343 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:34.358315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-zzfw9" Sep 18 03:44:42.775730 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:42.775684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:44:42.827079 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:42.827047 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:44:43.225632 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:44:43.225593 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-z2k7x"] Sep 18 03:45:44.778766 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:44.778729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:45:44.877708 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:44.877672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:45:45.920102 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:45.920061 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:45:46.033900 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:46.033871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:45:58.829413 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:58.829204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-78f7d99c47-ddq8h_32b0a5d6-b4e2-4707-9301-fe483e26b538/manager/0.log" Sep 18 03:45:58.950097 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:58.950065 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55cc95c545-szljv_4d5a1ade-1c65-49c6-a7e9-b65d07092951/manager/0.log" Sep 18 03:45:59.734604 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:45:59.734572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8btz4_5e3d3df2-e819-4799-859d-fd7a6366786c/postgres/0.log" Sep 18 03:46:00.789814 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:00.789746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-llzhz_842593c1-151c-45ea-a617-93eaed6191b2/kuadrant-console-plugin/0.log" Sep 18 03:46:01.022619 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:01.022591 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-z2k7x_0ef4c223-20b9-4102-b0c5-250f1cc361c5/limitador/0.log" Sep 18 03:46:01.596606 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:01.596573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-srpgj_043ea614-3dc0-492e-8d3e-8ce05bd4255d/discovery/0.log" Sep 18 03:46:01.810470 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:01.810432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6dc6c678-krt6h_634221d0-d3be-400b-91c3-faa19f4bf464/kube-auth-proxy/0.log" Sep 18 03:46:02.240012 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:02.239983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rbj6b_8351071a-3d24-48f9-9c83-0af5715a2559/payload-processing/0.log" Sep 18 03:46:03.021088 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:03.021053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-5bccb7bbf7-wpkh6_59c8ea63-65c1-43df-a8b2-0b151595c0db/main/0.log" Sep 18 03:46:03.257112 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:03.257076 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-zzfw9_5b97859f-3f95-4775-9450-5a3120330cae/main/0.log" Sep 18 03:46:09.007197 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:09.007149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:46:09.069239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:09.069203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:46:11.772196 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:11.772164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vfqzn_8a54338f-2334-40f2-b27a-d4acf2a0dd6f/global-pull-secret-syncer/0.log" Sep 18 03:46:11.816505 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:11.816477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" Sep 18 03:46:11.903522 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:11.903477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-38.ec2.internal_1a1da006789cadfe221cc035b2d280ed/haproxy/0.log" Sep 18 03:46:12.981425 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:12.981390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:46:13.081775 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:13.081745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-942rk_cde83bf5-532f-449c-801d-9886391e38d2/konnectivity-agent/0.log" limit=1024 Sep 18 03:46:16.633502 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:16.633474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-llzhz_842593c1-151c-45ea-a617-93eaed6191b2/kuadrant-console-plugin/0.log" Sep 18 03:46:16.704310 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:16.704280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-z2k7x_0ef4c223-20b9-4102-b0c5-250f1cc361c5/limitador/0.log" Sep 18 03:46:18.079564 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.079539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/alertmanager/0.log" Sep 18 03:46:18.100271 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.100247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/config-reloader/0.log" Sep 18 03:46:18.119223 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.119202 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/kube-rbac-proxy-web/0.log" Sep 18 03:46:18.142063 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.142039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/kube-rbac-proxy/0.log" Sep 18 03:46:18.163594 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.163568 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/kube-rbac-proxy-metric/0.log" Sep 18 03:46:18.188361 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.188327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/prom-label-proxy/0.log" Sep 18 03:46:18.210072 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.210052 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_054d2a4d-3b52-4da6-b17f-8eb4d0aef54e/init-config-reloader/0.log" Sep 18 03:46:18.346643 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.346558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76684cdcfd-pzsfm_b11b6bba-17b0-4e1d-a319-ae4883c16115/metrics-server/0.log" Sep 18 03:46:18.410733 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.410703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9g9d_f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf/node-exporter/0.log" Sep 18 03:46:18.428157 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.428137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9g9d_f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf/kube-rbac-proxy/0.log" Sep 18 03:46:18.448299 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.448281 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9g9d_f1806ff4-dfc8-4cb8-8eef-5aa505d6efaf/init-textfile/0.log" Sep 18 03:46:18.644629 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.644557 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-krtp2_29cc7d1f-e6cf-473e-9786-f8c7668f7d89/kube-rbac-proxy-main/0.log" Sep 18 03:46:18.670239 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.670217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-krtp2_29cc7d1f-e6cf-473e-9786-f8c7668f7d89/kube-rbac-proxy-self/0.log" Sep 18 03:46:18.696706 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:18.696680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-krtp2_29cc7d1f-e6cf-473e-9786-f8c7668f7d89/openshift-state-metrics/0.log" Sep 18 03:46:19.044049 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:19.044016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884d565f4-ktsr4_b47cb37b-288d-47b5-a0c6-484a07ef08e5/thanos-query/0.log" Sep 18 03:46:19.062358 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:19.062337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884d565f4-ktsr4_b47cb37b-288d-47b5-a0c6-484a07ef08e5/kube-rbac-proxy-web/0.log" Sep 18 03:46:19.086121 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:19.086098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884d565f4-ktsr4_b47cb37b-288d-47b5-a0c6-484a07ef08e5/kube-rbac-proxy/0.log" Sep 18 03:46:19.103615 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:19.103594 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884d565f4-ktsr4_b47cb37b-288d-47b5-a0c6-484a07ef08e5/prom-label-proxy/0.log" Sep 18 03:46:19.123484 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:19.123442 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884d565f4-ktsr4_b47cb37b-288d-47b5-a0c6-484a07ef08e5/kube-rbac-proxy-rules/0.log" Sep 18 03:46:19.143296 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:19.143270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7884d565f4-ktsr4_b47cb37b-288d-47b5-a0c6-484a07ef08e5/kube-rbac-proxy-metrics/0.log" Sep 18 03:46:20.508037 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:20.508001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-kq4lq_a3394a4d-dee1-4ad6-ab45-a03ac404ef2e/networking-console-plugin/0.log" Sep 18 03:46:21.103047 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.103015 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/1.log" Sep 18 03:46:21.111957 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.111927 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-4cqm4_be3dd34e-ddd3-4095-8495-428af0afe2e5/console-operator/2.log" Sep 18 03:46:21.616857 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.616827 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l"] Sep 18 03:46:21.620570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.620552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.622885 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.622865 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6cb42\"/\"openshift-service-ca.crt\"" Sep 18 03:46:21.623016 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.622954 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6cb42\"/\"kube-root-ca.crt\"" Sep 18 03:46:21.623680 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.623667 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6cb42\"/\"default-dockercfg-hl7tk\"" Sep 18 03:46:21.627668 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.627640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l"] Sep 18 03:46:21.671099 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.671069 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-l59kp_8ddae06c-a5d1-406f-b202-3e9481e95fc9/download-server/0.log" Sep 18 03:46:21.692404 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.692381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-proc\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.692553 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.692413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-lib-modules\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.692553 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.692440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-podres\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.692553 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.692509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-sys\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.692670 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.692552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9bkb\" (UniqueName: \"kubernetes.io/projected/020749e4-0b51-4e2c-a948-b4d8bf9603c1-kube-api-access-q9bkb\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793725 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-podres\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793863 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-sys\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793863 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9bkb\" (UniqueName: \"kubernetes.io/projected/020749e4-0b51-4e2c-a948-b4d8bf9603c1-kube-api-access-q9bkb\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793863 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-podres\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793980 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-sys\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793980 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-proc\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793980 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793909 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-proc\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.793980 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.793956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-lib-modules\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.794128 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.794042 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/020749e4-0b51-4e2c-a948-b4d8bf9603c1-lib-modules\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.801770 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.801739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9bkb\" (UniqueName: \"kubernetes.io/projected/020749e4-0b51-4e2c-a948-b4d8bf9603c1-kube-api-access-q9bkb\") pod \"perf-node-gather-daemonset-hgk8l\" (UID: \"020749e4-0b51-4e2c-a948-b4d8bf9603c1\") " pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:21.931811 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:21.931722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:22.199665 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:22.199482 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l"] Sep 18 03:46:22.202113 ip-10-0-136-38 kubenswrapper[2576]: W0918 03:46:22.202080 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod020749e4_0b51_4e2c_a948_b4d8bf9603c1.slice/crio-35591c0949ecc7cd902afa3d9b08c3bdb515bdac7f57dbea84af0e5db2844f95 WatchSource:0}: Error finding container 35591c0949ecc7cd902afa3d9b08c3bdb515bdac7f57dbea84af0e5db2844f95: Status 404 returned error can't find the container with id 35591c0949ecc7cd902afa3d9b08c3bdb515bdac7f57dbea84af0e5db2844f95 Sep 18 03:46:22.866895 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:22.866859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" event={"ID":"020749e4-0b51-4e2c-a948-b4d8bf9603c1","Type":"ContainerStarted","Data":"70048f883c22d4e813452edacc8436a224c889d9f2c349fa90c5221810ec7bcb"} Sep 18 03:46:22.867277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:22.866909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" event={"ID":"020749e4-0b51-4e2c-a948-b4d8bf9603c1","Type":"ContainerStarted","Data":"35591c0949ecc7cd902afa3d9b08c3bdb515bdac7f57dbea84af0e5db2844f95"} Sep 18 03:46:22.867277 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:22.866986 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:22.882948 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:22.882901 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" podStartSLOduration=1.88288646 podStartE2EDuration="1.88288646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:46:22.881419272 +0000 UTC m=+825.150419235" watchObservedRunningTime="2026-09-18 03:46:22.88288646 +0000 UTC m=+825.151886421" Sep 18 03:46:23.309841 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:23.309813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7477s_285cbb37-da1c-4993-869b-1d2d60f3ecdd/dns/0.log" Sep 18 03:46:23.328056 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:23.328033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7477s_285cbb37-da1c-4993-869b-1d2d60f3ecdd/kube-rbac-proxy/0.log" Sep 18 03:46:23.476468 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:23.476417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vlv2c_c7bdfd44-54e1-4d9d-8224-dd898a7b9fa2/dns-node-resolver/0.log" Sep 18 03:46:24.033379 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:24.033351 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gxgln_43b3a6ed-ec00-4e2b-a9c9-6f6d7380d95f/node-ca/0.log" Sep 18 03:46:24.970543 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:24.970512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-srpgj_043ea614-3dc0-492e-8d3e-8ce05bd4255d/discovery/0.log" Sep 18 03:46:25.010982 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:25.010955 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6dc6c678-krt6h_634221d0-d3be-400b-91c3-faa19f4bf464/kube-auth-proxy/0.log" Sep 18 03:46:25.109936 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:25.109899 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rbj6b_8351071a-3d24-48f9-9c83-0af5715a2559/payload-processing/0.log" Sep 18 03:46:25.740628 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:25.740601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27cqh_73f9f56d-7fc8-4f2f-8d68-5843400066a9/serve-healthcheck-canary/0.log" Sep 18 03:46:26.236848 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:26.236817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-br9qd_1d7bd3d3-057d-4495-ba85-60029e010375/kube-rbac-proxy/0.log" Sep 18 03:46:26.256179 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:26.256157 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-br9qd_1d7bd3d3-057d-4495-ba85-60029e010375/exporter/0.log" Sep 18 03:46:26.280310 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:26.280284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-br9qd_1d7bd3d3-057d-4495-ba85-60029e010375/extractor/0.log" Sep 18 03:46:28.545896 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:28.545866 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7b6444b484-bqt7h_8ef9f742-2ed7-4299-9361-f162f5240552/manager/0.log" Sep 18 03:46:28.561720 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:28.561693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7b6444b484-bqt7h_8ef9f742-2ed7-4299-9361-f162f5240552/copy-manifests/0.log" Sep 18 03:46:28.881412 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:28.881323 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6cb42/perf-node-gather-daemonset-hgk8l" Sep 18 03:46:30.305241 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:30.305209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-srpgj_043ea614-3dc0-492e-8d3e-8ce05bd4255d/discovery/0.log" Sep 18 03:46:30.331491 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:30.331440 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6dc6c678-krt6h_634221d0-d3be-400b-91c3-faa19f4bf464/kube-auth-proxy/0.log" Sep 18 03:46:30.388702 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:30.388671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rbj6b_8351071a-3d24-48f9-9c83-0af5715a2559/payload-processing/0.log" Sep 18 03:46:30.390246 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:30.390227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-78f7d99c47-ddq8h_32b0a5d6-b4e2-4707-9301-fe483e26b538/manager/0.log" Sep 18 03:46:30.433336 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:30.433313 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55cc95c545-szljv_4d5a1ade-1c65-49c6-a7e9-b65d07092951/manager/0.log" Sep 18 03:46:31.698060 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:31.698025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-srpgj_043ea614-3dc0-492e-8d3e-8ce05bd4255d/discovery/0.log" Sep 18 03:46:31.727858 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:31.727834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6dc6c678-krt6h_634221d0-d3be-400b-91c3-faa19f4bf464/kube-auth-proxy/0.log" Sep 18 03:46:31.790769 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:31.790736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-rbj6b_8351071a-3d24-48f9-9c83-0af5715a2559/payload-processing/0.log" Sep 18 03:46:35.795393 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:35.795296 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-q8j7v_d5e96173-c0f3-4b43-8edd-290864ffdf5e/kube-storage-version-migrator-operator/1.log" Sep 18 03:46:35.798378 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:35.798327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-q8j7v_d5e96173-c0f3-4b43-8edd-290864ffdf5e/kube-storage-version-migrator-operator/0.log" Sep 18 03:46:36.736044 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.736012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/kube-multus-additional-cni-plugins/0.log" Sep 18 03:46:36.754570 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.754536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/egress-router-binary-copy/0.log" Sep 18 03:46:36.772764 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.772735 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/cni-plugins/0.log" Sep 18 03:46:36.791659 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.791631 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/bond-cni-plugin/0.log" Sep 18 03:46:36.810186 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.810155 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/routeoverride-cni/0.log" Sep 18 03:46:36.830328 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.830300 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/whereabouts-cni-bincopy/0.log" Sep 18 03:46:36.848152 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:36.848132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zdtq_aac4c343-36cd-4dc5-8e48-f2c90f2cc8f5/whereabouts-cni/0.log" Sep 18 03:46:37.299824 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:37.299798 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wqrbx_170150d8-1619-4f88-9282-cb53a22f3c06/kube-multus/0.log" Sep 18 03:46:37.383968 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:37.383944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gf592_8db89550-fea8-45bf-b990-609ad2ec5648/network-metrics-daemon/0.log" Sep 18 03:46:37.400431 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:37.400395 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gf592_8db89550-fea8-45bf-b990-609ad2ec5648/kube-rbac-proxy/0.log" Sep 18 03:46:38.479088 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:38.479057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfvbj_a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a/ovn-controller/0.log" Sep 18 03:46:38.495021 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:38.494998 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfvbj_a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a/ovn-acl-logging/0.log" Sep 18 03:46:38.522926 ip-10-0-136-38 kubenswrapper[2576]: I0918 03:46:38.522895 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfvbj_a5fefb7a-770a-4fc9-b4d9-27b9bb9cb03a/kube-rbac-proxy-node/0.log"