Sep 10 03:37:08.613050 ip-10-0-130-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 03:37:08.613061 ip-10-0-130-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 03:37:08.613068 ip-10-0-130-142 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 03:37:08.613300 ip-10-0-130-142 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 03:37:19.006260 ip-10-0-130-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 03:37:19.006277 ip-10-0-130-142 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 82c0acf88e394482b964d6074be948fd -- Sep 10 03:39:05.088461 ip-10-0-130-142 systemd[1]: Starting Kubernetes Kubelet... Sep 10 03:39:05.444510 ip-10-0-130-142 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:39:05.444510 ip-10-0-130-142 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 03:39:05.444510 ip-10-0-130-142 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:39:05.444510 ip-10-0-130-142 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 03:39:05.445282 ip-10-0-130-142 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:39:05.446180 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.446049 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 03:39:05.448993 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.448977 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:05.448993 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.448993 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.448997 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449000 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449006 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449010 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449014 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449017 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449020 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449022 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449025 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449028 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449031 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449033 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449036 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449038 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449041 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449044 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449047 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449049 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:05.449064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449058 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449063 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449067 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449070 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449073 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449076 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449080 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449082 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449085 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449088 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449091 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449093 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449097 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449100 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449102 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449105 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449107 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449110 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449112 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:05.449536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449115 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449118 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449120 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449123 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449126 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449129 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449132 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449134 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449136 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449139 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449141 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449144 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449147 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449164 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449169 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449174 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449178 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449182 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449185 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449188 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:05.449988 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449191 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449193 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449196 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449199 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449201 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449204 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449206 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449209 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449211 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449214 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449216 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449220 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449222 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449225 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449227 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449230 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449233 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449235 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449238 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449240 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:05.450510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449243 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449246 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449248 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449251 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449254 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449256 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449261 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449264 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449267 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449270 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449272 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449275 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449277 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449280 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449283 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449287 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449290 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449293 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449297 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:05.450992 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.449300 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450791 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450798 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450802 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450805 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450808 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450811 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450813 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450816 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450819 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450822 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450825 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450828 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450831 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450834 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450838 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450840 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450843 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450847 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:05.451510 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450852 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450855 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450859 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450862 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450865 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450868 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450871 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450874 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450877 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450879 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450883 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450885 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450888 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450890 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450893 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450896 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450898 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450901 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450903 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450906 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:05.451995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450909 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450911 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450914 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450917 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450919 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450922 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450924 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450926 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450929 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450932 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450935 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450937 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450940 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450943 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450948 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450951 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450954 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450957 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450959 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450962 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:05.452502 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450965 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450967 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450970 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450972 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450975 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450978 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450980 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450983 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450985 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450988 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450990 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450993 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450995 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.450999 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451002 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451004 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451007 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451009 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451012 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:05.453000 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451016 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451019 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451022 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451025 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451028 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451031 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451035 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451037 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451040 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451044 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451048 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451051 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451054 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451057 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451059 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451062 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451064 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451067 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451069 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451072 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:05.453478 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451074 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451077 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451463 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451468 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451471 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451474 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451477 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451480 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451482 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451485 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451488 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451490 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451493 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451496 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451499 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451502 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451504 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451507 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451510 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451513 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:05.453959 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451516 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451519 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451522 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451525 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451527 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451530 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451532 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451535 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451537 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451540 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451544 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451547 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451550 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451553 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451556 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451558 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451561 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451563 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451566 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:05.454470 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451568 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451571 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451573 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451575 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451578 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451580 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451583 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451586 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451589 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451592 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451597 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451600 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451602 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451604 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451607 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451610 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451612 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451615 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451617 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:05.454958 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451620 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451623 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451627 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451629 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451632 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451634 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451637 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451641 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451644 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451647 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451650 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451652 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451655 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451658 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451661 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451664 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451666 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451669 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451671 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451675 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:05.455432 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451677 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451680 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451683 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451689 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451692 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451694 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451697 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451700 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451702 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451706 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451708 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451711 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451713 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451716 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451718 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451721 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451724 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451726 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451728 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451731 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:05.455914 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451733 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451736 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.451738 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451809 2566 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451840 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451850 2566 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451855 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451859 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451862 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451866 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451870 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451874 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451877 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451880 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451883 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451888 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451891 2566 flags.go:64] FLAG: --cgroup-root="" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451894 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451896 2566 flags.go:64] FLAG: --client-ca-file="" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451900 2566 flags.go:64] FLAG: --cloud-provider="external" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451903 2566 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451907 2566 flags.go:64] FLAG: --cluster-domain="" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451910 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451913 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 03:39:05.456454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451917 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451920 2566 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451924 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451927 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451930 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451933 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451936 2566 flags.go:64] FLAG: --contention-profiling="false" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451939 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451942 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451945 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451949 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451952 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451955 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451958 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451961 2566 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451964 2566 flags.go:64] FLAG: --enable-server="true" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451967 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451972 2566 flags.go:64] FLAG: --event-burst="100" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451975 2566 flags.go:64] FLAG: --event-qps="50" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451978 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451981 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451984 2566 flags.go:64] FLAG: --eviction-hard="" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451988 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451992 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451995 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 03:39:05.457046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.451998 2566 flags.go:64] FLAG: --eviction-soft="" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452002 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452005 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452008 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452011 2566 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452013 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452021 2566 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452024 2566 flags.go:64] FLAG: --feature-gates="" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452028 2566 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452031 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452034 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452037 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452040 2566 flags.go:64] FLAG: --healthz-port="10248" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452043 2566 flags.go:64] FLAG: --help="false" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452046 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452049 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452051 2566 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452054 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452057 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452061 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452065 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452068 2566 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452071 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 03:39:05.457652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452074 2566 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452077 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452080 2566 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452083 2566 flags.go:64] FLAG: --kube-reserved="" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452086 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452089 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452092 2566 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452097 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452099 2566 flags.go:64] FLAG: --lock-file="" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452102 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452105 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452108 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452113 2566 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452116 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452119 2566 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452122 2566 flags.go:64] FLAG: --logging-format="text" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452125 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452128 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452131 2566 flags.go:64] FLAG: --manifest-url="" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452134 2566 flags.go:64] FLAG: --manifest-url-header="" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452138 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452141 2566 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452145 2566 flags.go:64] FLAG: --max-pods="110" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452160 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452164 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 03:39:05.458284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452166 2566 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452170 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452173 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452176 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452180 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452188 2566 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452191 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452194 2566 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452197 2566 flags.go:64] FLAG: --pod-cidr="" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452200 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452205 2566 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452208 2566 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452212 2566 flags.go:64] FLAG: --pods-per-core="0" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452215 2566 flags.go:64] FLAG: --port="10250" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452219 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452222 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04e84bd79d2b7a2ff" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452225 2566 flags.go:64] FLAG: --qos-reserved="" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452229 2566 flags.go:64] FLAG: --read-only-port="10255" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452231 2566 flags.go:64] FLAG: --register-node="true" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452235 2566 flags.go:64] FLAG: --register-with-taints="" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452238 2566 flags.go:64] FLAG: --registry-burst="10" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452241 2566 flags.go:64] FLAG: --registry-qps="5" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452244 2566 flags.go:64] FLAG: --reserved-cpus="" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452247 2566 flags.go:64] FLAG: --reserved-memory="" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452251 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 03:39:05.458959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452255 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452258 2566 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452261 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452264 2566 flags.go:64] FLAG: --runonce="false" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452267 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452270 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452273 2566 flags.go:64] FLAG: --seccomp-default="false" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452276 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452279 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452282 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452285 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452288 2566 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452292 2566 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452295 2566 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452297 2566 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452300 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452303 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452306 2566 flags.go:64] FLAG: --system-cgroups="" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452309 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452315 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452318 2566 flags.go:64] FLAG: --tls-cert-file="" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452322 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452326 2566 flags.go:64] FLAG: --tls-min-version="" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452330 2566 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452332 2566 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 03:39:05.459708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452335 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452338 2566 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452341 2566 flags.go:64] FLAG: --v="2" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452345 2566 flags.go:64] FLAG: --version="false" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452348 2566 flags.go:64] FLAG: --vmodule="" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452352 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.452355 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452470 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452473 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452476 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452479 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452482 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452485 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452488 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452491 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452493 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452495 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452498 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452501 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452505 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452508 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:05.460743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452511 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452514 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452516 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452519 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452523 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452527 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452530 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452533 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452536 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452538 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452541 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452543 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452546 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452548 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452551 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452554 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452556 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452559 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452562 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:05.461507 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452566 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452569 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452572 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452575 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452578 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452580 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452583 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452586 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452588 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452591 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452593 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452597 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452600 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452602 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452605 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452608 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452610 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452612 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452615 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452618 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:05.461983 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452620 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452623 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452625 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452628 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452630 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452633 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452635 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452638 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452641 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452643 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452646 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452649 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452651 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452654 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452657 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452659 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452662 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452664 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452667 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452669 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:05.462512 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452672 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452674 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452677 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452680 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452683 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452685 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452688 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452690 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452693 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452696 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452698 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452701 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452703 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452706 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452709 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452712 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452716 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452719 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452722 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452725 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:05.463006 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452727 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452730 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452733 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452735 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452737 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.452740 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.453248 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.461625 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.461642 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.462414 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.462423 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462483 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462488 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462492 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:05.463520 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462495 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462498 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462502 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462504 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462507 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462510 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462514 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462519 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462522 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462525 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462528 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462531 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462534 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462537 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462540 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462543 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462545 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462549 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462553 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:05.463883 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462557 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462561 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462564 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462567 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462570 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462572 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462575 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462579 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462583 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462586 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462589 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462592 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462595 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462598 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462600 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462603 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462606 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462609 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462612 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462615 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:05.464402 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462618 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462621 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462624 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462626 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462629 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462632 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462635 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462637 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462641 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462644 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462647 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462652 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462655 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462657 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462660 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462663 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462665 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462668 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462670 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:05.464892 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462674 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462676 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462679 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462682 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462685 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462687 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462690 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462693 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462695 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462698 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462700 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462723 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462727 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462730 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462733 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462736 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462739 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462742 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462745 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462748 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:05.465496 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462751 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462753 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462756 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462759 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462761 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462764 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462766 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462769 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462771 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462774 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462777 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462779 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462783 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462786 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462789 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462792 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462794 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:05.466024 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462797 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.462802 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462924 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462930 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462933 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462936 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462939 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462941 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462944 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462947 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462949 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462952 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462955 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462957 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462960 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:05.466481 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462963 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462965 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462968 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462970 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462973 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462975 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462977 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462981 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462985 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462988 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462991 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462994 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462997 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.462999 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463002 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463005 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463008 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463010 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463013 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463015 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:05.466909 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463018 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463021 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463023 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463026 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463029 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463031 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463034 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463036 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463039 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463042 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463044 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463047 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463051 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463054 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463056 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463058 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463061 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463064 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463066 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:05.467440 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463069 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463073 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463076 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463079 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463082 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463086 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463097 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463101 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463104 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463107 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463111 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463114 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463117 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463120 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463123 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463126 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463129 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463132 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:05.467903 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463134 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463137 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463140 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463142 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463145 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463147 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463167 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463170 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463174 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463177 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463180 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463183 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463185 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463188 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463191 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463193 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463196 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463199 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463201 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463204 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:05.468366 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463207 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463210 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463213 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463216 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463219 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463221 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463224 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463227 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:05.463230 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.463235 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.463362 2566 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.465397 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.466256 2566 server.go:1019] "Starting client certificate rotation" Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.466349 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 03:39:05.468880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.466932 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 03:39:05.469289 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.468428 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 03:39:05.469630 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.469611 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 03:39:05.481545 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.481519 2566 log.go:25] "Validated CRI v1 runtime API" Sep 10 03:39:05.485285 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.485267 2566 log.go:25] "Validated CRI v1 image API" Sep 10 03:39:05.486265 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.486250 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 03:39:05.491109 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.491077 2566 fs.go:135] Filesystem UUIDs: map[019c11d6-6aec-49b9-91d4-41d0ab5164df:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 944aea66-0768-467e-9da6-791be6b51c32:/dev/nvme0n1p3] Sep 10 03:39:05.491211 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.491107 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 03:39:05.495050 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.494879 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 03:39:05.496950 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.496832 2566 manager.go:216] Machine: {Timestamp:2026-09-10 03:39:05.496312254 +0000 UTC m=+0.300908683 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124036 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20fef9aaf1e387ceb09ec40e64d32e SystemUUID:ec20fef9-aaf1-e387-ceb0-9ec40e64d32e BootID:82c0acf8-8e39-4482-b964-d6074be948fd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:13:0b:ec:fb:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:13:0b:ec:fb:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:37:45:f9:f4:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 03:39:05.496950 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.496945 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 03:39:05.497085 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.497036 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 03:39:05.499852 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.499827 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 03:39:05.500041 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.499855 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 03:39:05.500578 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.500567 2566 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 03:39:05.500611 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.500580 2566 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 03:39:05.500611 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.500588 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 03:39:05.501218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.501203 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 03:39:05.501949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.501939 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 03:39:05.504552 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504539 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 10 03:39:05.505121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504866 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 03:39:05.505121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504913 2566 kubelet.go:486] "Attempting to sync node with API server" Sep 10 03:39:05.505121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504928 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 03:39:05.505121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504944 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 03:39:05.505121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504957 2566 kubelet.go:398] "Adding apiserver pod source" Sep 10 03:39:05.505121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.504983 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 03:39:05.505506 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.505490 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 03:39:05.505559 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.505523 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 03:39:05.508069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.508045 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 03:39:05.510198 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.510181 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 03:39:05.510291 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.510211 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 03:39:05.511245 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511234 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 03:39:05.511293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511251 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 03:39:05.511293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511257 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 03:39:05.511293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511263 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 03:39:05.511293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511272 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 03:39:05.511293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511277 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 03:39:05.511293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511291 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 03:39:05.511463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511296 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 03:39:05.511463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511303 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 03:39:05.511463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511308 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 03:39:05.511463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511317 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 03:39:05.511463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511321 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 03:39:05.511883 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511873 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 03:39:05.511883 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.511882 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 03:39:05.515691 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.515676 2566 server.go:1268] "Started kubelet" Sep 10 03:39:05.515902 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.515876 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 03:39:05.515951 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.515878 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 03:39:05.516008 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.515960 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 03:39:05.517288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.517269 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 03:39:05.517773 ip-10-0-130-142 systemd[1]: Started Kubernetes Kubelet. Sep 10 03:39:05.519249 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.519225 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 03:39:05.519327 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.519225 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 03:39:05.519327 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.519263 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 03:39:05.520184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.520165 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fnx7p" Sep 10 03:39:05.520887 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.520868 2566 server.go:310] "Adding debug handlers to kubelet server" Sep 10 03:39:05.523422 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.522515 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-142.ec2.internal.18d3d885a588633b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-142.ec2.internal,UID:ip-10-0-130-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-142.ec2.internal,},FirstTimestamp:2026-09-10 03:39:05.515647803 +0000 UTC m=+0.320244279,LastTimestamp:2026-09-10 03:39:05.515647803 +0000 UTC m=+0.320244279,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-142.ec2.internal,}" Sep 10 03:39:05.524050 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.524030 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 03:39:05.526623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.526605 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 03:39:05.526723 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.526682 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 03:39:05.526783 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.526717 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:05.527318 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527282 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 03:39:05.527318 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527284 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 03:39:05.527466 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527332 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 03:39:05.527466 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527411 2566 reconstruct.go:97] "Volume reconstruction finished" Sep 10 03:39:05.527466 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527420 2566 reconciler.go:29] "Reconciler: start to sync state" Sep 10 03:39:05.527619 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527515 2566 factory.go:55] Registering systemd factory Sep 10 03:39:05.527619 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527530 2566 factory.go:223] Registration of the systemd container factory successfully Sep 10 03:39:05.527789 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527771 2566 factory.go:153] Registering CRI-O factory Sep 10 03:39:05.527789 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527787 2566 factory.go:223] Registration of the crio container factory successfully Sep 10 03:39:05.527941 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527842 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 03:39:05.527941 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527860 2566 factory.go:103] Registering Raw factory Sep 10 03:39:05.527941 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527873 2566 manager.go:1196] Started watching for new ooms in manager Sep 10 03:39:05.528111 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.527999 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fnx7p" Sep 10 03:39:05.528266 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.528252 2566 manager.go:349] Starting recovery of all containers Sep 10 03:39:05.530953 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.530924 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 03:39:05.531079 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.531051 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 03:39:05.540515 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.540461 2566 manager.go:354] Recovery completed Sep 10 03:39:05.545002 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.544987 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.546903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.546883 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.546981 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.546913 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.546981 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.546924 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.547575 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.547556 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 03:39:05.547575 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.547573 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 03:39:05.547693 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.547591 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 10 03:39:05.547693 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.547591 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.548361 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.548348 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.548425 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.548372 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.548425 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.548382 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.627451 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.627417 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:05.635691 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.635661 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 03:39:05.636850 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.636823 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 03:39:05.636949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.636890 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 03:39:05.636949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.636921 2566 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 03:39:05.637038 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.636970 2566 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 10 03:39:05.639347 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.639327 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:05.684889 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.684859 2566 policy_none.go:49] "None policy: Start" Sep 10 03:39:05.684889 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.684887 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 03:39:05.684889 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.684898 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 03:39:05.685895 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.685884 2566 policy_none.go:47] "Start" Sep 10 03:39:05.714811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.714794 2566 manager.go:337] "Starting Device Plugin manager" Sep 10 03:39:05.714935 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.714837 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 03:39:05.714935 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.714850 2566 server.go:87] "Starting device plugin registration server" Sep 10 03:39:05.715320 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.715305 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 03:39:05.715384 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.715323 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 03:39:05.715506 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.715487 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 03:39:05.716179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.715572 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 03:39:05.716179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.715581 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 03:39:05.716636 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.716618 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 03:39:05.716714 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.716672 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:05.736684 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.736658 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-142.ec2.internal\" not found" node="ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.737712 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.737693 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal"] Sep 10 03:39:05.737785 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.737773 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.738916 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.738900 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.739000 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.738934 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.739000 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.738948 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.740302 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.740289 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.740428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.740413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.740462 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.740450 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.741223 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.741208 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.741292 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.741238 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.741292 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.741250 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.741292 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.741210 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.741400 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.741308 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.741400 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.741319 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.742385 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.742373 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.742437 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.742395 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.743409 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.743394 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.743538 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.743419 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.743538 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.743430 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.768977 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.768952 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-142.ec2.internal\" not found" node="ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.773417 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.773396 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-142.ec2.internal\" not found" node="ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.815680 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.815652 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:05.816620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.816605 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:05.816702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.816634 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:05.816702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.816644 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:05.816702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.816665 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.822117 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.822095 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.822117 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.822119 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-142.ec2.internal\": node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:05.828600 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.828580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c5d0660e983672ee533777021d69a5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"9c5d0660e983672ee533777021d69a5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.828710 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.828606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f0198fac28ce54a3ba5394c28e56a3d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-142.ec2.internal\" (UID: \"2f0198fac28ce54a3ba5394c28e56a3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.828710 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.828624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c5d0660e983672ee533777021d69a5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"9c5d0660e983672ee533777021d69a5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.836480 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.836461 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:05.929258 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.929225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c5d0660e983672ee533777021d69a5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"9c5d0660e983672ee533777021d69a5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.929371 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.929265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f0198fac28ce54a3ba5394c28e56a3d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-142.ec2.internal\" (UID: \"2f0198fac28ce54a3ba5394c28e56a3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.929371 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.929305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c5d0660e983672ee533777021d69a5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"9c5d0660e983672ee533777021d69a5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.929371 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.929318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c5d0660e983672ee533777021d69a5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"9c5d0660e983672ee533777021d69a5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.929472 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.929368 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c5d0660e983672ee533777021d69a5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal\" (UID: \"9c5d0660e983672ee533777021d69a5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.929472 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:05.929376 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f0198fac28ce54a3ba5394c28e56a3d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-142.ec2.internal\" (UID: \"2f0198fac28ce54a3ba5394c28e56a3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" Sep 10 03:39:05.937347 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:05.937326 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.038181 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.038094 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.071289 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.071268 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:06.076905 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.076889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" Sep 10 03:39:06.138906 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.138864 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.239495 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.239461 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.339622 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.339585 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.440735 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.440704 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.466772 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.466736 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 03:39:06.467259 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.466904 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 03:39:06.537309 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.537273 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 03:34:06 +0000 UTC" deadline="2028-04-30 13:36:01.23647987 +0000 UTC" Sep 10 03:39:06.537309 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.537304 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14361h56m54.69917966s" Sep 10 03:39:06.541192 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.541166 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.641307 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.641241 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.658536 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:06.658345 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5d0660e983672ee533777021d69a5e.slice/crio-c0cf44ad506a381ef979b7c35de67915597b820d62609b99994c77087a1d7f8d WatchSource:0}: Error finding container c0cf44ad506a381ef979b7c35de67915597b820d62609b99994c77087a1d7f8d: Status 404 returned error can't find the container with id c0cf44ad506a381ef979b7c35de67915597b820d62609b99994c77087a1d7f8d Sep 10 03:39:06.662493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.662474 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:39:06.741751 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:06.741701 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-142.ec2.internal\" not found" Sep 10 03:39:06.799397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.799369 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:06.824143 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.824104 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:06.827278 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.827258 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" Sep 10 03:39:06.840247 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.840222 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 03:39:06.841221 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.841206 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" Sep 10 03:39:06.852838 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.852814 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 03:39:06.994489 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:06.994456 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:07.508330 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.508173 2566 apiserver.go:52] "Watching apiserver" Sep 10 03:39:07.515443 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.515403 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 03:39:07.516027 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.515999 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-djlkd","kube-system/global-pull-secret-syncer-jxlz4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv","openshift-cluster-node-tuning-operator/tuned-72w2m","openshift-dns/node-resolver-95fzq","openshift-image-registry/node-ca-lssfz","openshift-network-diagnostics/network-check-target-p9dnx","openshift-network-operator/iptables-alerter-wxdlk","openshift-ovn-kubernetes/ovnkube-node-lmn64","kube-system/konnectivity-agent-7v2jq","kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal","openshift-multus/multus-69jck","openshift-multus/multus-additional-cni-plugins-lpk8r"] Sep 10 03:39:07.518196 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.518112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:07.518324 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.518198 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:07.520070 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.519723 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-69jck" Sep 10 03:39:07.520829 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.520806 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.521905 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.521846 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.522338 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.522317 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k2cl8\"" Sep 10 03:39:07.522424 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.522372 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 03:39:07.522505 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.522421 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.522567 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.522534 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 03:39:07.522649 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.522630 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.523117 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.523179 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.523398 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.523503 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t9754\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.523715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.524216 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.524530 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.525184 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.524537 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4cdbh\"" Sep 10 03:39:07.526124 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.526091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.530283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.528049 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 03:39:07.530283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.528842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.530283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.529020 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c5lcj\"" Sep 10 03:39:07.530283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.529424 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.530283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.529686 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.530283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.529974 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ttp9s\"" Sep 10 03:39:07.531763 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.531732 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.533388 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.533363 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 03:39:07.533961 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.533931 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.537292 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537270 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 03:39:07.537828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537811 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 03:39:07.538633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537509 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 03:39:07.538633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.538633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537600 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 03:39:07.538633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537698 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k45lc\"" Sep 10 03:39:07.538633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.537400 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.538957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.538884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:07.539033 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.539000 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:07.539204 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-systemd-units\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539274 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-systemd\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539327 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.539389 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-lib-modules\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539389 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-var-lib-kubelet\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.539491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovnkube-config\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-modprobe-d\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f7bf\" (UniqueName: \"kubernetes.io/projected/88ba748b-ef29-4bdc-a330-a6b6d95121aa-kube-api-access-4f7bf\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.539685 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysctl-conf\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539685 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-sys\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-system-cni-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.539792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovnkube-script-lib\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-tuned\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-registration-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-systemd\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-k8s-cni-cncf-io\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539872 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-kubelet\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-etc-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-run-netns\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539946 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-cni-bin\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.539994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-socket-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.539995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrf8s\" (UniqueName: \"kubernetes.io/projected/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-kube-api-access-hrf8s\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysconfig\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-host\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bafa2588-753b-4d1c-9854-03d99c67062f-hosts-file\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafa2588-753b-4d1c-9854-03d99c67062f-tmp-dir\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn55c\" (UniqueName: \"kubernetes.io/projected/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-kube-api-access-bn55c\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ba748b-ef29-4bdc-a330-a6b6d95121aa-host\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ba748b-ef29-4bdc-a330-a6b6d95121aa-serviceca\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovn-node-metrics-cert\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-cni-netd\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.540382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-socket-dir-parent\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-var-lib-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-etc-kubernetes\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5pj\" (UniqueName: \"kubernetes.io/projected/3bad94b7-374a-439c-92bf-0fbcaff626c3-kube-api-access-vk5pj\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysctl-d\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540499 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-cni-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-cni-bin\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-hostroot\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-conf-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-daemon-config\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540659 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-multus-certs\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.540957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3229383-1011-4e2e-9e4b-6b4a0af20586-tmp\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.540980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-kubelet\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541002 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.541067 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-slash\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-run\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-cnibin\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-run-ovn-kubernetes\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-netns\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-device-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-sys-fs\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541324 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-log-socket\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-env-overrides\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bad94b7-374a-439c-92bf-0fbcaff626c3-cni-binary-copy\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-cni-multus\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.541566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:07.542467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-ovn\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.542467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-node-log\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.542467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-kubernetes\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.542467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6s6m\" (UniqueName: \"kubernetes.io/projected/c3229383-1011-4e2e-9e4b-6b4a0af20586-kube-api-access-r6s6m\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.542467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.541632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7zq\" (UniqueName: \"kubernetes.io/projected/bafa2588-753b-4d1c-9854-03d99c67062f-kube-api-access-lg7zq\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.542765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.542740 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.544394 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.544086 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.546366 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.546279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.547535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.547382 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 03:39:07.547535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.547419 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 03:39:07.549648 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.549586 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4pmqc\"" Sep 10 03:39:07.549865 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.549778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 03:39:07.550079 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.550025 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 03:39:07.550391 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.550230 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b4v6k\"" Sep 10 03:39:07.550391 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.550260 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 03:39:07.550553 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.550408 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:39:07.550958 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.550776 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gpk6l\"" Sep 10 03:39:07.550958 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.550823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 03:39:07.568046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.567663 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sstlz" Sep 10 03:39:07.574921 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.574515 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sstlz" Sep 10 03:39:07.629461 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.629427 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 03:39:07.642499 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7zq\" (UniqueName: \"kubernetes.io/projected/bafa2588-753b-4d1c-9854-03d99c67062f-kube-api-access-lg7zq\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-systemd-units\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-systemd\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d94f243f-977b-4356-bf70-4fb75a13d985-host-slash\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-lib-modules\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-var-lib-kubelet\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.642687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovnkube-config\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf56d3ca-0c64-4c9f-a822-565d97259dd1-kubelet-config\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-modprobe-d\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f7bf\" (UniqueName: \"kubernetes.io/projected/88ba748b-ef29-4bdc-a330-a6b6d95121aa-kube-api-access-4f7bf\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysctl-conf\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-sys\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-system-cni-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovnkube-script-lib\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-tuned\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-registration-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-systemd\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.642977 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-k8s-cni-cncf-io\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf56d3ca-0c64-4c9f-a822-565d97259dd1-dbus\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91840637-38fe-40c5-841a-4ce3e56f47af-konnectivity-ca\") pod \"konnectivity-agent-7v2jq\" (UID: \"91840637-38fe-40c5-841a-4ce3e56f47af\") " pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.643061 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-kubelet\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-etc-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643116 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-run-netns\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-cni-bin\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91840637-38fe-40c5-841a-4ce3e56f47af-agent-certs\") pod \"konnectivity-agent-7v2jq\" (UID: \"91840637-38fe-40c5-841a-4ce3e56f47af\") " pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-socket-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrf8s\" (UniqueName: \"kubernetes.io/projected/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-kube-api-access-hrf8s\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d94f243f-977b-4356-bf70-4fb75a13d985-iptables-alerter-script\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbjzz\" (UniqueName: \"kubernetes.io/projected/d94f243f-977b-4356-bf70-4fb75a13d985-kube-api-access-lbjzz\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643323 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysconfig\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-host\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bafa2588-753b-4d1c-9854-03d99c67062f-hosts-file\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafa2588-753b-4d1c-9854-03d99c67062f-tmp-dir\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn55c\" (UniqueName: \"kubernetes.io/projected/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-kube-api-access-bn55c\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjfq\" (UniqueName: \"kubernetes.io/projected/3616b002-6af6-476c-aa9b-488e86caa6e4-kube-api-access-lgjfq\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ba748b-ef29-4bdc-a330-a6b6d95121aa-host\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ba748b-ef29-4bdc-a330-a6b6d95121aa-serviceca\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.643828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovn-node-metrics-cert\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-system-cni-dir\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-cni-netd\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-socket-dir-parent\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-var-lib-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643764 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-etc-kubernetes\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5pj\" (UniqueName: \"kubernetes.io/projected/3bad94b7-374a-439c-92bf-0fbcaff626c3-kube-api-access-vk5pj\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysctl-d\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-cni-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643873 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-cni-bin\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-hostroot\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-conf-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-daemon-config\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.643981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-multus-certs\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.644743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3229383-1011-4e2e-9e4b-6b4a0af20586-tmp\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-kubelet\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-slash\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-run\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-cnibin\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644148 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-run-ovn-kubernetes\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-netns\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-device-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-sys-fs\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-log-socket\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-env-overrides\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bad94b7-374a-439c-92bf-0fbcaff626c3-cni-binary-copy\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-cni-multus\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.645623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644542 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-cnibin\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644600 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdvv\" (UniqueName: \"kubernetes.io/projected/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-kube-api-access-fzdvv\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644629 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-ovn\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-node-log\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644712 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-kubernetes\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.644740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6s6m\" (UniqueName: \"kubernetes.io/projected/c3229383-1011-4e2e-9e4b-6b4a0af20586-kube-api-access-r6s6m\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.645320 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-systemd-units\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.645379 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-systemd\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.645440 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.645656 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-lib-modules\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.645709 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-var-lib-kubelet\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.645803 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646278 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-var-lib-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.646428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646428 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovnkube-config\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646521 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-etc-kubernetes\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646577 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-modprobe-d\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646786 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysctl-d\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646861 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-sys\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646902 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-cni-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.646925 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-system-cni-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647028 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysctl-conf\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647076 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-cni-bin\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647122 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-hostroot\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647218 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647159 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-conf-dir\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647292 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-cnibin\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647362 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-multus-certs\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovnkube-script-lib\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647588 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-sysconfig\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647591 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-run\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647606 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647634 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-slash\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647650 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-device-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647689 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-host\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647690 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-run-ovn-kubernetes\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.647765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647759 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-kubelet\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647792 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-systemd\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647800 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-log-socket\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647804 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-netns\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647839 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647852 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-daemon-config\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647858 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bafa2588-753b-4d1c-9854-03d99c67062f-hosts-file\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647878 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-run-k8s-cni-cncf-io\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647928 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-cni-bin\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647935 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-run-netns\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647974 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-host-cni-netd\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.647979 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-etc-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648016 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88ba748b-ef29-4bdc-a330-a6b6d95121aa-host\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648067 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-openvswitch\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648095 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-env-overrides\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648145 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-registration-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648145 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafa2588-753b-4d1c-9854-03d99c67062f-tmp-dir\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648187 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-cni-multus\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.648349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648240 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-sys-fs\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648274 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88ba748b-ef29-4bdc-a330-a6b6d95121aa-serviceca\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648284 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-multus-socket-dir-parent\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648287 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-node-log\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648345 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-kubernetes\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648381 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-run-ovn\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648403 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bad94b7-374a-439c-92bf-0fbcaff626c3-host-var-lib-kubelet\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648471 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-socket-dir\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.649365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.648591 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bad94b7-374a-439c-92bf-0fbcaff626c3-cni-binary-copy\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.650190 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.650108 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:07.650554 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.650501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" event={"ID":"2f0198fac28ce54a3ba5394c28e56a3d","Type":"ContainerStarted","Data":"f838f08ae0babe42b33b53b68b51b1d0610e45024bd9f5b421c4700c1cb24151"} Sep 10 03:39:07.651957 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.651900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" event={"ID":"9c5d0660e983672ee533777021d69a5e","Type":"ContainerStarted","Data":"c0cf44ad506a381ef979b7c35de67915597b820d62609b99994c77087a1d7f8d"} Sep 10 03:39:07.655511 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.655462 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3229383-1011-4e2e-9e4b-6b4a0af20586-etc-tuned\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.656179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.656151 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-ovn-node-metrics-cert\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.658217 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.658150 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6s6m\" (UniqueName: \"kubernetes.io/projected/c3229383-1011-4e2e-9e4b-6b4a0af20586-kube-api-access-r6s6m\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.658930 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.658884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7zq\" (UniqueName: \"kubernetes.io/projected/bafa2588-753b-4d1c-9854-03d99c67062f-kube-api-access-lg7zq\") pod \"node-resolver-95fzq\" (UID: \"bafa2588-753b-4d1c-9854-03d99c67062f\") " pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.660033 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.660009 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3229383-1011-4e2e-9e4b-6b4a0af20586-tmp\") pod \"tuned-72w2m\" (UID: \"c3229383-1011-4e2e-9e4b-6b4a0af20586\") " pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.662301 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.662267 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:07.662301 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.662298 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:07.662455 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.662314 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:07.662455 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.662397 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:39:08.162375018 +0000 UTC m=+2.966971450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:07.664811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.664788 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5pj\" (UniqueName: \"kubernetes.io/projected/3bad94b7-374a-439c-92bf-0fbcaff626c3-kube-api-access-vk5pj\") pod \"multus-69jck\" (UID: \"3bad94b7-374a-439c-92bf-0fbcaff626c3\") " pod="openshift-multus/multus-69jck" Sep 10 03:39:07.666491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.666464 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f7bf\" (UniqueName: \"kubernetes.io/projected/88ba748b-ef29-4bdc-a330-a6b6d95121aa-kube-api-access-4f7bf\") pod \"node-ca-lssfz\" (UID: \"88ba748b-ef29-4bdc-a330-a6b6d95121aa\") " pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.666959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.666933 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrf8s\" (UniqueName: \"kubernetes.io/projected/cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9-kube-api-access-hrf8s\") pod \"aws-ebs-csi-driver-node-g5bzv\" (UID: \"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.667817 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.667792 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn55c\" (UniqueName: \"kubernetes.io/projected/4f3fb80e-96cf-4bce-ab53-df7d2a5ec849-kube-api-access-bn55c\") pod \"ovnkube-node-lmn64\" (UID: \"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849\") " pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d94f243f-977b-4356-bf70-4fb75a13d985-host-slash\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf56d3ca-0c64-4c9f-a822-565d97259dd1-kubelet-config\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf56d3ca-0c64-4c9f-a822-565d97259dd1-dbus\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91840637-38fe-40c5-841a-4ce3e56f47af-konnectivity-ca\") pod \"konnectivity-agent-7v2jq\" (UID: \"91840637-38fe-40c5-841a-4ce3e56f47af\") " pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745165 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91840637-38fe-40c5-841a-4ce3e56f47af-agent-certs\") pod \"konnectivity-agent-7v2jq\" (UID: \"91840637-38fe-40c5-841a-4ce3e56f47af\") " pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745209 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d94f243f-977b-4356-bf70-4fb75a13d985-iptables-alerter-script\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745236 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbjzz\" (UniqueName: \"kubernetes.io/projected/d94f243f-977b-4356-bf70-4fb75a13d985-kube-api-access-lbjzz\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjfq\" (UniqueName: \"kubernetes.io/projected/3616b002-6af6-476c-aa9b-488e86caa6e4-kube-api-access-lgjfq\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-system-cni-dir\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745394 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-cnibin\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.745727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdvv\" (UniqueName: \"kubernetes.io/projected/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-kube-api-access-fzdvv\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745855 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf56d3ca-0c64-4c9f-a822-565d97259dd1-kubelet-config\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.745921 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d94f243f-977b-4356-bf70-4fb75a13d985-host-slash\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.746261 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.746336 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:39:08.246315906 +0000 UTC m=+3.050912329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.746506 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.746649 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.746736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.746713 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-cnibin\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.747192 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.746847 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf56d3ca-0c64-4c9f-a822-565d97259dd1-dbus\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.747533 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91840637-38fe-40c5-841a-4ce3e56f47af-konnectivity-ca\") pod \"konnectivity-agent-7v2jq\" (UID: \"91840637-38fe-40c5-841a-4ce3e56f47af\") " pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.747599 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d94f243f-977b-4356-bf70-4fb75a13d985-iptables-alerter-script\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.747668 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3616b002-6af6-476c-aa9b-488e86caa6e4-system-cni-dir\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.747751 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:07.747806 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:08.247790842 +0000 UTC m=+3.052387266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.748351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.748780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.748730 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3616b002-6af6-476c-aa9b-488e86caa6e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.750685 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.750655 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91840637-38fe-40c5-841a-4ce3e56f47af-agent-certs\") pod \"konnectivity-agent-7v2jq\" (UID: \"91840637-38fe-40c5-841a-4ce3e56f47af\") " pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.761448 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.761358 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbjzz\" (UniqueName: \"kubernetes.io/projected/d94f243f-977b-4356-bf70-4fb75a13d985-kube-api-access-lbjzz\") pod \"iptables-alerter-wxdlk\" (UID: \"d94f243f-977b-4356-bf70-4fb75a13d985\") " pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:07.761624 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.761597 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdvv\" (UniqueName: \"kubernetes.io/projected/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-kube-api-access-fzdvv\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:07.761940 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.761919 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjfq\" (UniqueName: \"kubernetes.io/projected/3616b002-6af6-476c-aa9b-488e86caa6e4-kube-api-access-lgjfq\") pod \"multus-additional-cni-plugins-lpk8r\" (UID: \"3616b002-6af6-476c-aa9b-488e86caa6e4\") " pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.839609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.839561 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-69jck" Sep 10 03:39:07.851028 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.850985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" Sep 10 03:39:07.861251 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.861202 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72w2m" Sep 10 03:39:07.869176 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.869136 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-95fzq" Sep 10 03:39:07.879066 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.879032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lssfz" Sep 10 03:39:07.886939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.886913 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:07.895873 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.895849 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:07.902952 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.902930 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" Sep 10 03:39:07.910565 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:07.910540 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wxdlk" Sep 10 03:39:08.251140 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:08.251098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:08.251363 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:08.251189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:08.251363 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:08.251260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:08.251363 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251269 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:08.251363 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251342 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:09.251321341 +0000 UTC m=+4.055917764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:08.251558 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251374 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:08.251558 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251447 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:39:09.251426273 +0000 UTC m=+4.056022702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:08.251558 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251377 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:08.251558 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251484 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:08.251558 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251503 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:08.251758 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.251582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:39:09.251568993 +0000 UTC m=+4.056165416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:08.576845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:08.576754 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 03:34:08 +0000 UTC" deadline="2028-02-27 22:18:01.833447826 +0000 UTC" Sep 10 03:39:08.576845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:08.576796 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12858h38m53.256654245s" Sep 10 03:39:08.638098 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:08.638059 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:08.638296 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:08.638202 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:08.797925 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.797891 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3fb80e_96cf_4bce_ab53_df7d2a5ec849.slice/crio-14d28a3548667223d8d5f67032a598c54181c7c7fd906b72c70c100e1108116e WatchSource:0}: Error finding container 14d28a3548667223d8d5f67032a598c54181c7c7fd906b72c70c100e1108116e: Status 404 returned error can't find the container with id 14d28a3548667223d8d5f67032a598c54181c7c7fd906b72c70c100e1108116e Sep 10 03:39:08.817487 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.817459 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94f243f_977b_4356_bf70_4fb75a13d985.slice/crio-f80372c12f9f8395bcdf53c49a7620e9a2a1f37990be0b546d463d16c8039b2d WatchSource:0}: Error finding container f80372c12f9f8395bcdf53c49a7620e9a2a1f37990be0b546d463d16c8039b2d: Status 404 returned error can't find the container with id f80372c12f9f8395bcdf53c49a7620e9a2a1f37990be0b546d463d16c8039b2d Sep 10 03:39:08.818765 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.818678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafa2588_753b_4d1c_9854_03d99c67062f.slice/crio-69483900f1ddde2f33c02be90ee23c409670b8be58c1e3d29a323ce9e1cf5b67 WatchSource:0}: Error finding container 69483900f1ddde2f33c02be90ee23c409670b8be58c1e3d29a323ce9e1cf5b67: Status 404 returned error can't find the container with id 69483900f1ddde2f33c02be90ee23c409670b8be58c1e3d29a323ce9e1cf5b67 Sep 10 03:39:08.819156 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.819132 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ba748b_ef29_4bdc_a330_a6b6d95121aa.slice/crio-53a6600524248ddc3abea0b014830746ca60b4edec11e1ac08924551d70f46cf WatchSource:0}: Error finding container 53a6600524248ddc3abea0b014830746ca60b4edec11e1ac08924551d70f46cf: Status 404 returned error can't find the container with id 53a6600524248ddc3abea0b014830746ca60b4edec11e1ac08924551d70f46cf Sep 10 03:39:08.821019 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.820894 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3229383_1011_4e2e_9e4b_6b4a0af20586.slice/crio-be5ee46089e966c30e76e6109219bdbf96ffcb682a3d03d63ad45a813885b25c WatchSource:0}: Error finding container be5ee46089e966c30e76e6109219bdbf96ffcb682a3d03d63ad45a813885b25c: Status 404 returned error can't find the container with id be5ee46089e966c30e76e6109219bdbf96ffcb682a3d03d63ad45a813885b25c Sep 10 03:39:08.823064 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.822771 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd98cc24_1455_4f8b_94dc_78b1f1d4d8d9.slice/crio-6ea4bb57f583fb62b5060ef05902f125ef748ca539e886bd47e55360b036bfc8 WatchSource:0}: Error finding container 6ea4bb57f583fb62b5060ef05902f125ef748ca539e886bd47e55360b036bfc8: Status 404 returned error can't find the container with id 6ea4bb57f583fb62b5060ef05902f125ef748ca539e886bd47e55360b036bfc8 Sep 10 03:39:08.823371 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.823350 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3616b002_6af6_476c_aa9b_488e86caa6e4.slice/crio-e1fd15f881043537a459c2d2947046fc65183d5195d9a765ac598aa64e207a6f WatchSource:0}: Error finding container e1fd15f881043537a459c2d2947046fc65183d5195d9a765ac598aa64e207a6f: Status 404 returned error can't find the container with id e1fd15f881043537a459c2d2947046fc65183d5195d9a765ac598aa64e207a6f Sep 10 03:39:08.825555 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.825326 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bad94b7_374a_439c_92bf_0fbcaff626c3.slice/crio-c44167e642e69b10b40d711d6dfc8f8d17a293a8788277ef80717262bc467eff WatchSource:0}: Error finding container c44167e642e69b10b40d711d6dfc8f8d17a293a8788277ef80717262bc467eff: Status 404 returned error can't find the container with id c44167e642e69b10b40d711d6dfc8f8d17a293a8788277ef80717262bc467eff Sep 10 03:39:08.826302 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:08.826261 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91840637_38fe_40c5_841a_4ce3e56f47af.slice/crio-ddd63cc7f8c3b423414f57f68e924aaacbfd475fc8d7df54d78180fb053182fe WatchSource:0}: Error finding container ddd63cc7f8c3b423414f57f68e924aaacbfd475fc8d7df54d78180fb053182fe: Status 404 returned error can't find the container with id ddd63cc7f8c3b423414f57f68e924aaacbfd475fc8d7df54d78180fb053182fe Sep 10 03:39:09.259032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.258996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:09.259244 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.259046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:09.259244 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.259083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:09.259244 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259151 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:09.259244 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259224 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:11.259208629 +0000 UTC m=+6.063805061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:09.259509 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259262 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:09.259509 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259315 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:09.259509 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259337 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:09.259509 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259339 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:39:11.259320099 +0000 UTC m=+6.063916528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:09.259509 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259348 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:09.259509 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.259383 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:39:11.259373667 +0000 UTC m=+6.063970100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:09.577455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.577407 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 03:34:08 +0000 UTC" deadline="2028-05-02 02:07:52.095687549 +0000 UTC" Sep 10 03:39:09.577455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.577454 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14398h28m42.518239469s" Sep 10 03:39:09.638402 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.638363 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:09.638582 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.638524 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:09.640955 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.640925 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:09.641109 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:09.641047 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:09.665392 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.665353 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerStarted","Data":"e1fd15f881043537a459c2d2947046fc65183d5195d9a765ac598aa64e207a6f"} Sep 10 03:39:09.673459 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.673364 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" event={"ID":"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9","Type":"ContainerStarted","Data":"6ea4bb57f583fb62b5060ef05902f125ef748ca539e886bd47e55360b036bfc8"} Sep 10 03:39:09.681444 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.681405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"14d28a3548667223d8d5f67032a598c54181c7c7fd906b72c70c100e1108116e"} Sep 10 03:39:09.706219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.706181 2566 generic.go:356] "Generic (PLEG): container finished" podID="9c5d0660e983672ee533777021d69a5e" containerID="342959fb084f0f1a0837456869f88a2e9aabe1da212a0a3647ae0bb08ba92013" exitCode=0 Sep 10 03:39:09.719874 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.719686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" event={"ID":"9c5d0660e983672ee533777021d69a5e","Type":"ContainerDied","Data":"342959fb084f0f1a0837456869f88a2e9aabe1da212a0a3647ae0bb08ba92013"} Sep 10 03:39:09.731145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.731114 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-95fzq" event={"ID":"bafa2588-753b-4d1c-9854-03d99c67062f","Type":"ContainerStarted","Data":"69483900f1ddde2f33c02be90ee23c409670b8be58c1e3d29a323ce9e1cf5b67"} Sep 10 03:39:09.748845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.748722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7v2jq" event={"ID":"91840637-38fe-40c5-841a-4ce3e56f47af","Type":"ContainerStarted","Data":"ddd63cc7f8c3b423414f57f68e924aaacbfd475fc8d7df54d78180fb053182fe"} Sep 10 03:39:09.761676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.761585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72w2m" event={"ID":"c3229383-1011-4e2e-9e4b-6b4a0af20586","Type":"ContainerStarted","Data":"be5ee46089e966c30e76e6109219bdbf96ffcb682a3d03d63ad45a813885b25c"} Sep 10 03:39:09.770447 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.770406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lssfz" event={"ID":"88ba748b-ef29-4bdc-a330-a6b6d95121aa","Type":"ContainerStarted","Data":"53a6600524248ddc3abea0b014830746ca60b4edec11e1ac08924551d70f46cf"} Sep 10 03:39:09.790633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.790593 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wxdlk" event={"ID":"d94f243f-977b-4356-bf70-4fb75a13d985","Type":"ContainerStarted","Data":"f80372c12f9f8395bcdf53c49a7620e9a2a1f37990be0b546d463d16c8039b2d"} Sep 10 03:39:09.799086 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.799047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" event={"ID":"2f0198fac28ce54a3ba5394c28e56a3d","Type":"ContainerStarted","Data":"4157a6e174091f9d9fa176beda8719b9c8a29523e784705767bb4f6feb5e705f"} Sep 10 03:39:09.802325 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:09.802248 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-69jck" event={"ID":"3bad94b7-374a-439c-92bf-0fbcaff626c3","Type":"ContainerStarted","Data":"c44167e642e69b10b40d711d6dfc8f8d17a293a8788277ef80717262bc467eff"} Sep 10 03:39:10.638064 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:10.637521 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:10.638064 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:10.637666 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:10.826966 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:10.826879 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" event={"ID":"9c5d0660e983672ee533777021d69a5e","Type":"ContainerStarted","Data":"6f41bcf011bc86ebabb6820d7d6b20c95f6755d69601974082e84230b63e51c0"} Sep 10 03:39:10.842992 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:10.842924 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-142.ec2.internal" podStartSLOduration=3.842851386 podStartE2EDuration="3.842851386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:09.815087192 +0000 UTC m=+4.619683634" watchObservedRunningTime="2026-09-10 03:39:10.842851386 +0000 UTC m=+5.647447829" Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:11.283217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:11.283287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:11.283320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.283493 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.283511 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.283525 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.283590 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:39:15.283569269 +0000 UTC m=+10.088165704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.284003 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.284049 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:15.284034361 +0000 UTC m=+10.088630794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.284110 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:11.284179 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.284145 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:39:15.284132294 +0000 UTC m=+10.088728719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:11.649773 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:11.649651 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:11.650263 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.649787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:11.650263 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:11.650172 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:11.650404 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:11.650309 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:12.638174 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:12.638123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:12.638385 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:12.638297 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:13.637655 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:13.637615 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:13.638197 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:13.637793 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:13.638197 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:13.638188 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:13.638360 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:13.638305 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:14.638150 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:14.638071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:14.638585 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:14.638206 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:15.319529 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:15.319486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:15.319694 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319642 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:15.319694 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:15.319659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:15.319694 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:15.319692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:15.319851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319710 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:23.319693186 +0000 UTC m=+18.124289609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:15.319851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319790 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:15.319851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319801 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:15.319851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319816 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:15.319851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319831 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:15.319851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319852 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:39:23.319834384 +0000 UTC m=+18.124430819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:15.320162 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.319871 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:39:23.319859456 +0000 UTC m=+18.124455883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:15.639271 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:15.639154 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:15.639743 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.639305 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:15.639896 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:15.639748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:15.639896 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:15.639854 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:16.638275 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:16.638232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:16.638451 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:16.638371 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:17.642658 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:17.641912 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:17.642658 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:17.642047 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:17.642658 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:17.642472 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:17.642658 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:17.642569 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:18.638117 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:18.638083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:18.638294 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:18.638206 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:19.637539 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:19.637507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:19.637893 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:19.637620 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:19.637893 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:19.637674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:19.637893 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:19.637785 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:20.637569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:20.637533 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:20.637959 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:20.637661 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:21.637187 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:21.637132 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:21.637378 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:21.637143 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:21.637378 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:21.637278 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:21.637378 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:21.637359 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:22.637294 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:22.637257 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:22.637736 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:22.637360 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:23.380249 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:23.380215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:23.380249 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:23.380251 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:23.380287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380357 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380369 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380397 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380418 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:39:39.380402264 +0000 UTC m=+34.184998684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380418 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380433 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380433 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:39.380426788 +0000 UTC m=+34.185023204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:23.380493 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.380491 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:39:39.380475976 +0000 UTC m=+34.185072406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:23.637290 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:23.637219 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:23.637427 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.637331 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:23.637427 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:23.637387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:23.637708 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:23.637479 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:24.638082 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:24.638042 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:24.638495 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:24.638191 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:25.638233 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:25.638143 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:25.638697 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:25.638284 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:25.638697 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:25.638321 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:25.638697 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:25.638410 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:26.637456 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:26.637423 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:26.637625 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:26.637543 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:27.637338 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.637145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:27.638094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.637191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:27.638094 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:27.637446 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:27.638094 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:27.637516 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:27.862208 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.862114 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-69jck" event={"ID":"3bad94b7-374a-439c-92bf-0fbcaff626c3","Type":"ContainerStarted","Data":"30ccedf08679543cd280f4f39555240bded5a209ff0f1ec0eae5bc9204297840"} Sep 10 03:39:27.863882 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.863853 2566 generic.go:356] "Generic (PLEG): container finished" podID="3616b002-6af6-476c-aa9b-488e86caa6e4" containerID="57cd2baf4fe9f3634ed9202875d9d79fdfc37bb884b0c3866569b7f3daf65319" exitCode=0 Sep 10 03:39:27.863996 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.863932 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerDied","Data":"57cd2baf4fe9f3634ed9202875d9d79fdfc37bb884b0c3866569b7f3daf65319"} Sep 10 03:39:27.865880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.865847 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" event={"ID":"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9","Type":"ContainerStarted","Data":"f4cb28284ab65884b3c252b6cb91d59eddf4b310b0f51d0f42a73caece59f2f8"} Sep 10 03:39:27.869332 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.869308 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"b7e5189f2b61ee06d8f061e60e847b3a00b0e2ee52229ebbc4ef312b4a878ba0"} Sep 10 03:39:27.869422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.869380 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"d8a743b21b8218ec677e86eed238a09af6e82cd5afad1d81e5ca43226642abb9"} Sep 10 03:39:27.869532 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.869451 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"b8011e56b6330fce3995d7a1c1072921fadd07613b8289a80d1eec6a128268cf"} Sep 10 03:39:27.869532 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.869500 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"9286d02595e58e50afea7dc03dd4251763fcb496673461a8796007676a3337fd"} Sep 10 03:39:27.869637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.869543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"18f1c614726ec520fe59c4fee93a4ecda2faae3689253bd249e449834ce6a016"} Sep 10 03:39:27.869637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.869572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"bec29bb5b3df78194b23aa3503ee5b2e7d3cdc4ba64c7fc2dc11d46bebfe7b54"} Sep 10 03:39:27.870811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.870790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-95fzq" event={"ID":"bafa2588-753b-4d1c-9854-03d99c67062f","Type":"ContainerStarted","Data":"79bfc61489901702a45562deafcb7180ef96d52f8374c11f99ef51deab594dd5"} Sep 10 03:39:27.872379 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.872356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7v2jq" event={"ID":"91840637-38fe-40c5-841a-4ce3e56f47af","Type":"ContainerStarted","Data":"3c312f9d2855ba99d29f63a45d3ae3ee94b20500bfdcd6d7015778b8d829a920"} Sep 10 03:39:27.873868 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.873846 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72w2m" event={"ID":"c3229383-1011-4e2e-9e4b-6b4a0af20586","Type":"ContainerStarted","Data":"42e6f50dcb2164da5cedf33cc3bac553b28fce004dd16a0fe27070b80c06de53"} Sep 10 03:39:27.875396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.875373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lssfz" event={"ID":"88ba748b-ef29-4bdc-a330-a6b6d95121aa","Type":"ContainerStarted","Data":"360dd878f5c775e489b8f84050aca3ac686ae1600c4d83d1ecb3fba30255290e"} Sep 10 03:39:27.880208 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.880165 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-142.ec2.internal" podStartSLOduration=20.880135273 podStartE2EDuration="20.880135273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:10.843394621 +0000 UTC m=+5.647991064" watchObservedRunningTime="2026-09-10 03:39:27.880135273 +0000 UTC m=+22.684731712" Sep 10 03:39:27.880400 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.880372 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-69jck" podStartSLOduration=3.5823357 podStartE2EDuration="21.880359675s" totalImagesPullingTime="18.298023975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:27.880076174 +0000 UTC m=+22.684672613" watchObservedRunningTime="2026-09-10 03:39:27.880359675 +0000 UTC m=+22.684956114" Sep 10 03:39:27.896484 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.896423 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7v2jq" podStartSLOduration=3.668077596 podStartE2EDuration="21.896408055s" totalImagesPullingTime="18.228330459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:27.896017804 +0000 UTC m=+22.700614244" watchObservedRunningTime="2026-09-10 03:39:27.896408055 +0000 UTC m=+22.701004492" Sep 10 03:39:27.929633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.929584 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-72w2m" podStartSLOduration=3.656055893 podStartE2EDuration="21.929569632s" totalImagesPullingTime="18.273513739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:27.929337115 +0000 UTC m=+22.733933553" watchObservedRunningTime="2026-09-10 03:39:27.929569632 +0000 UTC m=+22.734166122" Sep 10 03:39:27.960416 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.960219 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-95fzq" podStartSLOduration=3.689292689 podStartE2EDuration="21.960203075s" totalImagesPullingTime="18.270910386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:27.945827714 +0000 UTC m=+22.750424154" watchObservedRunningTime="2026-09-10 03:39:27.960203075 +0000 UTC m=+22.764799513" Sep 10 03:39:27.960586 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:27.960459 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lssfz" podStartSLOduration=3.709270586 podStartE2EDuration="21.960451366s" totalImagesPullingTime="18.25118078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:27.959858354 +0000 UTC m=+22.764454791" watchObservedRunningTime="2026-09-10 03:39:27.960451366 +0000 UTC m=+22.765047804" Sep 10 03:39:28.009494 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.009463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:28.080197 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.080146 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:28.431004 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.430971 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:28.484661 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.484629 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:28.637618 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.637510 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:28.638123 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:28.638083 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:28.726130 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.726099 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 03:39:28.734077 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.733967 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T03:39:28.726123815Z","UUID":"c2873095-707f-4bde-9b6a-2c41162c3626","Handler":null,"Name":"","Endpoint":""} Sep 10 03:39:28.735606 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.735586 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 03:39:28.735697 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.735621 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 03:39:28.878807 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.878774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" event={"ID":"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9","Type":"ContainerStarted","Data":"b1cfe4fc33567ea9e3f9f4837cb7c64e54b58122b662044d5ea6d57a6427a608"} Sep 10 03:39:28.880193 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.880148 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wxdlk" event={"ID":"d94f243f-977b-4356-bf70-4fb75a13d985","Type":"ContainerStarted","Data":"a063f3e8e520849f8c44eedd7136e88e4d1bcd5732a724a5bd5cf228d7b78a8c"} Sep 10 03:39:28.897180 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:28.895878 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wxdlk" podStartSLOduration=4.643414536 podStartE2EDuration="22.89585209s" totalImagesPullingTime="18.252437554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:28.894737585 +0000 UTC m=+23.699334024" watchObservedRunningTime="2026-09-10 03:39:28.89585209 +0000 UTC m=+23.700448545" Sep 10 03:39:29.017715 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.017466 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:29.122292 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.122259 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:29.637636 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.637597 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:29.638169 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.637603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:29.638169 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:29.637739 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:29.638169 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:29.637855 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:29.884786 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.884741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" event={"ID":"cd98cc24-1455-4f8b-94dc-78b1f1d4d8d9","Type":"ContainerStarted","Data":"a7e706db0283f13cd6df02d22e1b2e88b69233961ae7ad6ae6b264c1145f8712"} Sep 10 03:39:29.889026 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.888942 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"b35dfa90e82e4ad912e3255a12677058b778a55205305849436cf60070fc923f"} Sep 10 03:39:29.902145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:29.902101 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5bzv" podStartSLOduration=3.39611905 podStartE2EDuration="23.902085515s" totalImagesPullingTime="20.505966465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:29.901811724 +0000 UTC m=+24.706408162" watchObservedRunningTime="2026-09-10 03:39:29.902085515 +0000 UTC m=+24.706681953" Sep 10 03:39:30.637381 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:30.637346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:30.637563 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:30.637477 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:31.263434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.263398 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:31.320424 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.320387 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:31.637159 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.637066 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:31.637328 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:31.637229 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:31.637328 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.637275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:31.637457 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:31.637398 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:31.698405 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.698357 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:31.699067 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.699048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:31.893657 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.893582 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:31.894163 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.894129 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7v2jq" Sep 10 03:39:31.958044 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:31.958006 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:32.638069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:32.637907 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:32.638656 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:32.638140 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:32.897952 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:32.897864 2566 generic.go:356] "Generic (PLEG): container finished" podID="3616b002-6af6-476c-aa9b-488e86caa6e4" containerID="9e1eeb3f407d2be47ffc126d0f102735782c8178dddd27d1a3407c164e8983f4" exitCode=0 Sep 10 03:39:32.898118 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:32.897954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerDied","Data":"9e1eeb3f407d2be47ffc126d0f102735782c8178dddd27d1a3407c164e8983f4"} Sep 10 03:39:32.901903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:32.901870 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" event={"ID":"4f3fb80e-96cf-4bce-ab53-df7d2a5ec849","Type":"ContainerStarted","Data":"f323044c3d68e10c23609ec562f27b6fb459bc4db085476fa2b60b330c0416b7"} Sep 10 03:39:32.952870 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:32.952815 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" podStartSLOduration=8.611041522 podStartE2EDuration="26.952799022s" totalImagesPullingTime="18.3417575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:32.951328678 +0000 UTC m=+27.755925140" watchObservedRunningTime="2026-09-10 03:39:32.952799022 +0000 UTC m=+27.757395461" Sep 10 03:39:33.637982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.637356 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:33.637982 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:33.637484 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:33.637982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.637556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:33.637982 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:33.637630 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:33.653724 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.653689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:33.754123 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.754090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:33.905237 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.905038 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:33.905237 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.905212 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:33.905437 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.905262 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:33.920329 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.920299 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:33.920519 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:33.920506 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:39:34.349384 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.349348 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxlz4"] Sep 10 03:39:34.349594 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.349577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:34.349707 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:34.349683 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:34.352715 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.352688 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-djlkd"] Sep 10 03:39:34.352854 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.352807 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:34.352931 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:34.352912 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:34.353480 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.353457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p9dnx"] Sep 10 03:39:34.353588 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.353542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:34.353639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:34.353608 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:34.597091 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.597055 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:34.658983 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.658944 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:34.743979 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.743952 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:34.908786 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.908695 2566 generic.go:356] "Generic (PLEG): container finished" podID="3616b002-6af6-476c-aa9b-488e86caa6e4" containerID="846d6be2ec063f3b876265249bdfb82fdec8fe5e5fddf6e4ddb2c38d52a6859b" exitCode=0 Sep 10 03:39:34.908956 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:34.908780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerDied","Data":"846d6be2ec063f3b876265249bdfb82fdec8fe5e5fddf6e4ddb2c38d52a6859b"} Sep 10 03:39:35.639045 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:35.639009 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:35.639252 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:35.639162 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:35.639571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:35.639545 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:35.639668 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:35.639647 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:35.913180 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:35.913135 2566 generic.go:356] "Generic (PLEG): container finished" podID="3616b002-6af6-476c-aa9b-488e86caa6e4" containerID="c3ed6aa45d8ed3cfc3df4a0ae28ab8dfd29e07afbc934a10884d7d0c3af1b42a" exitCode=0 Sep 10 03:39:35.913578 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:35.913183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerDied","Data":"c3ed6aa45d8ed3cfc3df4a0ae28ab8dfd29e07afbc934a10884d7d0c3af1b42a"} Sep 10 03:39:36.637765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:36.637530 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:36.637907 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:36.637874 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:37.483696 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:37.483661 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:37.638078 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:37.638047 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:37.638284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:37.638049 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:37.638284 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:37.638194 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:37.638396 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:37.638286 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:37.757314 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:37.757234 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:37.821206 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:37.821176 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:38.374837 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.374804 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:38.474228 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.474191 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:38.598506 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.598476 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:38.637987 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.637954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:38.638187 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:38.638075 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxlz4" podUID="bf56d3ca-0c64-4c9f-a822-565d97259dd1" Sep 10 03:39:38.699059 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.699021 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:38.799887 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.799805 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:38.900189 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:38.900143 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95fzq_bafa2588-753b-4d1c-9854-03d99c67062f/dns-node-resolver/0.log" Sep 10 03:39:39.083106 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.083026 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:39.183112 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.183077 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:39.397367 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.397277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:39.397367 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.397352 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.397386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397415 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397483 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret podName:bf56d3ca-0c64-4c9f-a822-565d97259dd1 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.397462556 +0000 UTC m=+66.202058992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret") pod "global-pull-secret-syncer-jxlz4" (UID: "bf56d3ca-0c64-4c9f-a822-565d97259dd1") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397482 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397513 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397531 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397544 2566 projected.go:196] Error preparing data for projected volume kube-api-access-vnvkm for pod openshift-network-diagnostics/network-check-target-p9dnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397558 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs podName:d370d3ab-9d24-43c3-9eaa-2916f5aa97fc nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.397539326 +0000 UTC m=+66.202135756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs") pod "network-metrics-daemon-djlkd" (UID: "d370d3ab-9d24-43c3-9eaa-2916f5aa97fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:39.397605 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.397587 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm podName:575b6ab4-8cfe-468f-8326-595f7316feff nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.397571258 +0000 UTC m=+66.202167681 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvkm" (UniqueName: "kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm") pod "network-check-target-p9dnx" (UID: "575b6ab4-8cfe-468f-8326-595f7316feff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:39.637433 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.637401 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:39.637865 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.637533 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djlkd" podUID="d370d3ab-9d24-43c3-9eaa-2916f5aa97fc" Sep 10 03:39:39.637865 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.637606 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:39.637865 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:39.637720 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p9dnx" podUID="575b6ab4-8cfe-468f-8326-595f7316feff" Sep 10 03:39:39.712736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.712694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:39.766517 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.766470 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:39.900069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:39.900038 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lssfz_88ba748b-ef29-4bdc-a330-a6b6d95121aa/node-ca/0.log" Sep 10 03:39:40.049084 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.049010 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-142.ec2.internal" event="NodeReady" Sep 10 03:39:40.049257 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.049162 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 03:39:40.080985 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.080753 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5695c6fd5c-lncvv"] Sep 10 03:39:40.132316 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.132289 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-85g9d"] Sep 10 03:39:40.132483 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.132427 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.134837 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.134633 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 03:39:40.134837 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.134733 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 03:39:40.134837 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.134750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8svdn\"" Sep 10 03:39:40.134837 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.134785 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 03:39:40.140580 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.140555 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 03:39:40.145268 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.145234 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sh4n8"] Sep 10 03:39:40.145397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.145364 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.147479 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.147461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 03:39:40.147605 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.147490 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5z68m\"" Sep 10 03:39:40.147605 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.147505 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 03:39:40.163382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.163357 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5695c6fd5c-lncvv"] Sep 10 03:39:40.163518 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.163397 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-85g9d"] Sep 10 03:39:40.163518 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.163426 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sh4n8"] Sep 10 03:39:40.163518 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.163450 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rbscm"] Sep 10 03:39:40.163518 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.163485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.168376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.166068 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 03:39:40.168376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.166406 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2nrct\"" Sep 10 03:39:40.168376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.166445 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 03:39:40.168376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.166630 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 03:39:40.168376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.166707 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 03:39:40.189520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.189489 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbscm"] Sep 10 03:39:40.189663 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.189615 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.191857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.191831 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 03:39:40.191857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.191843 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 03:39:40.192033 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.191989 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 03:39:40.192033 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.191994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tssz\"" Sep 10 03:39:40.235450 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.235416 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:40.301485 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.301389 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:40.305456 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e150fc37-9008-4a93-82c5-e775f6bd9894-ca-trust-extracted\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.305609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.305609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce762875-56c5-4d4b-be65-437d29a2faca-config-volume\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.305609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e36a3a11-7dea-4c1f-917f-02a93918a190-cert\") pod \"ingress-canary-rbscm\" (UID: \"e36a3a11-7dea-4c1f-917f-02a93918a190\") " pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.305609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-trusted-ca\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.305609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305596 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce762875-56c5-4d4b-be65-437d29a2faca-tmp-dir\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305625 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs4qx\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-kube-api-access-rs4qx\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbnl\" (UniqueName: \"kubernetes.io/projected/ce762875-56c5-4d4b-be65-437d29a2faca-kube-api-access-nnbnl\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-image-registry-private-configuration\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.305871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drp9z\" (UniqueName: \"kubernetes.io/projected/e36a3a11-7dea-4c1f-917f-02a93918a190-kube-api-access-drp9z\") pod \"ingress-canary-rbscm\" (UID: \"e36a3a11-7dea-4c1f-917f-02a93918a190\") " pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.306222 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-bound-sa-token\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.306222 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4465e614-8d9c-4493-a7b2-275c639f88ad-crio-socket\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.306222 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305935 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4465e614-8d9c-4493-a7b2-275c639f88ad-data-volume\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.306222 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vl8\" (UniqueName: \"kubernetes.io/projected/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-api-access-j5vl8\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.306222 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-certificates\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.306222 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.305978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-installation-pull-secrets\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.406330 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406297 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-bound-sa-token\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.406522 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4465e614-8d9c-4493-a7b2-275c639f88ad-crio-socket\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.406522 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4465e614-8d9c-4493-a7b2-275c639f88ad-data-volume\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.406522 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vl8\" (UniqueName: \"kubernetes.io/projected/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-api-access-j5vl8\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.406522 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-certificates\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-installation-pull-secrets\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e150fc37-9008-4a93-82c5-e775f6bd9894-ca-trust-extracted\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce762875-56c5-4d4b-be65-437d29a2faca-config-volume\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e36a3a11-7dea-4c1f-917f-02a93918a190-cert\") pod \"ingress-canary-rbscm\" (UID: \"e36a3a11-7dea-4c1f-917f-02a93918a190\") " pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406677 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4465e614-8d9c-4493-a7b2-275c639f88ad-data-volume\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-trusted-ca\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.406728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce762875-56c5-4d4b-be65-437d29a2faca-tmp-dir\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406597 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4465e614-8d9c-4493-a7b2-275c639f88ad-crio-socket\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406770 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.406801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.406750 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.406882 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.406895 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5695c6fd5c-lncvv: secret "image-registry-tls" not found Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.406897 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:39:40.407069 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.406842 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407092 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e150fc37-9008-4a93-82c5-e775f6bd9894-ca-trust-extracted\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.406907 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls podName:ce762875-56c5-4d4b-be65-437d29a2faca nodeName:}" failed. No retries permitted until 2026-09-10 03:39:40.906885488 +0000 UTC m=+35.711481926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls") pod "dns-default-85g9d" (UID: "ce762875-56c5-4d4b-be65-437d29a2faca") : secret "dns-default-metrics-tls" not found Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.407146 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls podName:e150fc37-9008-4a93-82c5-e775f6bd9894 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:40.907129467 +0000 UTC m=+35.711725884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls") pod "image-registry-5695c6fd5c-lncvv" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894") : secret "image-registry-tls" not found Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.407185 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:40.90717622 +0000 UTC m=+35.711772647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : configmap "kube-rbac-proxy" not found Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.407199 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:40.907191216 +0000 UTC m=+35.711787633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : secret "insights-runtime-extractor-tls" not found Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs4qx\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-kube-api-access-rs4qx\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbnl\" (UniqueName: \"kubernetes.io/projected/ce762875-56c5-4d4b-be65-437d29a2faca-kube-api-access-nnbnl\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407296 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-certificates\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-image-registry-private-configuration\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drp9z\" (UniqueName: \"kubernetes.io/projected/e36a3a11-7dea-4c1f-917f-02a93918a190-kube-api-access-drp9z\") pod \"ingress-canary-rbscm\" (UID: \"e36a3a11-7dea-4c1f-917f-02a93918a190\") " pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407385 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce762875-56c5-4d4b-be65-437d29a2faca-tmp-dir\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.407526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407418 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce762875-56c5-4d4b-be65-437d29a2faca-config-volume\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.408019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.407909 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-trusted-ca\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.411550 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.411510 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-image-registry-private-configuration\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.411550 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.411534 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-installation-pull-secrets\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.411728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.411557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e36a3a11-7dea-4c1f-917f-02a93918a190-cert\") pod \"ingress-canary-rbscm\" (UID: \"e36a3a11-7dea-4c1f-917f-02a93918a190\") " pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.417986 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.417956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vl8\" (UniqueName: \"kubernetes.io/projected/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-api-access-j5vl8\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.418296 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.418241 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbnl\" (UniqueName: \"kubernetes.io/projected/ce762875-56c5-4d4b-be65-437d29a2faca-kube-api-access-nnbnl\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.418702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.418678 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs4qx\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-kube-api-access-rs4qx\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.418825 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.418780 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-bound-sa-token\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.419459 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.419419 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drp9z\" (UniqueName: \"kubernetes.io/projected/e36a3a11-7dea-4c1f-917f-02a93918a190-kube-api-access-drp9z\") pod \"ingress-canary-rbscm\" (UID: \"e36a3a11-7dea-4c1f-917f-02a93918a190\") " pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.500240 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.500201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbscm" Sep 10 03:39:40.638170 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.638041 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:39:40.641262 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.641233 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 03:39:40.699852 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.699817 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9lmv9"] Sep 10 03:39:40.716354 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.716317 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9lmv9"] Sep 10 03:39:40.716480 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.716415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.718823 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.718799 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 03:39:40.718935 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.718822 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 03:39:40.718935 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.718845 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 03:39:40.718935 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.718799 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-l4dd2\"" Sep 10 03:39:40.718935 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.718850 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 03:39:40.776989 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.776965 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:40.812670 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.812582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/63601a52-04de-43a9-b25b-a3f2c9664618-signing-key\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.812670 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.812638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qv59\" (UniqueName: \"kubernetes.io/projected/63601a52-04de-43a9-b25b-a3f2c9664618-kube-api-access-6qv59\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.812862 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.812785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/63601a52-04de-43a9-b25b-a3f2c9664618-signing-cabundle\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.846963 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.846932 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbscm"] Sep 10 03:39:40.850232 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.850208 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:40.854287 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:40.854263 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36a3a11_7dea_4c1f_917f_02a93918a190.slice/crio-c501e1d1650001724ae579031e6c1a4705afdb46d1e259dd9b9f75605b071b4b WatchSource:0}: Error finding container c501e1d1650001724ae579031e6c1a4705afdb46d1e259dd9b9f75605b071b4b: Status 404 returned error can't find the container with id c501e1d1650001724ae579031e6c1a4705afdb46d1e259dd9b9f75605b071b4b Sep 10 03:39:40.914284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:40.914358 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/63601a52-04de-43a9-b25b-a3f2c9664618-signing-cabundle\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.914399 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914168 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:39:40.914399 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.914481 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914407 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls podName:ce762875-56c5-4d4b-be65-437d29a2faca nodeName:}" failed. No retries permitted until 2026-09-10 03:39:41.914390809 +0000 UTC m=+36.718987224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls") pod "dns-default-85g9d" (UID: "ce762875-56c5-4d4b-be65-437d29a2faca") : secret "dns-default-metrics-tls" not found Sep 10 03:39:40.914481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:40.914481 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914457 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:39:40.914481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914511 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:41.914494142 +0000 UTC m=+36.719090584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : configmap "kube-rbac-proxy" not found Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914536 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914544 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914554 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5695c6fd5c-lncvv: secret "image-registry-tls" not found Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/63601a52-04de-43a9-b25b-a3f2c9664618-signing-key\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914587 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:41.914571191 +0000 UTC m=+36.719167609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : secret "insights-runtime-extractor-tls" not found Sep 10 03:39:40.914685 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.914609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qv59\" (UniqueName: \"kubernetes.io/projected/63601a52-04de-43a9-b25b-a3f2c9664618-kube-api-access-6qv59\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.914925 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:40.914730 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls podName:e150fc37-9008-4a93-82c5-e775f6bd9894 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:41.914712444 +0000 UTC m=+36.719308867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls") pod "image-registry-5695c6fd5c-lncvv" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894") : secret "image-registry-tls" not found Sep 10 03:39:40.915054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.915035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/63601a52-04de-43a9-b25b-a3f2c9664618-signing-cabundle\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.917467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.917447 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/63601a52-04de-43a9-b25b-a3f2c9664618-signing-key\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.922051 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.922028 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qv59\" (UniqueName: \"kubernetes.io/projected/63601a52-04de-43a9-b25b-a3f2c9664618-kube-api-access-6qv59\") pod \"service-ca-75d99c484-9lmv9\" (UID: \"63601a52-04de-43a9-b25b-a3f2c9664618\") " pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:40.925598 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.925568 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbscm" event={"ID":"e36a3a11-7dea-4c1f-917f-02a93918a190","Type":"ContainerStarted","Data":"c501e1d1650001724ae579031e6c1a4705afdb46d1e259dd9b9f75605b071b4b"} Sep 10 03:39:40.928474 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:40.928454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerStarted","Data":"bb484b211e529f44aecad34c11efeb2af0866ee24af6c70357cae5b6eea1789f"} Sep 10 03:39:41.026281 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.026244 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-9lmv9" Sep 10 03:39:41.314197 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.314162 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9lmv9"] Sep 10 03:39:41.318353 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:41.318326 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63601a52_04de_43a9_b25b_a3f2c9664618.slice/crio-672642a288778a7ad3042494257241c53cc081171e27bd675fb63532dea654ff WatchSource:0}: Error finding container 672642a288778a7ad3042494257241c53cc081171e27bd675fb63532dea654ff: Status 404 returned error can't find the container with id 672642a288778a7ad3042494257241c53cc081171e27bd675fb63532dea654ff Sep 10 03:39:41.637631 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.637590 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:39:41.637814 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.637781 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:39:41.641168 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.641134 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 03:39:41.641982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.641797 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 03:39:41.641982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.641825 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vqcf\"" Sep 10 03:39:41.641982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.641863 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 03:39:41.649654 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.649627 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:41.653290 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.653260 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjm65\"" Sep 10 03:39:41.928009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.927976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:41.928219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.928026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:41.928219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.928054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:41.928219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.928081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:41.928219 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928144 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928221 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928232 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls podName:ce762875-56c5-4d4b-be65-437d29a2faca nodeName:}" failed. No retries permitted until 2026-09-10 03:39:43.928215776 +0000 UTC m=+38.732812214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls") pod "dns-default-85g9d" (UID: "ce762875-56c5-4d4b-be65-437d29a2faca") : secret "dns-default-metrics-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928235 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5695c6fd5c-lncvv: secret "image-registry-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928246 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928284 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls podName:e150fc37-9008-4a93-82c5-e775f6bd9894 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:43.928271987 +0000 UTC m=+38.732868422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls") pod "image-registry-5695c6fd5c-lncvv" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894") : secret "image-registry-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928309 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:43.92828952 +0000 UTC m=+38.732885939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : secret "insights-runtime-extractor-tls" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928144 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:39:41.928418 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:41.928345 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:43.928335741 +0000 UTC m=+38.732932162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : configmap "kube-rbac-proxy" not found Sep 10 03:39:41.933661 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.933628 2566 generic.go:356] "Generic (PLEG): container finished" podID="3616b002-6af6-476c-aa9b-488e86caa6e4" containerID="bb484b211e529f44aecad34c11efeb2af0866ee24af6c70357cae5b6eea1789f" exitCode=0 Sep 10 03:39:41.933812 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.933716 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerDied","Data":"bb484b211e529f44aecad34c11efeb2af0866ee24af6c70357cae5b6eea1789f"} Sep 10 03:39:41.935071 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:41.935045 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-9lmv9" event={"ID":"63601a52-04de-43a9-b25b-a3f2c9664618","Type":"ContainerStarted","Data":"672642a288778a7ad3042494257241c53cc081171e27bd675fb63532dea654ff"} Sep 10 03:39:42.941781 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:42.941743 2566 generic.go:356] "Generic (PLEG): container finished" podID="3616b002-6af6-476c-aa9b-488e86caa6e4" containerID="f9d383771df07ff887fea8ddc6b177242a365b817d2c2cf15fbfb52af50166e7" exitCode=0 Sep 10 03:39:42.942312 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:42.941805 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerDied","Data":"f9d383771df07ff887fea8ddc6b177242a365b817d2c2cf15fbfb52af50166e7"} Sep 10 03:39:43.945246 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:43.945213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:43.945256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:43.945278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:43.945295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945352 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945379 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945388 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945390 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5695c6fd5c-lncvv: secret "image-registry-tls" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945421 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:47.945402036 +0000 UTC m=+42.749998472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : configmap "kube-rbac-proxy" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945379 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945481 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:47.945464926 +0000 UTC m=+42.750061346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : secret "insights-runtime-extractor-tls" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls podName:e150fc37-9008-4a93-82c5-e775f6bd9894 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:47.945494665 +0000 UTC m=+42.750091085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls") pod "image-registry-5695c6fd5c-lncvv" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894") : secret "image-registry-tls" not found Sep 10 03:39:43.945639 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:43.945515 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls podName:ce762875-56c5-4d4b-be65-437d29a2faca nodeName:}" failed. No retries permitted until 2026-09-10 03:39:47.945510585 +0000 UTC m=+42.750107001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls") pod "dns-default-85g9d" (UID: "ce762875-56c5-4d4b-be65-437d29a2faca") : secret "dns-default-metrics-tls" not found Sep 10 03:39:44.504694 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:44.504511 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:44.947831 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:44.947793 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbscm" event={"ID":"e36a3a11-7dea-4c1f-917f-02a93918a190","Type":"ContainerStarted","Data":"f7e7ab437d0658c31f0721bd5f1b8efd549e78f1d528083609897c0328db43b5"} Sep 10 03:39:44.949463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:44.949435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-9lmv9" event={"ID":"63601a52-04de-43a9-b25b-a3f2c9664618","Type":"ContainerStarted","Data":"c29517cb2fd0d912f09d331b174add0e6fb4d46c128e2e7c26d18ed70f7e659f"} Sep 10 03:39:44.952840 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:44.952816 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" event={"ID":"3616b002-6af6-476c-aa9b-488e86caa6e4","Type":"ContainerStarted","Data":"4b3dddc123bec96b593ee5ba444a6c2a0e1cb4e548ec332486da6a406f9916a6"} Sep 10 03:39:44.964438 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:44.964392 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rbscm" podStartSLOduration=1.7341267249999999 podStartE2EDuration="4.964377333s" totalImagesPullingTime="3.230250608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:44.96364752 +0000 UTC m=+39.768243958" watchObservedRunningTime="2026-09-10 03:39:44.964377333 +0000 UTC m=+39.768973770" Sep 10 03:39:44.984256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:44.984195 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-9lmv9" podStartSLOduration=2.216999089 podStartE2EDuration="4.984174256s" totalImagesPullingTime="2.767175167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:44.979924427 +0000 UTC m=+39.784520865" watchObservedRunningTime="2026-09-10 03:39:44.984174256 +0000 UTC m=+39.788770696" Sep 10 03:39:45.001483 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.001424 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lpk8r" podStartSLOduration=9.369479122 podStartE2EDuration="39.001401211s" totalImagesPullingTime="29.631922089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:45.0008088 +0000 UTC m=+39.805405260" watchObservedRunningTime="2026-09-10 03:39:45.001401211 +0000 UTC m=+39.805997649" Sep 10 03:39:45.174404 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.174316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:45.274614 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.274509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:45.375078 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.375029 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:45.486402 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.486354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:45.564871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.564766 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:45.669039 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.669010 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:45.872219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:45.872114 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:46.462784 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:46.462750 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:47.073131 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.073099 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:47.457249 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.457172 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:47.857837 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.857747 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:47.956960 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.956907 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:47.978049 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.978013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:47.978226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.978067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:47.978226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.978098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:47.978226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:47.978120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:47.978226 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978168 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:39:47.978226 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978208 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978248 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls podName:ce762875-56c5-4d4b-be65-437d29a2faca nodeName:}" failed. No retries permitted until 2026-09-10 03:39:55.978229609 +0000 UTC m=+50.782826026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls") pod "dns-default-85g9d" (UID: "ce762875-56c5-4d4b-be65-437d29a2faca") : secret "dns-default-metrics-tls" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978276 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:55.978261921 +0000 UTC m=+50.782858337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : configmap "kube-rbac-proxy" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978278 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978296 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978311 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5695c6fd5c-lncvv: secret "image-registry-tls" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978354 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls podName:4465e614-8d9c-4493-a7b2-275c639f88ad nodeName:}" failed. No retries permitted until 2026-09-10 03:39:55.978337539 +0000 UTC m=+50.782933968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sh4n8" (UID: "4465e614-8d9c-4493-a7b2-275c639f88ad") : secret "insights-runtime-extractor-tls" not found Sep 10 03:39:47.978478 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:39:47.978373 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls podName:e150fc37-9008-4a93-82c5-e775f6bd9894 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:55.978362744 +0000 UTC m=+50.782959167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls") pod "image-registry-5695c6fd5c-lncvv" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894") : secret "image-registry-tls" not found Sep 10 03:39:48.254696 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:48.254661 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:48.454848 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:48.454813 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:48.861798 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:48.861758 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:49.062665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:49.062636 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:49.167993 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:49.167928 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:49.456206 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:49.456167 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:50.068288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:50.068241 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:50.259591 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:50.259557 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:50.456889 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:50.456859 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:50.653306 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:50.653272 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:50.761269 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:50.761192 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:50.818297 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:50.818265 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:51.060531 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:51.060453 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:51.461728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:51.461703 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:51.562500 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:51.562469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:51.856578 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:51.856490 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:52.263904 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:52.263875 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:52.461898 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:52.461867 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:53.054331 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:53.054299 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:53.462471 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:53.462434 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:53.860447 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:53.860354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:54.056266 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:54.056229 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:54.459256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:54.459224 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:55.259795 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:55.259759 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:55.461346 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:55.461301 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:55.654804 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:55.654724 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:55.859170 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:55.859128 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:56.037413 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.037375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:56.037413 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.037416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:56.037638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.037436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:56.037638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.037592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:56.037971 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.037948 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4465e614-8d9c-4493-a7b2-275c639f88ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:56.041015 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.040984 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4465e614-8d9c-4493-a7b2-275c639f88ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sh4n8\" (UID: \"4465e614-8d9c-4493-a7b2-275c639f88ad\") " pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:56.041180 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.040984 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce762875-56c5-4d4b-be65-437d29a2faca-metrics-tls\") pod \"dns-default-85g9d\" (UID: \"ce762875-56c5-4d4b-be65-437d29a2faca\") " pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:56.041180 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.041056 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"image-registry-5695c6fd5c-lncvv\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:56.043891 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.043869 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:56.055168 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.055135 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:56.074920 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.074894 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sh4n8" Sep 10 03:39:56.334415 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.334339 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5695c6fd5c-lncvv"] Sep 10 03:39:56.337674 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:56.337647 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode150fc37_9008_4a93_82c5_e775f6bd9894.slice/crio-07783cf8200d598e29559ec28c61bc8f20589cf53e0ca59dbedd28e1380cbf3e WatchSource:0}: Error finding container 07783cf8200d598e29559ec28c61bc8f20589cf53e0ca59dbedd28e1380cbf3e: Status 404 returned error can't find the container with id 07783cf8200d598e29559ec28c61bc8f20589cf53e0ca59dbedd28e1380cbf3e Sep 10 03:39:56.356319 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.356287 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-85g9d"] Sep 10 03:39:56.359300 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:56.359279 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce762875_56c5_4d4b_be65_437d29a2faca.slice/crio-cc3d9dd45bc76d062ebfe9fdb5b26d88d63979520618da1886063579833e1f6b WatchSource:0}: Error finding container cc3d9dd45bc76d062ebfe9fdb5b26d88d63979520618da1886063579833e1f6b: Status 404 returned error can't find the container with id cc3d9dd45bc76d062ebfe9fdb5b26d88d63979520618da1886063579833e1f6b Sep 10 03:39:56.380767 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.380739 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sh4n8"] Sep 10 03:39:56.384296 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:39:56.384270 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4465e614_8d9c_4493_a7b2_275c639f88ad.slice/crio-77fc52bdbee267368a43f94ac3b9d50606dd879bb15d2f0c1a6ef233993351df WatchSource:0}: Error finding container 77fc52bdbee267368a43f94ac3b9d50606dd879bb15d2f0c1a6ef233993351df: Status 404 returned error can't find the container with id 77fc52bdbee267368a43f94ac3b9d50606dd879bb15d2f0c1a6ef233993351df Sep 10 03:39:56.984571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.984539 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" event={"ID":"e150fc37-9008-4a93-82c5-e775f6bd9894","Type":"ContainerStarted","Data":"464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1"} Sep 10 03:39:56.984772 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.984589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" event={"ID":"e150fc37-9008-4a93-82c5-e775f6bd9894","Type":"ContainerStarted","Data":"07783cf8200d598e29559ec28c61bc8f20589cf53e0ca59dbedd28e1380cbf3e"} Sep 10 03:39:56.984772 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.984658 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:39:56.986059 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.986029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-85g9d" event={"ID":"ce762875-56c5-4d4b-be65-437d29a2faca","Type":"ContainerStarted","Data":"cc3d9dd45bc76d062ebfe9fdb5b26d88d63979520618da1886063579833e1f6b"} Sep 10 03:39:56.987675 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.987651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh4n8" event={"ID":"4465e614-8d9c-4493-a7b2-275c639f88ad","Type":"ContainerStarted","Data":"aa5b548ead2f813a14ab8a94acff1c5fb959b3ba1478d9a951d06322316ad5cc"} Sep 10 03:39:56.987785 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:56.987731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh4n8" event={"ID":"4465e614-8d9c-4493-a7b2-275c639f88ad","Type":"ContainerStarted","Data":"77fc52bdbee267368a43f94ac3b9d50606dd879bb15d2f0c1a6ef233993351df"} Sep 10 03:39:57.005524 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:57.005472 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" podStartSLOduration=60.005451936 podStartE2EDuration="1m0.005451936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:57.005075767 +0000 UTC m=+51.809672202" watchObservedRunningTime="2026-09-10 03:39:57.005451936 +0000 UTC m=+51.810048376" Sep 10 03:39:57.446233 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:57.446186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:57.520309 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:57.520270 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:57.608236 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:57.608137 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:57.992795 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:57.992757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh4n8" event={"ID":"4465e614-8d9c-4493-a7b2-275c639f88ad","Type":"ContainerStarted","Data":"df57770dacd2dee1a43748b3240a0f81a79bd3b993a9fbf42eb34eb15bd5bc61"} Sep 10 03:39:58.037796 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:58.037756 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:58.998741 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:58.998700 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-85g9d" event={"ID":"ce762875-56c5-4d4b-be65-437d29a2faca","Type":"ContainerStarted","Data":"c6292fbe95e9a3113e9466a79bdf53cbce0db2930814af4aa7d51968c751e647"} Sep 10 03:39:58.999197 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:58.998760 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-85g9d" event={"ID":"ce762875-56c5-4d4b-be65-437d29a2faca","Type":"ContainerStarted","Data":"d2f4936985c25bcc6694ce2531b6e4e153a68a5d0727308b9a1c6d5ee52a460e"} Sep 10 03:39:58.999197 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:58.998790 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-85g9d" Sep 10 03:39:59.000880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.000858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sh4n8" event={"ID":"4465e614-8d9c-4493-a7b2-275c639f88ad","Type":"ContainerStarted","Data":"d9d561548e48d871d78f703cdcc0d03a2721b90a82ae4c1421512d0c42e89839"} Sep 10 03:39:59.020067 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.020011 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-85g9d" podStartSLOduration=17.462514634 podStartE2EDuration="19.019996447s" totalImagesPullingTime="1.557481813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:59.018545497 +0000 UTC m=+53.823141935" watchObservedRunningTime="2026-09-10 03:39:59.019996447 +0000 UTC m=+53.824592885" Sep 10 03:39:59.036670 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.036614 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sh4n8" podStartSLOduration=16.673900772 podStartE2EDuration="19.036600006s" totalImagesPullingTime="2.362699234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:59.036231116 +0000 UTC m=+53.840827558" watchObservedRunningTime="2026-09-10 03:39:59.036600006 +0000 UTC m=+53.841196487" Sep 10 03:39:59.038237 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.038214 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.138377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.138341 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.192725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.192697 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.524700 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.524600 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.577507 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.577482 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.717573 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.717546 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.771418 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.771392 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.920535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.920460 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:39:59.971637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:39:59.971614 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:00.145095 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:00.145051 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:00.243324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:00.243294 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:00.922105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:00.922076 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:01.132196 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:01.132163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:01.189251 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:01.189223 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:01.281299 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:01.281268 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:01.338428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:01.338396 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:01.956701 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:01.956672 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:02.069761 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.069730 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:02.163668 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.163630 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc"] Sep 10 03:40:02.166086 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.166064 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:02.168459 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.168428 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 03:40:02.168569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.168537 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gh6ph\"" Sep 10 03:40:02.174409 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.174386 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc"] Sep 10 03:40:02.178243 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.178220 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5695c6fd5c-lncvv"] Sep 10 03:40:02.189037 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.189006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c9c79be3-f511-492d-bff2-3bac64dd0ae5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-254xc\" (UID: \"c9c79be3-f511-492d-bff2-3bac64dd0ae5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:02.239956 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.239869 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:02.259873 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.259840 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-nvdm4"] Sep 10 03:40:02.261725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.261706 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:02.262909 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.262885 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b6d9b9bd-lkhz2"] Sep 10 03:40:02.264003 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.263987 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 03:40:02.264248 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.264234 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l9qlj\"" Sep 10 03:40:02.264312 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.264271 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 03:40:02.264491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.264477 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.277324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.277304 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-nvdm4"] Sep 10 03:40:02.281799 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.281775 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b6d9b9bd-lkhz2"] Sep 10 03:40:02.290022 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.289998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c917861-19d9-40a2-8001-487ee1d88737-ca-trust-extracted\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c9c79be3-f511-492d-bff2-3bac64dd0ae5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-254xc\" (UID: \"c9c79be3-f511-492d-bff2-3bac64dd0ae5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:02.290145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhjnr\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-kube-api-access-zhjnr\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290093 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c917861-19d9-40a2-8001-487ee1d88737-installation-pull-secrets\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-registry-tls\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290145 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c917861-19d9-40a2-8001-487ee1d88737-registry-certificates\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290378 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290216 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-bound-sa-token\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290378 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c917861-19d9-40a2-8001-487ee1d88737-trusted-ca\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290378 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c917861-19d9-40a2-8001-487ee1d88737-image-registry-private-configuration\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.290378 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.290371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wbr\" (UniqueName: \"kubernetes.io/projected/1f83ee4c-3e0c-4f22-acdb-454f56982d0d-kube-api-access-g2wbr\") pod \"downloads-85d98c998f-nvdm4\" (UID: \"1f83ee4c-3e0c-4f22-acdb-454f56982d0d\") " pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:02.292732 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.292711 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c9c79be3-f511-492d-bff2-3bac64dd0ae5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-254xc\" (UID: \"c9c79be3-f511-492d-bff2-3bac64dd0ae5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:02.340351 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.340287 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:02.391545 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhjnr\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-kube-api-access-zhjnr\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.391721 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c917861-19d9-40a2-8001-487ee1d88737-installation-pull-secrets\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.391721 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-registry-tls\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.391721 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c917861-19d9-40a2-8001-487ee1d88737-registry-certificates\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.391721 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391647 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-bound-sa-token\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.391901 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391874 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c917861-19d9-40a2-8001-487ee1d88737-trusted-ca\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.391972 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.391954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c917861-19d9-40a2-8001-487ee1d88737-image-registry-private-configuration\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.392029 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.392018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wbr\" (UniqueName: \"kubernetes.io/projected/1f83ee4c-3e0c-4f22-acdb-454f56982d0d-kube-api-access-g2wbr\") pod \"downloads-85d98c998f-nvdm4\" (UID: \"1f83ee4c-3e0c-4f22-acdb-454f56982d0d\") " pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:02.392081 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.392058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c917861-19d9-40a2-8001-487ee1d88737-ca-trust-extracted\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.392445 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.392425 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c917861-19d9-40a2-8001-487ee1d88737-ca-trust-extracted\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.392726 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.392707 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c917861-19d9-40a2-8001-487ee1d88737-trusted-ca\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.392776 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.392735 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c917861-19d9-40a2-8001-487ee1d88737-registry-certificates\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.394317 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.394297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c917861-19d9-40a2-8001-487ee1d88737-image-registry-private-configuration\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.394519 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.394504 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c917861-19d9-40a2-8001-487ee1d88737-installation-pull-secrets\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.394799 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.394776 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-registry-tls\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.400464 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.400444 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-bound-sa-token\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.400832 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.400815 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wbr\" (UniqueName: \"kubernetes.io/projected/1f83ee4c-3e0c-4f22-acdb-454f56982d0d-kube-api-access-g2wbr\") pod \"downloads-85d98c998f-nvdm4\" (UID: \"1f83ee4c-3e0c-4f22-acdb-454f56982d0d\") " pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:02.401555 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.401146 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhjnr\" (UniqueName: \"kubernetes.io/projected/3c917861-19d9-40a2-8001-487ee1d88737-kube-api-access-zhjnr\") pod \"image-registry-64b6d9b9bd-lkhz2\" (UID: \"3c917861-19d9-40a2-8001-487ee1d88737\") " pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.460978 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.460943 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:02.474468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.474438 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:02.558534 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.558469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:02.571347 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.571300 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:02.575681 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.575646 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:02.745475 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.745444 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc"] Sep 10 03:40:02.748560 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:02.748524 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c79be3_f511_492d_bff2_3bac64dd0ae5.slice/crio-5b3160d7ea8d2e0797f9e53c27599e5b542b52d37353d0aac32b4b6b37e82824 WatchSource:0}: Error finding container 5b3160d7ea8d2e0797f9e53c27599e5b542b52d37353d0aac32b4b6b37e82824: Status 404 returned error can't find the container with id 5b3160d7ea8d2e0797f9e53c27599e5b542b52d37353d0aac32b4b6b37e82824 Sep 10 03:40:02.839011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.838927 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-nvdm4"] Sep 10 03:40:02.841412 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:02.841389 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f83ee4c_3e0c_4f22_acdb_454f56982d0d.slice/crio-35ed6c755551dbd3e823de5e82b920b7744b3dec6d4f92f6659aa660cf1a671b WatchSource:0}: Error finding container 35ed6c755551dbd3e823de5e82b920b7744b3dec6d4f92f6659aa660cf1a671b: Status 404 returned error can't find the container with id 35ed6c755551dbd3e823de5e82b920b7744b3dec6d4f92f6659aa660cf1a671b Sep 10 03:40:02.847636 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:02.847614 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b6d9b9bd-lkhz2"] Sep 10 03:40:02.850117 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:02.850093 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c917861_19d9_40a2_8001_487ee1d88737.slice/crio-b32bddd9058f70da2f9a72f105ef22ee205e32afad67e2a71c103638b99c82a1 WatchSource:0}: Error finding container b32bddd9058f70da2f9a72f105ef22ee205e32afad67e2a71c103638b99c82a1: Status 404 returned error can't find the container with id b32bddd9058f70da2f9a72f105ef22ee205e32afad67e2a71c103638b99c82a1 Sep 10 03:40:03.013941 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.013905 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" event={"ID":"c9c79be3-f511-492d-bff2-3bac64dd0ae5","Type":"ContainerStarted","Data":"5b3160d7ea8d2e0797f9e53c27599e5b542b52d37353d0aac32b4b6b37e82824"} Sep 10 03:40:03.015471 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.015446 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" event={"ID":"3c917861-19d9-40a2-8001-487ee1d88737","Type":"ContainerStarted","Data":"73c5be421c92dd952b52e823bafb5cacc6c36f04d00fc0a4df9f86588e0b5a66"} Sep 10 03:40:03.015613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.015482 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" event={"ID":"3c917861-19d9-40a2-8001-487ee1d88737","Type":"ContainerStarted","Data":"b32bddd9058f70da2f9a72f105ef22ee205e32afad67e2a71c103638b99c82a1"} Sep 10 03:40:03.015613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.015524 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:03.016695 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.016663 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-nvdm4" event={"ID":"1f83ee4c-3e0c-4f22-acdb-454f56982d0d","Type":"ContainerStarted","Data":"35ed6c755551dbd3e823de5e82b920b7744b3dec6d4f92f6659aa660cf1a671b"} Sep 10 03:40:03.034404 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.034358 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" podStartSLOduration=1.034340782 podStartE2EDuration="1.034340782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:03.033625261 +0000 UTC m=+57.838221724" watchObservedRunningTime="2026-09-10 03:40:03.034340782 +0000 UTC m=+57.838937258" Sep 10 03:40:03.786348 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.786310 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:03.847994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:03.847930 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:05.026703 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.026661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" event={"ID":"c9c79be3-f511-492d-bff2-3bac64dd0ae5","Type":"ContainerStarted","Data":"cb163329c35898255a4bc2444ed9a5df74469d91a48cbc0cf0d4b38cc3e8c67e"} Sep 10 03:40:05.027177 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.027021 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:05.032325 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.032303 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" Sep 10 03:40:05.043825 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.043780 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-254xc" podStartSLOduration=1.204466924 podStartE2EDuration="3.043761189s" totalImagesPullingTime="1.839294265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:05.042244142 +0000 UTC m=+59.846840581" watchObservedRunningTime="2026-09-10 03:40:05.043761189 +0000 UTC m=+59.848357628" Sep 10 03:40:05.646802 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.646760 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:05.711765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.711720 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:05.828705 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.828661 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:05.925979 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:05.925912 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lmn64" Sep 10 03:40:06.074692 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:06.074652 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:06.127327 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:06.127288 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:07.351922 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:07.351885 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:07.431363 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:07.431330 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:09.006691 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:09.006659 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-85g9d" Sep 10 03:40:09.012828 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:09.012798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:09.548542 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:09.548475 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:09.600689 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:09.600645 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:10.781794 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:10.781744 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.006683 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.006604 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.033797 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.033590 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7sbzf"] Sep 10 03:40:11.064716 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.064484 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.066872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.066833 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 03:40:11.067011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.066948 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 03:40:11.068130 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.068048 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 03:40:11.068630 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.068068 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 03:40:11.068630 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.068147 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 03:40:11.068630 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.068171 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 03:40:11.068630 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.067993 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kxjr\"" Sep 10 03:40:11.082245 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.082144 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.167694 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-sys\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.167872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-wtmp\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.167872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.167872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxk6q\" (UniqueName: \"kubernetes.io/projected/dc671265-07ae-4103-b879-fa11241a7f5d-kube-api-access-gxk6q\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.168042 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-textfile\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.168042 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-root\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.168042 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.168042 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.167988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.168042 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.168010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc671265-07ae-4103-b879-fa11241a7f5d-metrics-client-ca\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.268994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.268948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.268994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.268997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxk6q\" (UniqueName: \"kubernetes.io/projected/dc671265-07ae-4103-b879-fa11241a7f5d-kube-api-access-gxk6q\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269261 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-textfile\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269261 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269123 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-root\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269261 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269261 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269261 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269236 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc671265-07ae-4103-b879-fa11241a7f5d-metrics-client-ca\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269509 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-sys\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269509 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-wtmp\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269509 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-wtmp\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269657 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269543 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.269770 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:40:11.269743 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 03:40:11.269899 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:40:11.269793 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls podName:dc671265-07ae-4103-b879-fa11241a7f5d nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.769780548 +0000 UTC m=+66.574376964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls") pod "node-exporter-7sbzf" (UID: "dc671265-07ae-4103-b879-fa11241a7f5d") : secret "node-exporter-tls" not found Sep 10 03:40:11.269899 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.269859 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-sys\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.270137 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.270109 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc671265-07ae-4103-b879-fa11241a7f5d-root\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.270237 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.270186 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-textfile\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.270337 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.270317 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc671265-07ae-4103-b879-fa11241a7f5d-metrics-client-ca\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.272576 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.272553 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.279727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.279699 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxk6q\" (UniqueName: \"kubernetes.io/projected/dc671265-07ae-4103-b879-fa11241a7f5d-kube-api-access-gxk6q\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.319649 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.319571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.420714 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.420660 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.470572 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.470539 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:40:11.470762 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.470585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:40:11.470762 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.470614 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:40:11.473316 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.473287 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 03:40:11.473454 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.473428 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 03:40:11.473556 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.473527 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 03:40:11.483741 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.483519 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 03:40:11.484620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.484596 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d370d3ab-9d24-43c3-9eaa-2916f5aa97fc-metrics-certs\") pod \"network-metrics-daemon-djlkd\" (UID: \"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc\") " pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:40:11.484730 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.484693 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf56d3ca-0c64-4c9f-a822-565d97259dd1-original-pull-secret\") pod \"global-pull-secret-syncer-jxlz4\" (UID: \"bf56d3ca-0c64-4c9f-a822-565d97259dd1\") " pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:40:11.495782 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.495751 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvkm\" (UniqueName: \"kubernetes.io/projected/575b6ab4-8cfe-468f-8326-595f7316feff-kube-api-access-vnvkm\") pod \"network-check-target-p9dnx\" (UID: \"575b6ab4-8cfe-468f-8326-595f7316feff\") " pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:40:11.547859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.547825 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxlz4" Sep 10 03:40:11.596933 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.596842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.651820 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.651675 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjm65\"" Sep 10 03:40:11.656835 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.656778 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vqcf\"" Sep 10 03:40:11.659277 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.659224 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:40:11.665455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.665433 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djlkd" Sep 10 03:40:11.696677 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.696646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.773176 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.772712 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:11.773176 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:40:11.772880 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 03:40:11.773176 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:40:11.772941 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls podName:dc671265-07ae-4103-b879-fa11241a7f5d nodeName:}" failed. No retries permitted until 2026-09-10 03:40:12.772922263 +0000 UTC m=+67.577518688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls") pod "node-exporter-7sbzf" (UID: "dc671265-07ae-4103-b879-fa11241a7f5d") : secret "node-exporter-tls" not found Sep 10 03:40:11.795565 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.795534 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.841866 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.841775 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxlz4"] Sep 10 03:40:11.845845 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:11.845813 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf56d3ca_0c64_4c9f_a822_565d97259dd1.slice/crio-2112a2682e4e766717c207b0bef5958bd0bc60fbdf18ed0dd3f4967b19cae038 WatchSource:0}: Error finding container 2112a2682e4e766717c207b0bef5958bd0bc60fbdf18ed0dd3f4967b19cae038: Status 404 returned error can't find the container with id 2112a2682e4e766717c207b0bef5958bd0bc60fbdf18ed0dd3f4967b19cae038 Sep 10 03:40:11.896568 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.896524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:11.951691 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.951654 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p9dnx"] Sep 10 03:40:11.955092 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:11.955064 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575b6ab4_8cfe_468f_8326_595f7316feff.slice/crio-343c7b869229f6fcb78b26450f363f35aea21bca8215a5ed0e9660fe5614bd1b WatchSource:0}: Error finding container 343c7b869229f6fcb78b26450f363f35aea21bca8215a5ed0e9660fe5614bd1b: Status 404 returned error can't find the container with id 343c7b869229f6fcb78b26450f363f35aea21bca8215a5ed0e9660fe5614bd1b Sep 10 03:40:11.985697 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.985659 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-djlkd"] Sep 10 03:40:11.988875 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:11.988844 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd370d3ab_9d24_43c3_9eaa_2916f5aa97fc.slice/crio-c8da2554b0833578da56c45d178def35ce44be8e678d8562438df7fe908fa7b1 WatchSource:0}: Error finding container c8da2554b0833578da56c45d178def35ce44be8e678d8562438df7fe908fa7b1: Status 404 returned error can't find the container with id c8da2554b0833578da56c45d178def35ce44be8e678d8562438df7fe908fa7b1 Sep 10 03:40:11.991782 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:11.991741 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:12.054622 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.054588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p9dnx" event={"ID":"575b6ab4-8cfe-468f-8326-595f7316feff","Type":"ContainerStarted","Data":"343c7b869229f6fcb78b26450f363f35aea21bca8215a5ed0e9660fe5614bd1b"} Sep 10 03:40:12.055915 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.055888 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-djlkd" event={"ID":"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc","Type":"ContainerStarted","Data":"c8da2554b0833578da56c45d178def35ce44be8e678d8562438df7fe908fa7b1"} Sep 10 03:40:12.057132 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.057110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxlz4" event={"ID":"bf56d3ca-0c64-4c9f-a822-565d97259dd1","Type":"ContainerStarted","Data":"2112a2682e4e766717c207b0bef5958bd0bc60fbdf18ed0dd3f4967b19cae038"} Sep 10 03:40:12.057253 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.057134 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:12.122700 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.122613 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:40:12.126226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.126199 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.126859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.126545 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:12.129228 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129206 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wcl9q\"" Sep 10 03:40:12.129386 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129362 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 03:40:12.129386 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129236 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 03:40:12.129585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129229 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 03:40:12.129585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129258 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 03:40:12.129585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129280 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 03:40:12.129585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129306 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 03:40:12.129585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129323 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 03:40:12.129827 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129678 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 03:40:12.129827 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.129815 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 03:40:12.147925 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.147895 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:40:12.176792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-config-out\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176909 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176961 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-web-config\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.176988 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.176985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.177396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.177081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.177396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.177106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.177396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.177129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.177396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.177185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvwpv\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-kube-api-access-jvwpv\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.177396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.177217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.184716 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.184682 2566 patch_prober.go:28] interesting pod/image-registry-5695c6fd5c-lncvv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 03:40:12.184865 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.184742 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" podUID="e150fc37-9008-4a93-82c5-e775f6bd9894" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 03:40:12.219653 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.219590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:12.277867 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.277826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.277867 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.277868 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.277902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.277931 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvwpv\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-kube-api-access-jvwpv\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.277956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.277998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-config-out\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278460 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278460 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278460 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-web-config\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.278460 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.278235 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.279753 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:40:12.279724 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle podName:b33b0e38-1931-42c7-870b-a079b42174d4 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:12.779699034 +0000 UTC m=+67.584295462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4") : configmap references non-existent config key: ca-bundle.crt Sep 10 03:40:12.280426 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.279992 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.280426 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.280273 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.281319 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.281298 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.281474 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.281304 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.282181 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.281705 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.282181 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.282109 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.282342 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.282304 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.282748 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.282722 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.282860 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.282842 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-config-out\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.283543 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.283523 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-web-config\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.283850 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.283827 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.291024 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.290996 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvwpv\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-kube-api-access-jvwpv\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.782895 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.782849 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.783078 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.782946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:12.783825 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.783789 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:12.785702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.785655 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc671265-07ae-4103-b879-fa11241a7f5d-node-exporter-tls\") pod \"node-exporter-7sbzf\" (UID: \"dc671265-07ae-4103-b879-fa11241a7f5d\") " pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:12.877974 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:12.877941 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7sbzf" Sep 10 03:40:13.040441 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:13.040355 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:40:13.557871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:13.557831 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:13.700920 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:13.700882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:13.819044 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:13.818964 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:13.954379 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:13.954306 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:14.054635 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:14.054558 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:14.155907 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:14.155791 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:14.296117 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:14.296079 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:15.816583 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:15.816535 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:15.882939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:15.882906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:16.606375 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:16.606338 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:16.704075 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:16.704027 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:16.822500 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:16.822469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:17.240959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:17.240923 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:17.592302 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:17.592197 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:17.647247 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:17.647215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:20.484092 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:20.484045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:20.583575 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:20.583530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:21.630000 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:21.629846 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:40:21.822832 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:21.822794 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:21.923298 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:21.923247 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:22.100933 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.100835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-nvdm4" event={"ID":"1f83ee4c-3e0c-4f22-acdb-454f56982d0d","Type":"ContainerStarted","Data":"af8fccfd93a9535be88bc2d09e518e6e34ff00863d959c6c9e49881f4403f9d0"} Sep 10 03:40:22.101224 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.101203 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:22.103468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.103399 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7sbzf" event={"ID":"dc671265-07ae-4103-b879-fa11241a7f5d","Type":"ContainerStarted","Data":"771f3298b8ee70f5e6069dc33d35fcaecfd698b21fe06ae68494d2122ad8b439"} Sep 10 03:40:22.105823 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.105792 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-djlkd" event={"ID":"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc","Type":"ContainerStarted","Data":"6429fc1a465f85f76769f8e6b20324c3f70447620986f1da29f7e7781e8526b6"} Sep 10 03:40:22.105945 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.105848 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-djlkd" event={"ID":"d370d3ab-9d24-43c3-9eaa-2916f5aa97fc","Type":"ContainerStarted","Data":"51790f8f3a4f7c12f11797524dd2bd789fda96f3e59e37b7306bced80945b2ba"} Sep 10 03:40:22.107856 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.107829 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxlz4" event={"ID":"bf56d3ca-0c64-4c9f-a822-565d97259dd1","Type":"ContainerStarted","Data":"d6116ce586cf9fb2d44ea9b6166e7db4243fccf973fde365ac5244469d7c247b"} Sep 10 03:40:22.111728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.111703 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-nvdm4" Sep 10 03:40:22.120935 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.120768 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-nvdm4" podStartSLOduration=1.6269107790000001 podStartE2EDuration="20.120750564s" totalImagesPullingTime="18.493839785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:22.11989067 +0000 UTC m=+76.924487110" watchObservedRunningTime="2026-09-10 03:40:22.120750564 +0000 UTC m=+76.925347019" Sep 10 03:40:22.141135 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.141048 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-djlkd" podStartSLOduration=66.761209077 podStartE2EDuration="1m16.141029323s" totalImagesPullingTime="9.379820246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:22.139259376 +0000 UTC m=+76.943855829" watchObservedRunningTime="2026-09-10 03:40:22.141029323 +0000 UTC m=+76.945625761" Sep 10 03:40:22.154515 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.154453 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jxlz4" podStartSLOduration=66.665672575 podStartE2EDuration="1m16.154433536s" totalImagesPullingTime="9.488760961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:22.153486402 +0000 UTC m=+76.958082843" watchObservedRunningTime="2026-09-10 03:40:22.154433536 +0000 UTC m=+76.959029974" Sep 10 03:40:22.192019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.190599 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:40:22.255305 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.255263 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:22.359056 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:22.358959 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:22.838409 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:40:22.838358 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33b0e38_1931_42c7_870b_a079b42174d4.slice/crio-5bd767b1c7d42d7cb39a75e18758be0391c0861b2b96655d88d3e78fbc924e89 WatchSource:0}: Error finding container 5bd767b1c7d42d7cb39a75e18758be0391c0861b2b96655d88d3e78fbc924e89: Status 404 returned error can't find the container with id 5bd767b1c7d42d7cb39a75e18758be0391c0861b2b96655d88d3e78fbc924e89 Sep 10 03:40:23.114508 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:23.114426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"5bd767b1c7d42d7cb39a75e18758be0391c0861b2b96655d88d3e78fbc924e89"} Sep 10 03:40:23.127314 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:23.127260 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:23.187287 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:23.187254 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:24.025587 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:24.025558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b6d9b9bd-lkhz2" Sep 10 03:40:24.122676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:24.122188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p9dnx" event={"ID":"575b6ab4-8cfe-468f-8326-595f7316feff","Type":"ContainerStarted","Data":"c1b15c520cfde7b6b0884f4bb9735e03f8e3e40f9cfcd12ac7cd460792acf316"} Sep 10 03:40:24.122867 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:24.122848 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:40:24.142544 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:24.142467 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p9dnx" podStartSLOduration=66.842987762 podStartE2EDuration="1m18.142443887s" totalImagesPullingTime="11.299456125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:24.141624109 +0000 UTC m=+78.946220548" watchObservedRunningTime="2026-09-10 03:40:24.142443887 +0000 UTC m=+78.947040317" Sep 10 03:40:24.170532 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:24.170423 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:24.278956 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:24.278851 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:25.127912 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:25.127812 2566 generic.go:356] "Generic (PLEG): container finished" podID="dc671265-07ae-4103-b879-fa11241a7f5d" containerID="da5a9a2a6af710dc79a73b9cf9f2b20522c224e4ecd90eb1d2a41ee1cd1677a8" exitCode=0 Sep 10 03:40:25.128324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:25.127905 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7sbzf" event={"ID":"dc671265-07ae-4103-b879-fa11241a7f5d","Type":"ContainerDied","Data":"da5a9a2a6af710dc79a73b9cf9f2b20522c224e4ecd90eb1d2a41ee1cd1677a8"} Sep 10 03:40:25.129872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:25.129841 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa" exitCode=0 Sep 10 03:40:25.129978 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:25.129934 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa"} Sep 10 03:40:25.646468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:25.646432 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:25.746457 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:25.746424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:26.137172 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.137116 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7sbzf" event={"ID":"dc671265-07ae-4103-b879-fa11241a7f5d","Type":"ContainerStarted","Data":"e959ad7a0b8c9c907ab7cfc393c83123ca6d109548b66fd6c0dd040f139acafc"} Sep 10 03:40:26.137639 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.137212 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7sbzf" event={"ID":"dc671265-07ae-4103-b879-fa11241a7f5d","Type":"ContainerStarted","Data":"6cf7a7dd78d3b81b2394a72c0e964439dc016faab5578e05ef478f0310df3455"} Sep 10 03:40:26.167641 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.167583 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7sbzf" podStartSLOduration=11.579137968 podStartE2EDuration="15.167560947s" totalImagesPullingTime="3.495561452s" totalInitContainerRuntime="92.861527ms" isStatefulPod=true podCreationTimestamp="2026-09-10 03:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:26.165335269 +0000 UTC m=+80.969931710" watchObservedRunningTime="2026-09-10 03:40:26.167560947 +0000 UTC m=+80.972157386" Sep 10 03:40:26.553179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.553128 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:26.654748 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.654695 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:26.757787 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.757726 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:26.857854 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:26.857774 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:27.198116 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.198029 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" podUID="e150fc37-9008-4a93-82c5-e775f6bd9894" containerName="registry" containerID="cri-o://464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1" gracePeriod=30 Sep 10 03:40:27.502356 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.502324 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:40:27.612792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612759 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.612973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612814 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e150fc37-9008-4a93-82c5-e775f6bd9894-ca-trust-extracted\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.612973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612849 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs4qx\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-kube-api-access-rs4qx\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.612973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612874 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-trusted-ca\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.612973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612942 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-image-registry-private-configuration\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.612973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612963 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-installation-pull-secrets\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.613259 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.612998 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-certificates\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.613259 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.613042 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-bound-sa-token\") pod \"e150fc37-9008-4a93-82c5-e775f6bd9894\" (UID: \"e150fc37-9008-4a93-82c5-e775f6bd9894\") " Sep 10 03:40:27.613775 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.613603 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:27.613775 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.613726 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:27.616129 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.616068 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-kube-api-access-rs4qx" (OuterVolumeSpecName: "kube-api-access-rs4qx") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "kube-api-access-rs4qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:40:27.616283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.616250 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:40:27.616498 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.616470 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:40:27.616633 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.616590 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:40:27.616743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.616716 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:40:27.624073 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.624048 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e150fc37-9008-4a93-82c5-e775f6bd9894-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e150fc37-9008-4a93-82c5-e775f6bd9894" (UID: "e150fc37-9008-4a93-82c5-e775f6bd9894"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:40:27.714212 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714181 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-bound-sa-token\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714212 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714213 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714229 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e150fc37-9008-4a93-82c5-e775f6bd9894-ca-trust-extracted\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714243 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs4qx\" (UniqueName: \"kubernetes.io/projected/e150fc37-9008-4a93-82c5-e775f6bd9894-kube-api-access-rs4qx\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714255 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-trusted-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714269 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-image-registry-private-configuration\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714283 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e150fc37-9008-4a93-82c5-e775f6bd9894-installation-pull-secrets\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:27.714377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:27.714298 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e150fc37-9008-4a93-82c5-e775f6bd9894-registry-certificates\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:40:28.148116 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.148084 2566 generic.go:356] "Generic (PLEG): container finished" podID="e150fc37-9008-4a93-82c5-e775f6bd9894" containerID="464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1" exitCode=0 Sep 10 03:40:28.148262 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.148127 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" Sep 10 03:40:28.148262 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.148221 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" event={"ID":"e150fc37-9008-4a93-82c5-e775f6bd9894","Type":"ContainerDied","Data":"464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1"} Sep 10 03:40:28.148377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.148284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5695c6fd5c-lncvv" event={"ID":"e150fc37-9008-4a93-82c5-e775f6bd9894","Type":"ContainerDied","Data":"07783cf8200d598e29559ec28c61bc8f20589cf53e0ca59dbedd28e1380cbf3e"} Sep 10 03:40:28.148377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.148318 2566 scope.go:117] "RemoveContainer" containerID="464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1" Sep 10 03:40:28.151797 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.151775 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1"} Sep 10 03:40:28.151915 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.151844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78"} Sep 10 03:40:28.151915 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.151890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05"} Sep 10 03:40:28.152017 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.151928 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14"} Sep 10 03:40:28.162189 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.161507 2566 scope.go:117] "RemoveContainer" containerID="464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1" Sep 10 03:40:28.162189 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:40:28.161870 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1\": container with ID starting with 464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1 not found: ID does not exist" containerID="464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1" Sep 10 03:40:28.162189 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.161911 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1"} err="failed to get container status \"464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1\": rpc error: code = NotFound desc = could not find container \"464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1\": container with ID starting with 464cdb40638106e42cee328b6655b9fb4bbde8fb6cda8cb5791aab5dd17670d1 not found: ID does not exist" Sep 10 03:40:28.170994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.170967 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5695c6fd5c-lncvv"] Sep 10 03:40:28.176504 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.176479 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5695c6fd5c-lncvv"] Sep 10 03:40:28.961308 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:28.961268 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:29.061960 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:29.061925 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:29.160681 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:29.160636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212"} Sep 10 03:40:29.603620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:29.603588 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:29.643171 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:29.643122 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e150fc37-9008-4a93-82c5-e775f6bd9894" path="/var/lib/kubelet/pods/e150fc37-9008-4a93-82c5-e775f6bd9894/volumes" Sep 10 03:40:29.700705 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:29.700662 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:29.953735 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:29.953698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:30.004519 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:30.004473 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:30.170404 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:30.170366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerStarted","Data":"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737"} Sep 10 03:40:30.201492 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:30.201439 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=12.240638579 podStartE2EDuration="18.201422069s" totalImagesPullingTime="5.947903717s" totalInitContainerRuntime="12.879773ms" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:30.199732823 +0000 UTC m=+85.004329261" watchObservedRunningTime="2026-09-10 03:40:30.201422069 +0000 UTC m=+85.006018507" Sep 10 03:40:31.272872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:31.272841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:31.330951 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:31.330906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:46.282880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:46.282844 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:46.426541 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:46.426497 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:53.257168 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:53.257137 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbscm_e36a3a11-7dea-4c1f-917f-02a93918a190/serve-healthcheck-canary/0.log" Sep 10 03:40:56.140092 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:56.140064 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p9dnx" Sep 10 03:40:56.866489 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:56.866451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:40:56.925170 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:40:56.925129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:08.238277 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:08.238242 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:08.368790 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:08.368751 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:08.449166 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:08.449126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:25.718658 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:25.718624 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:30.221330 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:30.221293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:30.619452 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:30.619372 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:31.279796 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.279764 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:41:31.280333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.280073 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="alertmanager" containerID="cri-o://459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14" gracePeriod=120 Sep 10 03:41:31.280333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.280077 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy" containerID="cri-o://9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1" gracePeriod=120 Sep 10 03:41:31.280333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.280106 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-web" containerID="cri-o://d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78" gracePeriod=120 Sep 10 03:41:31.280333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.280183 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="prom-label-proxy" containerID="cri-o://8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737" gracePeriod=120 Sep 10 03:41:31.280333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.280202 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="config-reloader" containerID="cri-o://ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05" gracePeriod=120 Sep 10 03:41:31.280597 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:31.280334 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-metric" containerID="cri-o://7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212" gracePeriod=120 Sep 10 03:41:32.398496 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398466 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737" exitCode=0 Sep 10 03:41:32.398496 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398492 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1" exitCode=0 Sep 10 03:41:32.398496 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398499 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05" exitCode=0 Sep 10 03:41:32.398855 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398504 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14" exitCode=0 Sep 10 03:41:32.398855 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737"} Sep 10 03:41:32.398855 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1"} Sep 10 03:41:32.398855 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05"} Sep 10 03:41:32.398855 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.398659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14"} Sep 10 03:41:32.518185 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.518140 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:32.589857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589783 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.589857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589822 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-tls-assets\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.589857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589840 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvwpv\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-kube-api-access-jvwpv\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589871 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589898 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-main-db\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589920 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-metrics-client-ca\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589951 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-cluster-tls-config\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.589978 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-config-volume\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590013 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-config-out\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590056 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-web-config\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590087 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590116 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-main-tls\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590183 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy\") pod \"b33b0e38-1931-42c7-870b-a079b42174d4\" (UID: \"b33b0e38-1931-42c7-870b-a079b42174d4\") " Sep 10 03:41:32.590527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590294 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:32.590527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590303 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:41:32.590527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590434 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.590527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.590454 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-alertmanager-main-db\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.591373 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.591329 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:32.593750 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.593709 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.593961 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.593936 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-kube-api-access-jvwpv" (OuterVolumeSpecName: "kube-api-access-jvwpv") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "kube-api-access-jvwpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:41:32.594201 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.594182 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:41:32.594760 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.594732 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.595259 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.595219 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-config-out" (OuterVolumeSpecName: "config-out") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:41:32.595699 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.595667 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-config-volume" (OuterVolumeSpecName: "config-volume") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.595776 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.595745 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.595961 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.595932 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.598261 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.598082 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.603740 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.603716 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-web-config" (OuterVolumeSpecName: "web-config") pod "b33b0e38-1931-42c7-870b-a079b42174d4" (UID: "b33b0e38-1931-42c7-870b-a079b42174d4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:32.691422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691381 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b33b0e38-1931-42c7-870b-a079b42174d4-config-out\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691415 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-web-config\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691426 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691436 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-main-tls\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691445 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691454 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-tls-assets\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691462 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvwpv\" (UniqueName: \"kubernetes.io/projected/b33b0e38-1931-42c7-870b-a079b42174d4-kube-api-access-jvwpv\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691470 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691479 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33b0e38-1931-42c7-870b-a079b42174d4-metrics-client-ca\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691486 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-cluster-tls-config\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:32.691638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:32.691497 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b33b0e38-1931-42c7-870b-a079b42174d4-config-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:41:33.405046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405014 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212" exitCode=0 Sep 10 03:41:33.405046 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405040 2566 generic.go:356] "Generic (PLEG): container finished" podID="b33b0e38-1931-42c7-870b-a079b42174d4" containerID="d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78" exitCode=0 Sep 10 03:41:33.405493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405096 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.405493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212"} Sep 10 03:41:33.405493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78"} Sep 10 03:41:33.405493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b33b0e38-1931-42c7-870b-a079b42174d4","Type":"ContainerDied","Data":"5bd767b1c7d42d7cb39a75e18758be0391c0861b2b96655d88d3e78fbc924e89"} Sep 10 03:41:33.405493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.405265 2566 scope.go:117] "RemoveContainer" containerID="8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737" Sep 10 03:41:33.412597 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.412576 2566 scope.go:117] "RemoveContainer" containerID="7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212" Sep 10 03:41:33.419508 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.419488 2566 scope.go:117] "RemoveContainer" containerID="9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1" Sep 10 03:41:33.428346 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.428325 2566 scope.go:117] "RemoveContainer" containerID="d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78" Sep 10 03:41:33.428799 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.428779 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:41:33.431821 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.431798 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:41:33.435535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.435518 2566 scope.go:117] "RemoveContainer" containerID="ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05" Sep 10 03:41:33.442482 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.442464 2566 scope.go:117] "RemoveContainer" containerID="459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14" Sep 10 03:41:33.449274 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.449250 2566 scope.go:117] "RemoveContainer" containerID="505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa" Sep 10 03:41:33.454959 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.454927 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455183 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-web" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455198 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-web" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455207 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e150fc37-9008-4a93-82c5-e775f6bd9894" containerName="registry" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455213 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e150fc37-9008-4a93-82c5-e775f6bd9894" containerName="registry" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455220 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="init-config-reloader" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455225 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="init-config-reloader" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455231 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455236 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455241 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-metric" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455248 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-metric" Sep 10 03:41:33.455256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455259 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="prom-label-proxy" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455268 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="prom-label-proxy" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455283 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="config-reloader" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455291 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="config-reloader" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455306 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="alertmanager" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455315 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="alertmanager" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455363 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-web" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455371 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455377 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="alertmanager" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455383 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="prom-label-proxy" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455389 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="config-reloader" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455395 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" containerName="kube-rbac-proxy-metric" Sep 10 03:41:33.455571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.455400 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e150fc37-9008-4a93-82c5-e775f6bd9894" containerName="registry" Sep 10 03:41:33.456428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.456408 2566 scope.go:117] "RemoveContainer" containerID="8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737" Sep 10 03:41:33.456694 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.456677 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737\": container with ID starting with 8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737 not found: ID does not exist" containerID="8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737" Sep 10 03:41:33.456754 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.456701 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737"} err="failed to get container status \"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737\": rpc error: code = NotFound desc = could not find container \"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737\": container with ID starting with 8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737 not found: ID does not exist" Sep 10 03:41:33.456754 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.456718 2566 scope.go:117] "RemoveContainer" containerID="7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212" Sep 10 03:41:33.456989 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.456968 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212\": container with ID starting with 7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212 not found: ID does not exist" containerID="7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212" Sep 10 03:41:33.457053 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.456993 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212"} err="failed to get container status \"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212\": rpc error: code = NotFound desc = could not find container \"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212\": container with ID starting with 7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212 not found: ID does not exist" Sep 10 03:41:33.457053 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457012 2566 scope.go:117] "RemoveContainer" containerID="9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1" Sep 10 03:41:33.457277 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.457257 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1\": container with ID starting with 9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1 not found: ID does not exist" containerID="9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1" Sep 10 03:41:33.457346 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457289 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1"} err="failed to get container status \"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1\": rpc error: code = NotFound desc = could not find container \"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1\": container with ID starting with 9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1 not found: ID does not exist" Sep 10 03:41:33.457346 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457311 2566 scope.go:117] "RemoveContainer" containerID="d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78" Sep 10 03:41:33.457589 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.457573 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78\": container with ID starting with d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78 not found: ID does not exist" containerID="d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78" Sep 10 03:41:33.457624 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457603 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78"} err="failed to get container status \"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78\": rpc error: code = NotFound desc = could not find container \"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78\": container with ID starting with d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78 not found: ID does not exist" Sep 10 03:41:33.457624 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457619 2566 scope.go:117] "RemoveContainer" containerID="ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05" Sep 10 03:41:33.457854 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.457837 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05\": container with ID starting with ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05 not found: ID does not exist" containerID="ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05" Sep 10 03:41:33.457908 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457857 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05"} err="failed to get container status \"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05\": rpc error: code = NotFound desc = could not find container \"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05\": container with ID starting with ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05 not found: ID does not exist" Sep 10 03:41:33.457908 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.457873 2566 scope.go:117] "RemoveContainer" containerID="459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14" Sep 10 03:41:33.458093 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.458077 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14\": container with ID starting with 459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14 not found: ID does not exist" containerID="459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14" Sep 10 03:41:33.458128 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458098 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14"} err="failed to get container status \"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14\": rpc error: code = NotFound desc = could not find container \"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14\": container with ID starting with 459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14 not found: ID does not exist" Sep 10 03:41:33.458128 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458112 2566 scope.go:117] "RemoveContainer" containerID="505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa" Sep 10 03:41:33.458396 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:41:33.458375 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa\": container with ID starting with 505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa not found: ID does not exist" containerID="505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa" Sep 10 03:41:33.458446 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458404 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa"} err="failed to get container status \"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa\": rpc error: code = NotFound desc = could not find container \"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa\": container with ID starting with 505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa not found: ID does not exist" Sep 10 03:41:33.458446 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458423 2566 scope.go:117] "RemoveContainer" containerID="8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737" Sep 10 03:41:33.458687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458663 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737"} err="failed to get container status \"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737\": rpc error: code = NotFound desc = could not find container \"8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737\": container with ID starting with 8fc2f3b98edae2afec74906f7b2461e31b9a5defe5b73b1ef0118c08037e3737 not found: ID does not exist" Sep 10 03:41:33.458687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458683 2566 scope.go:117] "RemoveContainer" containerID="7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212" Sep 10 03:41:33.458839 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458765 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.458973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.458951 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212"} err="failed to get container status \"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212\": rpc error: code = NotFound desc = could not find container \"7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212\": container with ID starting with 7936b2b6572901e03c22a37334c0c966d7e0ef7ca87149f0708e9529a12c2212 not found: ID does not exist" Sep 10 03:41:33.459098 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459077 2566 scope.go:117] "RemoveContainer" containerID="9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1" Sep 10 03:41:33.459386 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459358 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1"} err="failed to get container status \"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1\": rpc error: code = NotFound desc = could not find container \"9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1\": container with ID starting with 9e54fb68af65047fcc27df2c16207e23cebcca81f59d4221bdac0106cf651cc1 not found: ID does not exist" Sep 10 03:41:33.459482 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459386 2566 scope.go:117] "RemoveContainer" containerID="d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78" Sep 10 03:41:33.459637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459614 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78"} err="failed to get container status \"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78\": rpc error: code = NotFound desc = could not find container \"d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78\": container with ID starting with d1d737ed770d86d3bc23453bbab5478d14a43e952987e1271b427db1c69e7f78 not found: ID does not exist" Sep 10 03:41:33.459637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459634 2566 scope.go:117] "RemoveContainer" containerID="ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05" Sep 10 03:41:33.459851 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459829 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05"} err="failed to get container status \"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05\": rpc error: code = NotFound desc = could not find container \"ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05\": container with ID starting with ed3502c539f32fbaff3b63023c74ea183ffcd58236366cd968558a8a442a8e05 not found: ID does not exist" Sep 10 03:41:33.459851 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.459849 2566 scope.go:117] "RemoveContainer" containerID="459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14" Sep 10 03:41:33.460088 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.460070 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14"} err="failed to get container status \"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14\": rpc error: code = NotFound desc = could not find container \"459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14\": container with ID starting with 459740f91a53ecd47638d60c20c9b37fe7293f4033315eb53ca064f03731cf14 not found: ID does not exist" Sep 10 03:41:33.460145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.460088 2566 scope.go:117] "RemoveContainer" containerID="505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa" Sep 10 03:41:33.460324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.460306 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa"} err="failed to get container status \"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa\": rpc error: code = NotFound desc = could not find container \"505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa\": container with ID starting with 505f9f5b809f489ab301210112d2e94376e4770564efb28ddbe3b2fc16d386aa not found: ID does not exist" Sep 10 03:41:33.461011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.460998 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 03:41:33.461209 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461196 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 03:41:33.461362 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461348 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 03:41:33.461426 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461348 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 03:41:33.461616 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461597 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 03:41:33.461796 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461779 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 03:41:33.461865 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461842 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wcl9q\"" Sep 10 03:41:33.461916 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461896 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 03:41:33.461994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.461975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 03:41:33.469530 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.466848 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 03:41:33.476439 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.476409 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:41:33.497429 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497429 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497641 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497641 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-572zl\" (UniqueName: \"kubernetes.io/projected/26cd8277-631d-4931-a7f5-d56ef0fd77f3-kube-api-access-572zl\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497641 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497641 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26cd8277-631d-4931-a7f5-d56ef0fd77f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497641 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26cd8277-631d-4931-a7f5-d56ef0fd77f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-web-config\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497704 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26cd8277-631d-4931-a7f5-d56ef0fd77f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26cd8277-631d-4931-a7f5-d56ef0fd77f3-config-out\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26cd8277-631d-4931-a7f5-d56ef0fd77f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.497853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.497827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599212 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599212 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26cd8277-631d-4931-a7f5-d56ef0fd77f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599212 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599169 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26cd8277-631d-4931-a7f5-d56ef0fd77f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599212 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-web-config\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26cd8277-631d-4931-a7f5-d56ef0fd77f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26cd8277-631d-4931-a7f5-d56ef0fd77f3-config-out\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26cd8277-631d-4931-a7f5-d56ef0fd77f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.599921 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.599556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-572zl\" (UniqueName: \"kubernetes.io/projected/26cd8277-631d-4931-a7f5-d56ef0fd77f3-kube-api-access-572zl\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.600563 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.600242 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26cd8277-631d-4931-a7f5-d56ef0fd77f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.600676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.600636 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26cd8277-631d-4931-a7f5-d56ef0fd77f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.600902 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.600877 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26cd8277-631d-4931-a7f5-d56ef0fd77f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602330 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602299 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602451 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602431 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26cd8277-631d-4931-a7f5-d56ef0fd77f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602519 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602452 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-web-config\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602519 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602471 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602624 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602583 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602738 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602721 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26cd8277-631d-4931-a7f5-d56ef0fd77f3-config-out\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.602856 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.602838 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.603573 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.603553 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.604336 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.604308 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26cd8277-631d-4931-a7f5-d56ef0fd77f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.607737 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.607717 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-572zl\" (UniqueName: \"kubernetes.io/projected/26cd8277-631d-4931-a7f5-d56ef0fd77f3-kube-api-access-572zl\") pod \"alertmanager-main-0\" (UID: \"26cd8277-631d-4931-a7f5-d56ef0fd77f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:33.641867 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.641834 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33b0e38-1931-42c7-870b-a079b42174d4" path="/var/lib/kubelet/pods/b33b0e38-1931-42c7-870b-a079b42174d4/volumes" Sep 10 03:41:33.772752 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:33.772702 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:41:34.059559 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:34.059536 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:41:34.061350 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:41:34.061325 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cd8277_631d_4931_a7f5_d56ef0fd77f3.slice/crio-dec1974852835db76c365652bd1f344e2f78e8fe3d576d678cecf1d406c514e3 WatchSource:0}: Error finding container dec1974852835db76c365652bd1f344e2f78e8fe3d576d678cecf1d406c514e3: Status 404 returned error can't find the container with id dec1974852835db76c365652bd1f344e2f78e8fe3d576d678cecf1d406c514e3 Sep 10 03:41:34.409537 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:34.409449 2566 generic.go:356] "Generic (PLEG): container finished" podID="26cd8277-631d-4931-a7f5-d56ef0fd77f3" containerID="3fec8c785459c652e263acc1f91175fbc9867b6b5e95172374f2c345a78cb7c6" exitCode=0 Sep 10 03:41:34.409939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:34.409539 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerDied","Data":"3fec8c785459c652e263acc1f91175fbc9867b6b5e95172374f2c345a78cb7c6"} Sep 10 03:41:34.409939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:34.409604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"dec1974852835db76c365652bd1f344e2f78e8fe3d576d678cecf1d406c514e3"} Sep 10 03:41:35.307909 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.307877 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx"] Sep 10 03:41:35.309998 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.309983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.312138 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.312112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 03:41:35.312358 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.312342 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 03:41:35.312439 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.312367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 03:41:35.312575 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.312559 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 03:41:35.312694 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.312675 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8hx29\"" Sep 10 03:41:35.312802 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.312787 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 03:41:35.317705 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.317652 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 03:41:35.323400 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.323377 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx"] Sep 10 03:41:35.413382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413382 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-secret-telemeter-client\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-federate-client-tls\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413424 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-telemeter-client-tls\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-metrics-client-ca\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-serving-certs-ca-bundle\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.413811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.413579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8s7j\" (UniqueName: \"kubernetes.io/projected/00eede8f-aa55-4553-a6ef-47b687cd4a87-kube-api-access-m8s7j\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.418340 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.418314 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"62beb916c018449857adb0294bab3a820544ea8e00225e0353889bf6c7365858"} Sep 10 03:41:35.418468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.418374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"cc7b548ca8b6b75bb62f7322e9de77d68d71aec959ed5aeb64439f386881b5c1"} Sep 10 03:41:35.418468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.418402 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"e43d8c24e562cdc89205f2a9aa609b699e34cd8e63fa2900d53288b1708ec334"} Sep 10 03:41:35.418468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.418427 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"4a67affdff6a6d045d1cde80698aaa5cb8c75585afacd03bda3146be983830fd"} Sep 10 03:41:35.418468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.418450 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"5c41c40eb24423923aa4634b890c4a84c1837a82dd52b8febbb8da905f37eb83"} Sep 10 03:41:35.418619 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.418474 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26cd8277-631d-4931-a7f5-d56ef0fd77f3","Type":"ContainerStarted","Data":"4a12f39bc941a01bf3d1b22911c843cef2a609b927d92fb3a1e648be17440319"} Sep 10 03:41:35.444580 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.444521 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.430116197 podStartE2EDuration="2.444503255s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.387058ms" isStatefulPod=false podCreationTimestamp="2026-09-10 03:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:41:35.443077389 +0000 UTC m=+150.247673827" watchObservedRunningTime="2026-09-10 03:41:35.444503255 +0000 UTC m=+150.249099694" Sep 10 03:41:35.514585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.514543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-metrics-client-ca\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.514759 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.514730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-serving-certs-ca-bundle\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.514851 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.514837 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8s7j\" (UniqueName: \"kubernetes.io/projected/00eede8f-aa55-4553-a6ef-47b687cd4a87-kube-api-access-m8s7j\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.514975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515090 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-secret-telemeter-client\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515172 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-federate-client-tls\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-telemeter-client-tls\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515209 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515626 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515400 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-metrics-client-ca\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515626 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515479 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-serving-certs-ca-bundle\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.515894 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.515868 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00eede8f-aa55-4553-a6ef-47b687cd4a87-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.517594 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.517571 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-secret-telemeter-client\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.517750 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.517731 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-telemeter-client-tls\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.517812 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.517756 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-federate-client-tls\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.517915 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.517897 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00eede8f-aa55-4553-a6ef-47b687cd4a87-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.522916 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.522884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8s7j\" (UniqueName: \"kubernetes.io/projected/00eede8f-aa55-4553-a6ef-47b687cd4a87-kube-api-access-m8s7j\") pod \"telemeter-client-5fbc5c6777-b4bdx\" (UID: \"00eede8f-aa55-4553-a6ef-47b687cd4a87\") " pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.620299 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.620210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" Sep 10 03:41:35.897857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:35.897777 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx"] Sep 10 03:41:35.900934 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:41:35.900908 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eede8f_aa55_4553_a6ef_47b687cd4a87.slice/crio-bdce1223d72082d4a1695e5067557da81227dad0cd30a45b60c9a9e2feb80ef9 WatchSource:0}: Error finding container bdce1223d72082d4a1695e5067557da81227dad0cd30a45b60c9a9e2feb80ef9: Status 404 returned error can't find the container with id bdce1223d72082d4a1695e5067557da81227dad0cd30a45b60c9a9e2feb80ef9 Sep 10 03:41:36.422611 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:36.422575 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" event={"ID":"00eede8f-aa55-4553-a6ef-47b687cd4a87","Type":"ContainerStarted","Data":"bdce1223d72082d4a1695e5067557da81227dad0cd30a45b60c9a9e2feb80ef9"} Sep 10 03:41:38.431902 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:38.431813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" event={"ID":"00eede8f-aa55-4553-a6ef-47b687cd4a87","Type":"ContainerStarted","Data":"1aaa259d03b7bb4e5f8bd1a20d2960018bee31c0f7f85279bdc37a5a80128a2f"} Sep 10 03:41:38.431902 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:38.431866 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" event={"ID":"00eede8f-aa55-4553-a6ef-47b687cd4a87","Type":"ContainerStarted","Data":"bc21b2795b160428551501b2634e28f3f4b46452c6ef43099529b92852cb00f6"} Sep 10 03:41:38.431902 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:38.431885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" event={"ID":"00eede8f-aa55-4553-a6ef-47b687cd4a87","Type":"ContainerStarted","Data":"4dc10f5b6fbdc35b0947b6057c8a988b9ef10d18ee192a2ff9f56ced568e35f3"} Sep 10 03:41:38.452569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:38.452475 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fbc5c6777-b4bdx" podStartSLOduration=1.271485724 podStartE2EDuration="3.452454674s" totalImagesPullingTime="2.18096895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:41:38.452202763 +0000 UTC m=+153.256799202" watchObservedRunningTime="2026-09-10 03:41:38.452454674 +0000 UTC m=+153.257051114" Sep 10 03:41:38.603618 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:38.603587 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:38.666939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:38.666888 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:49.229759 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:49.229721 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:49.290307 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:49.290278 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:41:49.349617 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:41:49.349585 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:23.452259 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:23.452217 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:23.553509 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:23.553480 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:45.502572 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:45.502537 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:45.558338 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:45.558308 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:57.474043 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:57.474002 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:57.524606 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:57.524576 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:59.132692 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:59.132660 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:59.234172 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:59.234124 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:59.441216 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:59.441187 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:42:59.543001 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:42:59.542973 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:00.251455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:00.251423 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:00.352047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:00.352016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:01.278278 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:01.278245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:01.377565 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:01.377530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:09.532667 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:09.532631 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:09.586286 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:09.586246 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:46.488146 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:46.488106 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:47.176729 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.176693 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96"] Sep 10 03:43:47.180206 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.180185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.182738 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.182710 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:43:47.182944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.182924 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zsbrs\"" Sep 10 03:43:47.183566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.183551 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:43:47.189797 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.189774 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96"] Sep 10 03:43:47.283601 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.283561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfcfm\" (UniqueName: \"kubernetes.io/projected/1bdfedac-6066-4c7e-9d01-634f86194790-kube-api-access-rfcfm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.283782 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.283643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.283782 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.283684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.384422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.384383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.384603 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.384428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfcfm\" (UniqueName: \"kubernetes.io/projected/1bdfedac-6066-4c7e-9d01-634f86194790-kube-api-access-rfcfm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.384603 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.384486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.384846 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.384822 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.384906 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.384842 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.393312 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.393284 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfcfm\" (UniqueName: \"kubernetes.io/projected/1bdfedac-6066-4c7e-9d01-634f86194790-kube-api-access-rfcfm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.489428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.489402 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:43:47.760062 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.759977 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96"] Sep 10 03:43:47.762930 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:43:47.762896 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdfedac_6066_4c7e_9d01_634f86194790.slice/crio-789a528968a5dc4845c69812dba74e2672437b882bbeababe8b911bd691e449e WatchSource:0}: Error finding container 789a528968a5dc4845c69812dba74e2672437b882bbeababe8b911bd691e449e: Status 404 returned error can't find the container with id 789a528968a5dc4845c69812dba74e2672437b882bbeababe8b911bd691e449e Sep 10 03:43:47.871328 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.871293 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" event={"ID":"1bdfedac-6066-4c7e-9d01-634f86194790","Type":"ContainerStarted","Data":"789a528968a5dc4845c69812dba74e2672437b882bbeababe8b911bd691e449e"} Sep 10 03:43:47.986645 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:47.986617 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:49.695969 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:49.695937 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:43:54.898856 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:54.898819 2566 generic.go:356] "Generic (PLEG): container finished" podID="1bdfedac-6066-4c7e-9d01-634f86194790" containerID="3e17678f2bd8f716e9876ac17fedb4d069ef056b92189e6b077a0edf6cfdc5b7" exitCode=0 Sep 10 03:43:54.899247 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:54.898906 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" event={"ID":"1bdfedac-6066-4c7e-9d01-634f86194790","Type":"ContainerDied","Data":"3e17678f2bd8f716e9876ac17fedb4d069ef056b92189e6b077a0edf6cfdc5b7"} Sep 10 03:43:56.907840 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:56.907807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" event={"ID":"1bdfedac-6066-4c7e-9d01-634f86194790","Type":"ContainerStarted","Data":"6f0ae937df0f38b0eaa3da0539dadb76020ac818a6d2475c1198b6d30f2d6bfc"} Sep 10 03:43:57.912974 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:57.912939 2566 generic.go:356] "Generic (PLEG): container finished" podID="1bdfedac-6066-4c7e-9d01-634f86194790" containerID="6f0ae937df0f38b0eaa3da0539dadb76020ac818a6d2475c1198b6d30f2d6bfc" exitCode=0 Sep 10 03:43:57.912974 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:43:57.912977 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" event={"ID":"1bdfedac-6066-4c7e-9d01-634f86194790","Type":"ContainerDied","Data":"6f0ae937df0f38b0eaa3da0539dadb76020ac818a6d2475c1198b6d30f2d6bfc"} Sep 10 03:44:05.552649 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:05.552620 2566 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 03:44:05.944220 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:05.944183 2566 generic.go:356] "Generic (PLEG): container finished" podID="1bdfedac-6066-4c7e-9d01-634f86194790" containerID="b4119516c91e0a5ee8285aa95ccc055570ff5895e5701d1404911fdf92b0329f" exitCode=0 Sep 10 03:44:05.946268 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:05.944320 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" event={"ID":"1bdfedac-6066-4c7e-9d01-634f86194790","Type":"ContainerDied","Data":"b4119516c91e0a5ee8285aa95ccc055570ff5895e5701d1404911fdf92b0329f"} Sep 10 03:44:07.072037 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.072011 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:44:07.144370 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.144337 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-util\") pod \"1bdfedac-6066-4c7e-9d01-634f86194790\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " Sep 10 03:44:07.144569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.144386 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-bundle\") pod \"1bdfedac-6066-4c7e-9d01-634f86194790\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " Sep 10 03:44:07.144569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.144432 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfcfm\" (UniqueName: \"kubernetes.io/projected/1bdfedac-6066-4c7e-9d01-634f86194790-kube-api-access-rfcfm\") pod \"1bdfedac-6066-4c7e-9d01-634f86194790\" (UID: \"1bdfedac-6066-4c7e-9d01-634f86194790\") " Sep 10 03:44:07.145105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.145074 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-bundle" (OuterVolumeSpecName: "bundle") pod "1bdfedac-6066-4c7e-9d01-634f86194790" (UID: "1bdfedac-6066-4c7e-9d01-634f86194790"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:44:07.146556 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.146535 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdfedac-6066-4c7e-9d01-634f86194790-kube-api-access-rfcfm" (OuterVolumeSpecName: "kube-api-access-rfcfm") pod "1bdfedac-6066-4c7e-9d01-634f86194790" (UID: "1bdfedac-6066-4c7e-9d01-634f86194790"). InnerVolumeSpecName "kube-api-access-rfcfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:44:07.151220 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.151195 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-util" (OuterVolumeSpecName: "util") pod "1bdfedac-6066-4c7e-9d01-634f86194790" (UID: "1bdfedac-6066-4c7e-9d01-634f86194790"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:44:07.245127 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.245030 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:07.245127 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.245074 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bdfedac-6066-4c7e-9d01-634f86194790-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:07.245127 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.245085 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfcfm\" (UniqueName: \"kubernetes.io/projected/1bdfedac-6066-4c7e-9d01-634f86194790-kube-api-access-rfcfm\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:07.953664 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.953628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" event={"ID":"1bdfedac-6066-4c7e-9d01-634f86194790","Type":"ContainerDied","Data":"789a528968a5dc4845c69812dba74e2672437b882bbeababe8b911bd691e449e"} Sep 10 03:44:07.953664 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.953650 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k2s96" Sep 10 03:44:07.953867 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:07.953683 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="789a528968a5dc4845c69812dba74e2672437b882bbeababe8b911bd691e449e" Sep 10 03:44:13.321513 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:13.321443 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:14.123642 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:14.123605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:15.256634 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256598 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl"] Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256850 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="util" Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256859 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="util" Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256873 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="extract" Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256879 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="extract" Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256890 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="pull" Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256895 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="pull" Sep 10 03:44:15.257009 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.256938 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bdfedac-6066-4c7e-9d01-634f86194790" containerName="extract" Sep 10 03:44:15.260055 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.260035 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.262475 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.262453 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 03:44:15.262744 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.262730 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g6vf8\"" Sep 10 03:44:15.262911 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.262899 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:44:15.272686 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.272660 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl"] Sep 10 03:44:15.305439 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.305399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6wm\" (UniqueName: \"kubernetes.io/projected/16ea6fab-8fd7-412c-9155-c275f0773542-kube-api-access-cp6wm\") pod \"cert-manager-operator-controller-manager-55c444bf86-6hckl\" (UID: \"16ea6fab-8fd7-412c-9155-c275f0773542\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.305613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.305454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16ea6fab-8fd7-412c-9155-c275f0773542-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6hckl\" (UID: \"16ea6fab-8fd7-412c-9155-c275f0773542\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.406442 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.406397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6wm\" (UniqueName: \"kubernetes.io/projected/16ea6fab-8fd7-412c-9155-c275f0773542-kube-api-access-cp6wm\") pod \"cert-manager-operator-controller-manager-55c444bf86-6hckl\" (UID: \"16ea6fab-8fd7-412c-9155-c275f0773542\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.406580 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.406470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16ea6fab-8fd7-412c-9155-c275f0773542-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6hckl\" (UID: \"16ea6fab-8fd7-412c-9155-c275f0773542\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.406813 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.406797 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16ea6fab-8fd7-412c-9155-c275f0773542-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6hckl\" (UID: \"16ea6fab-8fd7-412c-9155-c275f0773542\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.414953 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.414924 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6wm\" (UniqueName: \"kubernetes.io/projected/16ea6fab-8fd7-412c-9155-c275f0773542-kube-api-access-cp6wm\") pod \"cert-manager-operator-controller-manager-55c444bf86-6hckl\" (UID: \"16ea6fab-8fd7-412c-9155-c275f0773542\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.568343 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.568258 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" Sep 10 03:44:15.843626 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.843597 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl"] Sep 10 03:44:15.846183 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:15.846145 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ea6fab_8fd7_412c_9155_c275f0773542.slice/crio-8fed9c3de566e9550099683980716d6c21bc5edb6774f0fe4c419e601215fcc7 WatchSource:0}: Error finding container 8fed9c3de566e9550099683980716d6c21bc5edb6774f0fe4c419e601215fcc7: Status 404 returned error can't find the container with id 8fed9c3de566e9550099683980716d6c21bc5edb6774f0fe4c419e601215fcc7 Sep 10 03:44:15.848858 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.848837 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:44:15.982122 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:15.982091 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" event={"ID":"16ea6fab-8fd7-412c-9155-c275f0773542","Type":"ContainerStarted","Data":"8fed9c3de566e9550099683980716d6c21bc5edb6774f0fe4c419e601215fcc7"} Sep 10 03:44:16.930219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:16.930186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:17.042442 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:17.042406 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:17.993638 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:17.993608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" event={"ID":"16ea6fab-8fd7-412c-9155-c275f0773542","Type":"ContainerStarted","Data":"effd3d3d6760cf75c37d0901a418e9d4c06773d97eb7267626c065f66604102c"} Sep 10 03:44:18.014501 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.014447 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6hckl" podStartSLOduration=1.348766217 podStartE2EDuration="3.014431659s" totalImagesPullingTime="1.665665442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:44:18.013219807 +0000 UTC m=+312.817816245" watchObservedRunningTime="2026-09-10 03:44:18.014431659 +0000 UTC m=+312.819028097" Sep 10 03:44:18.439991 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.439964 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:18.571379 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.571345 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:18.775514 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.775426 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bznqt"] Sep 10 03:44:18.777433 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.777412 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:18.779903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.779880 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 03:44:18.780870 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.780852 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 03:44:18.782360 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.782344 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dfrp6\"" Sep 10 03:44:18.790345 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.790322 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bznqt"] Sep 10 03:44:18.832811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.832775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/441fde4a-fe6a-420e-993d-4ce7a208accb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bznqt\" (UID: \"441fde4a-fe6a-420e-993d-4ce7a208accb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:18.832980 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.832838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9z8c\" (UniqueName: \"kubernetes.io/projected/441fde4a-fe6a-420e-993d-4ce7a208accb-kube-api-access-r9z8c\") pod \"cert-manager-webhook-6486ffd997-bznqt\" (UID: \"441fde4a-fe6a-420e-993d-4ce7a208accb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:18.934144 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.934102 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9z8c\" (UniqueName: \"kubernetes.io/projected/441fde4a-fe6a-420e-993d-4ce7a208accb-kube-api-access-r9z8c\") pod \"cert-manager-webhook-6486ffd997-bznqt\" (UID: \"441fde4a-fe6a-420e-993d-4ce7a208accb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:18.934350 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.934207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/441fde4a-fe6a-420e-993d-4ce7a208accb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bznqt\" (UID: \"441fde4a-fe6a-420e-993d-4ce7a208accb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:18.942569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.942529 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/441fde4a-fe6a-420e-993d-4ce7a208accb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bznqt\" (UID: \"441fde4a-fe6a-420e-993d-4ce7a208accb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:18.942709 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:18.942639 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9z8c\" (UniqueName: \"kubernetes.io/projected/441fde4a-fe6a-420e-993d-4ce7a208accb-kube-api-access-r9z8c\") pod \"cert-manager-webhook-6486ffd997-bznqt\" (UID: \"441fde4a-fe6a-420e-993d-4ce7a208accb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:19.102690 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.102603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:19.199139 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.199105 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb"] Sep 10 03:44:19.201426 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.201412 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.203755 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.203736 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zsbrs\"" Sep 10 03:44:19.203884 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.203741 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:44:19.204140 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.204123 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:44:19.215664 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.215639 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb"] Sep 10 03:44:19.237145 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.237116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbz9\" (UniqueName: \"kubernetes.io/projected/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-kube-api-access-psbz9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.237311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.237238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.237311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.237279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.338569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.338523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.338569 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.338576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.338833 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.338613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbz9\" (UniqueName: \"kubernetes.io/projected/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-kube-api-access-psbz9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.338938 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.338917 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.339004 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.338984 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.346899 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.346872 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbz9\" (UniqueName: \"kubernetes.io/projected/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-kube-api-access-psbz9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.372329 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.372304 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bznqt"] Sep 10 03:44:19.374675 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:19.374646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod441fde4a_fe6a_420e_993d_4ce7a208accb.slice/crio-40605793419f7a9b546a0ccd2a99c9644651faf5db34613dff27fb922e33bb1e WatchSource:0}: Error finding container 40605793419f7a9b546a0ccd2a99c9644651faf5db34613dff27fb922e33bb1e: Status 404 returned error can't find the container with id 40605793419f7a9b546a0ccd2a99c9644651faf5db34613dff27fb922e33bb1e Sep 10 03:44:19.510735 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.510700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:19.779662 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:19.779605 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb"] Sep 10 03:44:19.781584 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:19.781559 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d70a79_ccd7_4f31_8beb_7be606f3a5cc.slice/crio-7f85cbc3f1b75b647951fb06d00820ed04a534f551ff0b621239f993f4c99043 WatchSource:0}: Error finding container 7f85cbc3f1b75b647951fb06d00820ed04a534f551ff0b621239f993f4c99043: Status 404 returned error can't find the container with id 7f85cbc3f1b75b647951fb06d00820ed04a534f551ff0b621239f993f4c99043 Sep 10 03:44:20.003119 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:20.003081 2566 generic.go:356] "Generic (PLEG): container finished" podID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerID="bd238855cf0f642d187d63ed67ceac081813c19a09a380d26b8d2e4db0af2f11" exitCode=0 Sep 10 03:44:20.003289 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:20.003183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" event={"ID":"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc","Type":"ContainerDied","Data":"bd238855cf0f642d187d63ed67ceac081813c19a09a380d26b8d2e4db0af2f11"} Sep 10 03:44:20.003289 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:20.003241 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" event={"ID":"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc","Type":"ContainerStarted","Data":"7f85cbc3f1b75b647951fb06d00820ed04a534f551ff0b621239f993f4c99043"} Sep 10 03:44:20.004424 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:20.004404 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" event={"ID":"441fde4a-fe6a-420e-993d-4ce7a208accb","Type":"ContainerStarted","Data":"40605793419f7a9b546a0ccd2a99c9644651faf5db34613dff27fb922e33bb1e"} Sep 10 03:44:20.782116 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:20.781998 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:20.971728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:20.971639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:23.020334 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.020304 2566 generic.go:356] "Generic (PLEG): container finished" podID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerID="8d4e8b3288fcb738c6f37f9d6864f402150b19ad4ce69504130a2b003eee980a" exitCode=0 Sep 10 03:44:23.020695 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.020382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" event={"ID":"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc","Type":"ContainerDied","Data":"8d4e8b3288fcb738c6f37f9d6864f402150b19ad4ce69504130a2b003eee980a"} Sep 10 03:44:23.022036 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.022008 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" event={"ID":"441fde4a-fe6a-420e-993d-4ce7a208accb","Type":"ContainerStarted","Data":"ce59d835aa90ed8a540fdcb7dd42b15c6b91ba7abf73d1034b4c19fadea5847e"} Sep 10 03:44:23.022129 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.022054 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:23.053461 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.053408 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" podStartSLOduration=1.56524954 podStartE2EDuration="5.053391247s" totalImagesPullingTime="3.488141707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:44:23.052419804 +0000 UTC m=+317.857016243" watchObservedRunningTime="2026-09-10 03:44:23.053391247 +0000 UTC m=+317.857987685" Sep 10 03:44:23.716445 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.716410 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:23.769526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:23.769494 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:24.028267 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:24.028178 2566 generic.go:356] "Generic (PLEG): container finished" podID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerID="3855b5dfca0ee5bb6a1571c5b2d5ad9e2cff9ce6c67a6881b13b466d8b5e21af" exitCode=0 Sep 10 03:44:24.028696 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:24.028263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" event={"ID":"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc","Type":"ContainerDied","Data":"3855b5dfca0ee5bb6a1571c5b2d5ad9e2cff9ce6c67a6881b13b466d8b5e21af"} Sep 10 03:44:25.153495 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.153469 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:25.187759 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.187725 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psbz9\" (UniqueName: \"kubernetes.io/projected/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-kube-api-access-psbz9\") pod \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " Sep 10 03:44:25.187933 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.187773 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-bundle\") pod \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " Sep 10 03:44:25.187933 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.187810 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-util\") pod \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\" (UID: \"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc\") " Sep 10 03:44:25.188247 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.188217 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-bundle" (OuterVolumeSpecName: "bundle") pod "b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" (UID: "b6d70a79-ccd7-4f31-8beb-7be606f3a5cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:44:25.189798 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.189770 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-kube-api-access-psbz9" (OuterVolumeSpecName: "kube-api-access-psbz9") pod "b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" (UID: "b6d70a79-ccd7-4f31-8beb-7be606f3a5cc"). InnerVolumeSpecName "kube-api-access-psbz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:44:25.192829 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.192807 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-util" (OuterVolumeSpecName: "util") pod "b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" (UID: "b6d70a79-ccd7-4f31-8beb-7be606f3a5cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:44:25.288931 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.288837 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psbz9\" (UniqueName: \"kubernetes.io/projected/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-kube-api-access-psbz9\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:25.288931 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.288877 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:25.288931 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:25.288886 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d70a79-ccd7-4f31-8beb-7be606f3a5cc-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:26.037649 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:26.037619 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" Sep 10 03:44:26.037649 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:26.037631 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f99swb" event={"ID":"b6d70a79-ccd7-4f31-8beb-7be606f3a5cc","Type":"ContainerDied","Data":"7f85cbc3f1b75b647951fb06d00820ed04a534f551ff0b621239f993f4c99043"} Sep 10 03:44:26.037846 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:26.037670 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f85cbc3f1b75b647951fb06d00820ed04a534f551ff0b621239f993f4c99043" Sep 10 03:44:26.272792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:26.272747 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:27.059363 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:27.059331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:27.167005 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:27.166971 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:28.385903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.385876 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:28.780679 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.780641 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-22hs5"] Sep 10 03:44:28.780976 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.780958 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="pull" Sep 10 03:44:28.781047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.780979 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="pull" Sep 10 03:44:28.781047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.781000 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="util" Sep 10 03:44:28.781047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.781007 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="util" Sep 10 03:44:28.781047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.781036 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="extract" Sep 10 03:44:28.781047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.781045 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="extract" Sep 10 03:44:28.781339 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.781106 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6d70a79-ccd7-4f31-8beb-7be606f3a5cc" containerName="extract" Sep 10 03:44:28.783890 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.783868 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:28.786571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.786535 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7zvnr\"" Sep 10 03:44:28.793419 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.793396 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-22hs5"] Sep 10 03:44:28.812883 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.812851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6a82470-9d53-426e-a262-904ab4c4bfdc-bound-sa-token\") pod \"cert-manager-55b4d954d5-22hs5\" (UID: \"a6a82470-9d53-426e-a262-904ab4c4bfdc\") " pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:28.813034 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.812892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltg7d\" (UniqueName: \"kubernetes.io/projected/a6a82470-9d53-426e-a262-904ab4c4bfdc-kube-api-access-ltg7d\") pod \"cert-manager-55b4d954d5-22hs5\" (UID: \"a6a82470-9d53-426e-a262-904ab4c4bfdc\") " pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:28.913328 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.913287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6a82470-9d53-426e-a262-904ab4c4bfdc-bound-sa-token\") pod \"cert-manager-55b4d954d5-22hs5\" (UID: \"a6a82470-9d53-426e-a262-904ab4c4bfdc\") " pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:28.913328 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.913335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltg7d\" (UniqueName: \"kubernetes.io/projected/a6a82470-9d53-426e-a262-904ab4c4bfdc-kube-api-access-ltg7d\") pod \"cert-manager-55b4d954d5-22hs5\" (UID: \"a6a82470-9d53-426e-a262-904ab4c4bfdc\") " pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:28.922010 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.921982 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6a82470-9d53-426e-a262-904ab4c4bfdc-bound-sa-token\") pod \"cert-manager-55b4d954d5-22hs5\" (UID: \"a6a82470-9d53-426e-a262-904ab4c4bfdc\") " pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:28.922185 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:28.922141 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltg7d\" (UniqueName: \"kubernetes.io/projected/a6a82470-9d53-426e-a262-904ab4c4bfdc-kube-api-access-ltg7d\") pod \"cert-manager-55b4d954d5-22hs5\" (UID: \"a6a82470-9d53-426e-a262-904ab4c4bfdc\") " pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:29.030774 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:29.030678 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bznqt" Sep 10 03:44:29.095657 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:29.095617 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-22hs5" Sep 10 03:44:29.370499 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:29.370473 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-22hs5"] Sep 10 03:44:29.373381 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:29.373352 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a82470_9d53_426e_a262_904ab4c4bfdc.slice/crio-c6410862c6b359b253d30ba55f053739decdfe7c5f274a8aa11502c6012940b1 WatchSource:0}: Error finding container c6410862c6b359b253d30ba55f053739decdfe7c5f274a8aa11502c6012940b1: Status 404 returned error can't find the container with id c6410862c6b359b253d30ba55f053739decdfe7c5f274a8aa11502c6012940b1 Sep 10 03:44:30.055974 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:30.055939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-22hs5" event={"ID":"a6a82470-9d53-426e-a262-904ab4c4bfdc","Type":"ContainerStarted","Data":"712b0f4db806dcb4b28cf0d69e6cfc8d8f507d5f4677518b737e12613f2e0064"} Sep 10 03:44:30.056372 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:30.055983 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-22hs5" event={"ID":"a6a82470-9d53-426e-a262-904ab4c4bfdc","Type":"ContainerStarted","Data":"c6410862c6b359b253d30ba55f053739decdfe7c5f274a8aa11502c6012940b1"} Sep 10 03:44:30.072395 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:30.072344 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-22hs5" podStartSLOduration=2.072325477 podStartE2EDuration="2.072325477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:44:30.070824585 +0000 UTC m=+324.875421024" watchObservedRunningTime="2026-09-10 03:44:30.072325477 +0000 UTC m=+324.876921914" Sep 10 03:44:31.188483 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:31.188452 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:31.288314 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:31.288257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:34.468758 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:34.468727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:34.570071 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:34.570040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:37.458508 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:37.458475 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:37.557358 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:37.557321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:38.945366 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:38.945333 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c"] Sep 10 03:44:38.965045 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:38.965015 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c"] Sep 10 03:44:38.965211 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:38.965140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:38.967648 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:38.967626 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:44:38.967780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:38.967700 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:44:38.967780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:38.967760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zsbrs\"" Sep 10 03:44:39.089963 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.089917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.090166 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.090024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.090166 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.090066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56l2k\" (UniqueName: \"kubernetes.io/projected/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-kube-api-access-56l2k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.190939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.190908 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.191105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.190966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.191105 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.190998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56l2k\" (UniqueName: \"kubernetes.io/projected/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-kube-api-access-56l2k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.191351 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.191331 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.191401 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.191380 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.199467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.199408 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56l2k\" (UniqueName: \"kubernetes.io/projected/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-kube-api-access-56l2k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.274466 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.274428 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:39.566109 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.566052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c"] Sep 10 03:44:39.568409 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:39.568381 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff448ab3_ecc0_4466_8fec_b12b2c124f0a.slice/crio-70e19d71bfba923fd9c87f521d22047b3920a50514d4834aa4fb30dc955bac2e WatchSource:0}: Error finding container 70e19d71bfba923fd9c87f521d22047b3920a50514d4834aa4fb30dc955bac2e: Status 404 returned error can't find the container with id 70e19d71bfba923fd9c87f521d22047b3920a50514d4834aa4fb30dc955bac2e Sep 10 03:44:39.695262 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:39.695220 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:40.099953 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:40.099919 2566 generic.go:356] "Generic (PLEG): container finished" podID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerID="04bbeb11ac21dc818dc209251b38e7c8a9b83f8ad6fcea62a3e3e4c63cf16e8b" exitCode=0 Sep 10 03:44:40.100357 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:40.099981 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" event={"ID":"ff448ab3-ecc0-4466-8fec-b12b2c124f0a","Type":"ContainerDied","Data":"04bbeb11ac21dc818dc209251b38e7c8a9b83f8ad6fcea62a3e3e4c63cf16e8b"} Sep 10 03:44:40.100357 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:40.100031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" event={"ID":"ff448ab3-ecc0-4466-8fec-b12b2c124f0a","Type":"ContainerStarted","Data":"70e19d71bfba923fd9c87f521d22047b3920a50514d4834aa4fb30dc955bac2e"} Sep 10 03:44:41.105540 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:41.105452 2566 generic.go:356] "Generic (PLEG): container finished" podID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerID="07dc6cd44054c394619f1904bc2005eb2a75b76bfde1812e703fc8f90f39e253" exitCode=0 Sep 10 03:44:41.105540 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:41.105497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" event={"ID":"ff448ab3-ecc0-4466-8fec-b12b2c124f0a","Type":"ContainerDied","Data":"07dc6cd44054c394619f1904bc2005eb2a75b76bfde1812e703fc8f90f39e253"} Sep 10 03:44:42.112327 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:42.112295 2566 generic.go:356] "Generic (PLEG): container finished" podID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerID="9cda528053ac313e30336c16bd1d708685e16fc8767962e94a6615abf9297ea2" exitCode=0 Sep 10 03:44:42.112736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:42.112337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" event={"ID":"ff448ab3-ecc0-4466-8fec-b12b2c124f0a","Type":"ContainerDied","Data":"9cda528053ac313e30336c16bd1d708685e16fc8767962e94a6615abf9297ea2"} Sep 10 03:44:43.243442 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.243052 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:43.322753 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.322717 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56l2k\" (UniqueName: \"kubernetes.io/projected/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-kube-api-access-56l2k\") pod \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " Sep 10 03:44:43.322753 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.322770 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-bundle\") pod \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " Sep 10 03:44:43.323019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.322924 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-util\") pod \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\" (UID: \"ff448ab3-ecc0-4466-8fec-b12b2c124f0a\") " Sep 10 03:44:43.323499 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.323475 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-bundle" (OuterVolumeSpecName: "bundle") pod "ff448ab3-ecc0-4466-8fec-b12b2c124f0a" (UID: "ff448ab3-ecc0-4466-8fec-b12b2c124f0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:44:43.324861 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.324831 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-kube-api-access-56l2k" (OuterVolumeSpecName: "kube-api-access-56l2k") pod "ff448ab3-ecc0-4466-8fec-b12b2c124f0a" (UID: "ff448ab3-ecc0-4466-8fec-b12b2c124f0a"). InnerVolumeSpecName "kube-api-access-56l2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:44:43.328678 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.328594 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-util" (OuterVolumeSpecName: "util") pod "ff448ab3-ecc0-4466-8fec-b12b2c124f0a" (UID: "ff448ab3-ecc0-4466-8fec-b12b2c124f0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:44:43.424455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.424360 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:43.424455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.424395 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56l2k\" (UniqueName: \"kubernetes.io/projected/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-kube-api-access-56l2k\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:43.424455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:43.424410 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff448ab3-ecc0-4466-8fec-b12b2c124f0a-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:44:44.122082 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:44.122046 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" event={"ID":"ff448ab3-ecc0-4466-8fec-b12b2c124f0a","Type":"ContainerDied","Data":"70e19d71bfba923fd9c87f521d22047b3920a50514d4834aa4fb30dc955bac2e"} Sep 10 03:44:44.122082 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:44.122087 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhzf4c" Sep 10 03:44:44.122310 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:44.122094 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70e19d71bfba923fd9c87f521d22047b3920a50514d4834aa4fb30dc955bac2e" Sep 10 03:44:55.361142 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:55.361097 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:55.453747 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:55.453714 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:55.999255 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:55.999210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.175709 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175679 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l"] Sep 10 03:44:56.175952 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175940 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="extract" Sep 10 03:44:56.176006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175953 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="extract" Sep 10 03:44:56.176006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175964 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="util" Sep 10 03:44:56.176006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175970 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="util" Sep 10 03:44:56.176006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175978 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="pull" Sep 10 03:44:56.176006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.175986 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="pull" Sep 10 03:44:56.176179 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.176044 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff448ab3-ecc0-4466-8fec-b12b2c124f0a" containerName="extract" Sep 10 03:44:56.180968 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.180945 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.183372 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.183350 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:44:56.183497 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.183479 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zsbrs\"" Sep 10 03:44:56.184299 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.184283 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:44:56.189969 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.189943 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l"] Sep 10 03:44:56.192493 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.192474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.278373 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.278288 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.325402 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.325368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.325564 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.325414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqqm\" (UniqueName: \"kubernetes.io/projected/0432f474-86ab-49b8-8a86-3508c9664bf2-kube-api-access-7qqqm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.325564 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.325503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.383651 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.383615 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j"] Sep 10 03:44:56.387479 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.387457 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.389651 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.389629 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 03:44:56.389922 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.389890 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 03:44:56.390030 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.389984 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 03:44:56.390030 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.390002 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-klh6s\"" Sep 10 03:44:56.390300 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.390285 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 03:44:56.402402 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.402375 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j"] Sep 10 03:44:56.426002 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.425967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.426138 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.426025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.426138 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.426058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqqm\" (UniqueName: \"kubernetes.io/projected/0432f474-86ab-49b8-8a86-3508c9664bf2-kube-api-access-7qqqm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.426387 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.426370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.426453 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.426434 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.441345 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.441310 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqqm\" (UniqueName: \"kubernetes.io/projected/0432f474-86ab-49b8-8a86-3508c9664bf2-kube-api-access-7qqqm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.490396 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.490363 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:44:56.527444 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.527384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gh9\" (UniqueName: \"kubernetes.io/projected/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-kube-api-access-c4gh9\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.527444 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.527440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-webhook-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.527706 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.527518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-manifests\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.527706 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.527563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.527706 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.527599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-tmp\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.554973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.554890 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.628589 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.628553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gh9\" (UniqueName: \"kubernetes.io/projected/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-kube-api-access-c4gh9\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.628589 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.628594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-webhook-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.628818 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.628717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-manifests\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.628818 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.628780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.628902 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.628817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-tmp\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.629130 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.629112 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-manifests\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.631203 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.631181 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.631294 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.631241 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-tmp\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.631368 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.631351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-webhook-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.637147 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.637122 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gh9\" (UniqueName: \"kubernetes.io/projected/6983443d-ea9d-4b2b-b886-3bc0a837dbe3-kube-api-access-c4gh9\") pod \"opendatahub-operator-controller-manager-b77bb99d9-vh97j\" (UID: \"6983443d-ea9d-4b2b-b886-3bc0a837dbe3\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.656336 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.656302 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.696970 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.696928 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:44:56.752989 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.752775 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.764766 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.764734 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l"] Sep 10 03:44:56.767260 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:56.767232 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0432f474_86ab_49b8_8a86_3508c9664bf2.slice/crio-de59a493e57a8e515cb74631356105343c4a87657f0ed182f493f86bdb2afcd5 WatchSource:0}: Error finding container de59a493e57a8e515cb74631356105343c4a87657f0ed182f493f86bdb2afcd5: Status 404 returned error can't find the container with id de59a493e57a8e515cb74631356105343c4a87657f0ed182f493f86bdb2afcd5 Sep 10 03:44:56.853409 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.853361 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.955475 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.955442 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:56.982329 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:56.982304 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j"] Sep 10 03:44:56.984072 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:44:56.984042 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6983443d_ea9d_4b2b_b886_3bc0a837dbe3.slice/crio-c076f33c4118adaf049ad15f79c2a387174ea67464640a3c95f0f69c4efade4d WatchSource:0}: Error finding container c076f33c4118adaf049ad15f79c2a387174ea67464640a3c95f0f69c4efade4d: Status 404 returned error can't find the container with id c076f33c4118adaf049ad15f79c2a387174ea67464640a3c95f0f69c4efade4d Sep 10 03:44:57.055630 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:57.055556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:44:57.176977 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:57.176945 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" event={"ID":"6983443d-ea9d-4b2b-b886-3bc0a837dbe3","Type":"ContainerStarted","Data":"c076f33c4118adaf049ad15f79c2a387174ea67464640a3c95f0f69c4efade4d"} Sep 10 03:44:57.178381 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:57.178354 2566 generic.go:356] "Generic (PLEG): container finished" podID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerID="674bb3f4b5184e797e4d8e86021a20048ac87bb26c4765e865d1f900d51e5a92" exitCode=0 Sep 10 03:44:57.178497 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:57.178410 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" event={"ID":"0432f474-86ab-49b8-8a86-3508c9664bf2","Type":"ContainerDied","Data":"674bb3f4b5184e797e4d8e86021a20048ac87bb26c4765e865d1f900d51e5a92"} Sep 10 03:44:57.178497 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:57.178441 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" event={"ID":"0432f474-86ab-49b8-8a86-3508c9664bf2","Type":"ContainerStarted","Data":"de59a493e57a8e515cb74631356105343c4a87657f0ed182f493f86bdb2afcd5"} Sep 10 03:44:58.186899 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:58.186839 2566 generic.go:356] "Generic (PLEG): container finished" podID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerID="caa8a1b341cde5cd001c8ce354be1e6ca582c2f87b3059f313987fed02528ba9" exitCode=0 Sep 10 03:44:58.187498 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:58.186967 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" event={"ID":"0432f474-86ab-49b8-8a86-3508c9664bf2","Type":"ContainerDied","Data":"caa8a1b341cde5cd001c8ce354be1e6ca582c2f87b3059f313987fed02528ba9"} Sep 10 03:44:59.194824 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:59.194783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" event={"ID":"0432f474-86ab-49b8-8a86-3508c9664bf2","Type":"ContainerStarted","Data":"38a04d593b448fcb9eee2561a5c49566a52dd5dcf53a572afdbf8be7d4c3d661"} Sep 10 03:44:59.214238 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:44:59.214176 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" podStartSLOduration=2.432389599 podStartE2EDuration="3.214140202s" totalImagesPullingTime="781.750603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:44:59.211705765 +0000 UTC m=+354.016302203" watchObservedRunningTime="2026-09-10 03:44:59.214140202 +0000 UTC m=+354.018736642" Sep 10 03:45:00.201826 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:00.201789 2566 generic.go:356] "Generic (PLEG): container finished" podID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerID="38a04d593b448fcb9eee2561a5c49566a52dd5dcf53a572afdbf8be7d4c3d661" exitCode=0 Sep 10 03:45:00.202290 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:00.201866 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" event={"ID":"0432f474-86ab-49b8-8a86-3508c9664bf2","Type":"ContainerDied","Data":"38a04d593b448fcb9eee2561a5c49566a52dd5dcf53a572afdbf8be7d4c3d661"} Sep 10 03:45:00.203528 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:00.203507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" event={"ID":"6983443d-ea9d-4b2b-b886-3bc0a837dbe3","Type":"ContainerStarted","Data":"2be374b71e92372c85965a28ebd0778dff4cd8e2cdfb8af55eede10e7dcb757c"} Sep 10 03:45:01.208832 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.208801 2566 generic.go:356] "Generic (PLEG): container finished" podID="6983443d-ea9d-4b2b-b886-3bc0a837dbe3" containerID="2be374b71e92372c85965a28ebd0778dff4cd8e2cdfb8af55eede10e7dcb757c" exitCode=0 Sep 10 03:45:01.209246 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.208889 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" event={"ID":"6983443d-ea9d-4b2b-b886-3bc0a837dbe3","Type":"ContainerDied","Data":"2be374b71e92372c85965a28ebd0778dff4cd8e2cdfb8af55eede10e7dcb757c"} Sep 10 03:45:01.337356 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.337326 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:45:01.349781 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.349758 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:01.457752 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.457722 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:01.474926 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.474894 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-util\") pod \"0432f474-86ab-49b8-8a86-3508c9664bf2\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " Sep 10 03:45:01.475031 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.474953 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qqqm\" (UniqueName: \"kubernetes.io/projected/0432f474-86ab-49b8-8a86-3508c9664bf2-kube-api-access-7qqqm\") pod \"0432f474-86ab-49b8-8a86-3508c9664bf2\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " Sep 10 03:45:01.475031 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.475018 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-bundle\") pod \"0432f474-86ab-49b8-8a86-3508c9664bf2\" (UID: \"0432f474-86ab-49b8-8a86-3508c9664bf2\") " Sep 10 03:45:01.475829 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.475769 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-bundle" (OuterVolumeSpecName: "bundle") pod "0432f474-86ab-49b8-8a86-3508c9664bf2" (UID: "0432f474-86ab-49b8-8a86-3508c9664bf2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:45:01.477194 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.477144 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0432f474-86ab-49b8-8a86-3508c9664bf2-kube-api-access-7qqqm" (OuterVolumeSpecName: "kube-api-access-7qqqm") pod "0432f474-86ab-49b8-8a86-3508c9664bf2" (UID: "0432f474-86ab-49b8-8a86-3508c9664bf2"). InnerVolumeSpecName "kube-api-access-7qqqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:45:01.480450 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.480430 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-util" (OuterVolumeSpecName: "util") pod "0432f474-86ab-49b8-8a86-3508c9664bf2" (UID: "0432f474-86ab-49b8-8a86-3508c9664bf2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:45:01.575845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.575759 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:01.575845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.575789 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0432f474-86ab-49b8-8a86-3508c9664bf2-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:01.575845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:01.575798 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qqqm\" (UniqueName: \"kubernetes.io/projected/0432f474-86ab-49b8-8a86-3508c9664bf2-kube-api-access-7qqqm\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:02.215063 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:02.215025 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" event={"ID":"6983443d-ea9d-4b2b-b886-3bc0a837dbe3","Type":"ContainerStarted","Data":"28c97d88d82467541ac369bf0aa3e2ea97fd91fc02dd36439e2361c584c47863"} Sep 10 03:45:02.215520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:02.215180 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:45:02.216996 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:02.216969 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" Sep 10 03:45:02.217113 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:02.216964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sll8l" event={"ID":"0432f474-86ab-49b8-8a86-3508c9664bf2","Type":"ContainerDied","Data":"de59a493e57a8e515cb74631356105343c4a87657f0ed182f493f86bdb2afcd5"} Sep 10 03:45:02.217113 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:02.217069 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de59a493e57a8e515cb74631356105343c4a87657f0ed182f493f86bdb2afcd5" Sep 10 03:45:02.240622 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:02.240560 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" podStartSLOduration=1.790924457 podStartE2EDuration="6.240545195s" totalImagesPullingTime="3.398593784s" totalInitContainerRuntime="1.051026954s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:02.239090482 +0000 UTC m=+357.043686921" watchObservedRunningTime="2026-09-10 03:45:02.240545195 +0000 UTC m=+357.045141634" Sep 10 03:45:10.236949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:10.236905 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:10.338223 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:10.338193 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:10.671880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:10.671799 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:10.772750 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:10.772717 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:13.223818 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:13.223788 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-vh97j" Sep 10 03:45:13.963332 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:13.963297 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:14.017228 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:14.017199 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:14.100042 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:14.100011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:14.158402 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:14.158372 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:14.706452 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:14.706418 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:14.809627 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:14.809598 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:15.622727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:15.622695 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:15.732564 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:15.732527 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:15.947994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:15.947965 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:16.037972 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.037935 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg"] Sep 10 03:45:16.038240 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038226 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="util" Sep 10 03:45:16.038288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038241 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="util" Sep 10 03:45:16.038288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038248 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="pull" Sep 10 03:45:16.038288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038254 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="pull" Sep 10 03:45:16.038288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038268 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="extract" Sep 10 03:45:16.038288 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038273 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="extract" Sep 10 03:45:16.038440 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.038331 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0432f474-86ab-49b8-8a86-3508c9664bf2" containerName="extract" Sep 10 03:45:16.047439 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.047415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.056391 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.056363 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-77gv4\"" Sep 10 03:45:16.060356 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.060337 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 03:45:16.061244 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.061229 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 03:45:16.064824 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.064806 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 03:45:16.064919 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.064860 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 03:45:16.073369 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.073345 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg"] Sep 10 03:45:16.110302 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.110266 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:16.194365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.194333 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9c6n\" (UniqueName: \"kubernetes.io/projected/722340e1-ea7a-4406-aa14-8ba6a08910d8-kube-api-access-z9c6n\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.194365 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.194372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/722340e1-ea7a-4406-aa14-8ba6a08910d8-tmp\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.194592 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.194402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/722340e1-ea7a-4406-aa14-8ba6a08910d8-tls-certs\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.294919 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.294836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/722340e1-ea7a-4406-aa14-8ba6a08910d8-tls-certs\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.295094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.294919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9c6n\" (UniqueName: \"kubernetes.io/projected/722340e1-ea7a-4406-aa14-8ba6a08910d8-kube-api-access-z9c6n\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.295094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.294949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/722340e1-ea7a-4406-aa14-8ba6a08910d8-tmp\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.297350 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.297318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/722340e1-ea7a-4406-aa14-8ba6a08910d8-tmp\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.297506 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.297488 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/722340e1-ea7a-4406-aa14-8ba6a08910d8-tls-certs\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.307194 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.307166 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9c6n\" (UniqueName: \"kubernetes.io/projected/722340e1-ea7a-4406-aa14-8ba6a08910d8-kube-api-access-z9c6n\") pod \"kube-auth-proxy-7878b9b57-vz6wg\" (UID: \"722340e1-ea7a-4406-aa14-8ba6a08910d8\") " pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.356716 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.356682 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" Sep 10 03:45:16.632281 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:16.632257 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg"] Sep 10 03:45:16.634718 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:45:16.634690 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722340e1_ea7a_4406_aa14_8ba6a08910d8.slice/crio-3a6f284443f01d37a0d874ad6635479cdd95e51953c3c27597482690237dc0ba WatchSource:0}: Error finding container 3a6f284443f01d37a0d874ad6635479cdd95e51953c3c27597482690237dc0ba: Status 404 returned error can't find the container with id 3a6f284443f01d37a0d874ad6635479cdd95e51953c3c27597482690237dc0ba Sep 10 03:45:17.285308 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.285267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" event={"ID":"722340e1-ea7a-4406-aa14-8ba6a08910d8","Type":"ContainerStarted","Data":"3a6f284443f01d37a0d874ad6635479cdd95e51953c3c27597482690237dc0ba"} Sep 10 03:45:17.678051 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.677958 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:17.679765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.679730 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8"] Sep 10 03:45:17.683482 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.683459 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.686807 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.686578 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 03:45:17.686807 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.686620 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 03:45:17.686807 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.686641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 03:45:17.686807 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.686579 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mlw8x\"" Sep 10 03:45:17.687090 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.686903 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 03:45:17.699389 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.698945 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8"] Sep 10 03:45:17.754130 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.754093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:17.809371 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ddf827-9a65-4fe5-a77f-da4459467f0c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.809528 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.809585 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.809636 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.809683 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.809729 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsqvl\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-kube-api-access-jsqvl\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.809911 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.809876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911340 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911516 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911516 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsqvl\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-kube-api-access-jsqvl\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911516 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911516 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ddf827-9a65-4fe5-a77f-da4459467f0c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911516 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.911737 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.911580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.912102 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.912069 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.914389 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.914358 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.914510 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.914486 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.914894 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.914863 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.916252 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.915875 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ddf827-9a65-4fe5-a77f-da4459467f0c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.923177 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.921708 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsqvl\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-kube-api-access-jsqvl\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.925566 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.925193 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tfbm8\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:17.998020 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:17.997985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:18.289528 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:18.289428 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8"] Sep 10 03:45:18.654914 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:18.654826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:19.443743 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:45:19.443705 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ddf827_9a65_4fe5_a77f_da4459467f0c.slice/crio-ac909a106aed95428eb00de45b9902a7221e8912a7f9475c59427081fa10ec6d WatchSource:0}: Error finding container ac909a106aed95428eb00de45b9902a7221e8912a7f9475c59427081fa10ec6d: Status 404 returned error can't find the container with id ac909a106aed95428eb00de45b9902a7221e8912a7f9475c59427081fa10ec6d Sep 10 03:45:20.302048 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:20.302010 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" event={"ID":"16ddf827-9a65-4fe5-a77f-da4459467f0c","Type":"ContainerStarted","Data":"ac909a106aed95428eb00de45b9902a7221e8912a7f9475c59427081fa10ec6d"} Sep 10 03:45:20.303455 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:20.303424 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" event={"ID":"722340e1-ea7a-4406-aa14-8ba6a08910d8","Type":"ContainerStarted","Data":"38c55ad4a47db4bce0dd1da140486783495f56a079d5cae66624c63de2afd83e"} Sep 10 03:45:20.321208 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:20.321145 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7878b9b57-vz6wg" podStartSLOduration=2.459794698 podStartE2EDuration="5.321128624s" totalImagesPullingTime="2.861333926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:20.319907203 +0000 UTC m=+375.124503640" watchObservedRunningTime="2026-09-10 03:45:20.321128624 +0000 UTC m=+375.125725061" Sep 10 03:45:22.476426 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:22.476381 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:45:22.476824 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:22.476456 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:45:23.152070 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.152041 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:23.227702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.227670 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:23.319050 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.319015 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" event={"ID":"16ddf827-9a65-4fe5-a77f-da4459467f0c","Type":"ContainerStarted","Data":"e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe"} Sep 10 03:45:23.319300 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.319279 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:23.320809 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.320786 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-tfbm8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 03:45:23.320888 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.320838 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" podUID="16ddf827-9a65-4fe5-a77f-da4459467f0c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 03:45:23.339194 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.339127 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" podStartSLOduration=3.3093959809999998 podStartE2EDuration="6.339112719s" totalImagesPullingTime="3.029716738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:23.337782909 +0000 UTC m=+378.142379347" watchObservedRunningTime="2026-09-10 03:45:23.339112719 +0000 UTC m=+378.143709157" Sep 10 03:45:23.843912 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:23.843880 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:24.053325 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:24.053291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:24.153849 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:24.153773 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:24.328802 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:24.328769 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:25.086235 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:25.086206 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:25.147744 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:25.147710 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:25.202068 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:25.202038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:26.822675 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:26.822644 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:26.928177 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:26.928130 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:27.028525 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:27.028491 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:27.337020 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:27.336979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:27.812504 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:27.812468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:29.291721 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:29.291683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:29.347420 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:29.347388 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:35.794090 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:35.794053 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:35.915725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:35.915693 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:36.088085 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:36.087965 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:36.218740 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:36.218704 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:36.347733 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:36.347647 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:45:38.075135 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.075094 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8"] Sep 10 03:45:38.075628 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.075355 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" podUID="16ddf827-9a65-4fe5-a77f-da4459467f0c" containerName="discovery" containerID="cri-o://e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe" gracePeriod=30 Sep 10 03:45:38.323311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.323286 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:38.377845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377763 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-token\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.377845 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377799 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-kubeconfig\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.378032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377847 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ddf827-9a65-4fe5-a77f-da4459467f0c-local-certs\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.378032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377872 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-cacerts\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.378032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377920 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-ca-configmap\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.378032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377968 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsqvl\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-kube-api-access-jsqvl\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.378032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.377996 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-dns-cert\") pod \"16ddf827-9a65-4fe5-a77f-da4459467f0c\" (UID: \"16ddf827-9a65-4fe5-a77f-da4459467f0c\") " Sep 10 03:45:38.378484 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.378392 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:45:38.380353 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.380323 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:45:38.380461 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.380395 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ddf827-9a65-4fe5-a77f-da4459467f0c-local-certs" (OuterVolumeSpecName: "local-certs") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:45:38.380526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.380473 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-cacerts" (OuterVolumeSpecName: "cacerts") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:45:38.380526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.380472 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-kube-api-access-jsqvl" (OuterVolumeSpecName: "kube-api-access-jsqvl") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "kube-api-access-jsqvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:45:38.380611 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.380592 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:45:38.380653 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.380602 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "16ddf827-9a65-4fe5-a77f-da4459467f0c" (UID: "16ddf827-9a65-4fe5-a77f-da4459467f0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:45:38.391072 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.391044 2566 generic.go:356] "Generic (PLEG): container finished" podID="16ddf827-9a65-4fe5-a77f-da4459467f0c" containerID="e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe" exitCode=0 Sep 10 03:45:38.391209 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.391091 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" Sep 10 03:45:38.391209 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.391123 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" event={"ID":"16ddf827-9a65-4fe5-a77f-da4459467f0c","Type":"ContainerDied","Data":"e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe"} Sep 10 03:45:38.391289 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.391225 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8" event={"ID":"16ddf827-9a65-4fe5-a77f-da4459467f0c","Type":"ContainerDied","Data":"ac909a106aed95428eb00de45b9902a7221e8912a7f9475c59427081fa10ec6d"} Sep 10 03:45:38.391289 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.391252 2566 scope.go:117] "RemoveContainer" containerID="e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe" Sep 10 03:45:38.399622 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.399603 2566 scope.go:117] "RemoveContainer" containerID="e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe" Sep 10 03:45:38.399878 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:45:38.399860 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe\": container with ID starting with e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe not found: ID does not exist" containerID="e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe" Sep 10 03:45:38.399944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.399886 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe"} err="failed to get container status \"e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe\": rpc error: code = NotFound desc = could not find container \"e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe\": container with ID starting with e02193ac202b6d1cca34b13e38a1bd1232dfaf270ac53a7971a57e7d4dcb2ffe not found: ID does not exist" Sep 10 03:45:38.411926 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.411905 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8"] Sep 10 03:45:38.416036 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.416014 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tfbm8"] Sep 10 03:45:38.478901 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478862 2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-ca-configmap\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:38.478901 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478896 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsqvl\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-kube-api-access-jsqvl\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:38.479088 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478911 2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-csr-dns-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:38.479088 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478925 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-token\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:38.479088 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478936 2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-istio-kubeconfig\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:38.479088 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478947 2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ddf827-9a65-4fe5-a77f-da4459467f0c-local-certs\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:38.479088 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:38.478957 2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16ddf827-9a65-4fe5-a77f-da4459467f0c-cacerts\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:45:39.642870 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:45:39.642837 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ddf827-9a65-4fe5-a77f-da4459467f0c" path="/var/lib/kubelet/pods/16ddf827-9a65-4fe5-a77f-da4459467f0c/volumes" Sep 10 03:46:14.965471 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:14.965410 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:15.065753 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:15.065719 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:16.917521 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:16.917485 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:16.975013 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:16.974983 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:27.844737 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:27.844692 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:27.937180 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:27.937082 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:31.468637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.468603 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6"] Sep 10 03:46:31.469027 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.468889 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ddf827-9a65-4fe5-a77f-da4459467f0c" containerName="discovery" Sep 10 03:46:31.469027 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.468900 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ddf827-9a65-4fe5-a77f-da4459467f0c" containerName="discovery" Sep 10 03:46:31.469027 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.468956 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ddf827-9a65-4fe5-a77f-da4459467f0c" containerName="discovery" Sep 10 03:46:31.471925 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.471909 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.474535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.474510 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:46:31.474535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.474523 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:46:31.475057 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.475042 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zsbrs\"" Sep 10 03:46:31.480760 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.480737 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6"] Sep 10 03:46:31.567244 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.567211 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl"] Sep 10 03:46:31.570859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.570839 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.578291 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.578267 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl"] Sep 10 03:46:31.605197 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.605138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krvzk\" (UniqueName: \"kubernetes.io/projected/9101b95c-04af-45d9-afb3-b859ef4fc7d4-kube-api-access-krvzk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.605362 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.605209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.605362 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.605280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.665311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.665276 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg"] Sep 10 03:46:31.668875 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.668853 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.676369 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.676344 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg"] Sep 10 03:46:31.706741 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.706705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.706949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.706777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.706949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.706834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krvzk\" (UniqueName: \"kubernetes.io/projected/9101b95c-04af-45d9-afb3-b859ef4fc7d4-kube-api-access-krvzk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.706949 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.706909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.707118 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.706949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn2hm\" (UniqueName: \"kubernetes.io/projected/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-kube-api-access-pn2hm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.707118 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.706984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.707394 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.707372 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.707394 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.707387 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.715408 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.715377 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krvzk\" (UniqueName: \"kubernetes.io/projected/9101b95c-04af-45d9-afb3-b859ef4fc7d4-kube-api-access-krvzk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.769279 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.769200 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8"] Sep 10 03:46:31.772668 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.772652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:31.780716 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.780692 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8"] Sep 10 03:46:31.781418 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.781395 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:31.807989 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.807959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn2hm\" (UniqueName: \"kubernetes.io/projected/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-kube-api-access-pn2hm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.808191 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.808191 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.808329 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlsxz\" (UniqueName: \"kubernetes.io/projected/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-kube-api-access-hlsxz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.808329 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.808329 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.808560 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808539 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.808560 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.808548 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.816909 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.816879 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn2hm\" (UniqueName: \"kubernetes.io/projected/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-kube-api-access-pn2hm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.880665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.880619 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:31.908708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.908675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlsxz\" (UniqueName: \"kubernetes.io/projected/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-kube-api-access-hlsxz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.908894 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.908717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:31.908894 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.908760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.908894 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.908819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmf6\" (UniqueName: \"kubernetes.io/projected/2b6c361e-d6e1-4887-85ce-0885289f4c6b-kube-api-access-cgmf6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:31.909051 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.908880 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.909051 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.908918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:31.909251 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.909230 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.909297 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.909234 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.916834 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.916801 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlsxz\" (UniqueName: \"kubernetes.io/projected/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-kube-api-access-hlsxz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:31.978668 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:31.978634 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:32.009558 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.009509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmf6\" (UniqueName: \"kubernetes.io/projected/2b6c361e-d6e1-4887-85ce-0885289f4c6b-kube-api-access-cgmf6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.009558 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.009562 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.009840 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.009606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.010007 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.009988 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.010074 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.010002 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.018906 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.018873 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmf6\" (UniqueName: \"kubernetes.io/projected/2b6c361e-d6e1-4887-85ce-0885289f4c6b-kube-api-access-cgmf6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.055448 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.055418 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6"] Sep 10 03:46:32.057858 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:32.057833 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9101b95c_04af_45d9_afb3_b859ef4fc7d4.slice/crio-4c8ca3e78ccc99ea56b3363b300095cc31725550b09200e1c4db74cf0f33b90a WatchSource:0}: Error finding container 4c8ca3e78ccc99ea56b3363b300095cc31725550b09200e1c4db74cf0f33b90a: Status 404 returned error can't find the container with id 4c8ca3e78ccc99ea56b3363b300095cc31725550b09200e1c4db74cf0f33b90a Sep 10 03:46:32.081937 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.081908 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:32.153870 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.153840 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl"] Sep 10 03:46:32.155341 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:32.155296 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd82fbce_5ee6_4f60_91d7_fd7f94eee9cf.slice/crio-566b3981dc5311ca2a702d18118e03738bd13850da19aff1ea78441eeffadcdb WatchSource:0}: Error finding container 566b3981dc5311ca2a702d18118e03738bd13850da19aff1ea78441eeffadcdb: Status 404 returned error can't find the container with id 566b3981dc5311ca2a702d18118e03738bd13850da19aff1ea78441eeffadcdb Sep 10 03:46:32.264174 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.264131 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg"] Sep 10 03:46:32.265998 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:32.265969 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82349eb1_b8ef_4f6d_a76a_0eceb01b4ad4.slice/crio-138be2982dfb8eee8529e94a74d92254ec83ee1196d2ffcaf6098483d850c930 WatchSource:0}: Error finding container 138be2982dfb8eee8529e94a74d92254ec83ee1196d2ffcaf6098483d850c930: Status 404 returned error can't find the container with id 138be2982dfb8eee8529e94a74d92254ec83ee1196d2ffcaf6098483d850c930 Sep 10 03:46:32.368465 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.368436 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8"] Sep 10 03:46:32.418226 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:32.418188 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6c361e_d6e1_4887_85ce_0885289f4c6b.slice/crio-d5e296abfca5841707361a0aaf9f0eb191af30f9edeb9a4405d347efc7be30d7 WatchSource:0}: Error finding container d5e296abfca5841707361a0aaf9f0eb191af30f9edeb9a4405d347efc7be30d7: Status 404 returned error can't find the container with id d5e296abfca5841707361a0aaf9f0eb191af30f9edeb9a4405d347efc7be30d7 Sep 10 03:46:32.630898 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.630802 2566 generic.go:356] "Generic (PLEG): container finished" podID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerID="e85f844bc8408d9f25595f12a6c718920105ede33a86203d0a6d5b905629ac0a" exitCode=0 Sep 10 03:46:32.631328 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.630899 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" event={"ID":"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf","Type":"ContainerDied","Data":"e85f844bc8408d9f25595f12a6c718920105ede33a86203d0a6d5b905629ac0a"} Sep 10 03:46:32.631328 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.630950 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" event={"ID":"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf","Type":"ContainerStarted","Data":"566b3981dc5311ca2a702d18118e03738bd13850da19aff1ea78441eeffadcdb"} Sep 10 03:46:32.632503 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.632484 2566 generic.go:356] "Generic (PLEG): container finished" podID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerID="d4567f73a6f3996427f94ffd08b2276306e2ad6922af72a91607f5a752eeb39e" exitCode=0 Sep 10 03:46:32.632580 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.632537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" event={"ID":"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4","Type":"ContainerDied","Data":"d4567f73a6f3996427f94ffd08b2276306e2ad6922af72a91607f5a752eeb39e"} Sep 10 03:46:32.632623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.632589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" event={"ID":"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4","Type":"ContainerStarted","Data":"138be2982dfb8eee8529e94a74d92254ec83ee1196d2ffcaf6098483d850c930"} Sep 10 03:46:32.634169 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.634126 2566 generic.go:356] "Generic (PLEG): container finished" podID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerID="0e620fdfc8be1dff88f2a1ebb7fafac6e98d5f7b36106087e237ac456c42d8f0" exitCode=0 Sep 10 03:46:32.634285 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.634230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" event={"ID":"9101b95c-04af-45d9-afb3-b859ef4fc7d4","Type":"ContainerDied","Data":"0e620fdfc8be1dff88f2a1ebb7fafac6e98d5f7b36106087e237ac456c42d8f0"} Sep 10 03:46:32.634285 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.634264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" event={"ID":"9101b95c-04af-45d9-afb3-b859ef4fc7d4","Type":"ContainerStarted","Data":"4c8ca3e78ccc99ea56b3363b300095cc31725550b09200e1c4db74cf0f33b90a"} Sep 10 03:46:32.635904 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.635883 2566 generic.go:356] "Generic (PLEG): container finished" podID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerID="7ec0387d490d3f87d72c12ac5305d026c7bc01d0eff78928bbdfc9ed5bf47db1" exitCode=0 Sep 10 03:46:32.635966 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.635916 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" event={"ID":"2b6c361e-d6e1-4887-85ce-0885289f4c6b","Type":"ContainerDied","Data":"7ec0387d490d3f87d72c12ac5305d026c7bc01d0eff78928bbdfc9ed5bf47db1"} Sep 10 03:46:32.635966 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:32.635949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" event={"ID":"2b6c361e-d6e1-4887-85ce-0885289f4c6b","Type":"ContainerStarted","Data":"d5e296abfca5841707361a0aaf9f0eb191af30f9edeb9a4405d347efc7be30d7"} Sep 10 03:46:34.647665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.647623 2566 generic.go:356] "Generic (PLEG): container finished" podID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerID="50717caddc6111dc3e51c40724e410a015e91cb20402a803d54b9d903ed97de6" exitCode=0 Sep 10 03:46:34.648100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.647715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" event={"ID":"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4","Type":"ContainerDied","Data":"50717caddc6111dc3e51c40724e410a015e91cb20402a803d54b9d903ed97de6"} Sep 10 03:46:34.649714 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.649689 2566 generic.go:356] "Generic (PLEG): container finished" podID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerID="1f3dcd54969e57fa624acb3f46d04c54f564c344faae3248d06c7d6fcb29ca7b" exitCode=0 Sep 10 03:46:34.649799 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.649780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" event={"ID":"9101b95c-04af-45d9-afb3-b859ef4fc7d4","Type":"ContainerDied","Data":"1f3dcd54969e57fa624acb3f46d04c54f564c344faae3248d06c7d6fcb29ca7b"} Sep 10 03:46:34.651760 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.651738 2566 generic.go:356] "Generic (PLEG): container finished" podID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerID="58b0015e7e3fb2dcd2335b52b5cf4bf8f130a454cb34265d7e4ae6801881a80b" exitCode=0 Sep 10 03:46:34.651862 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.651809 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" event={"ID":"2b6c361e-d6e1-4887-85ce-0885289f4c6b","Type":"ContainerDied","Data":"58b0015e7e3fb2dcd2335b52b5cf4bf8f130a454cb34265d7e4ae6801881a80b"} Sep 10 03:46:34.653804 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.653780 2566 generic.go:356] "Generic (PLEG): container finished" podID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerID="fd5f14c96b78562a5b4d8bb5b8c537b4301557cf9dc28bf4cbcb24f5763808b1" exitCode=0 Sep 10 03:46:34.653896 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:34.653850 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" event={"ID":"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf","Type":"ContainerDied","Data":"fd5f14c96b78562a5b4d8bb5b8c537b4301557cf9dc28bf4cbcb24f5763808b1"} Sep 10 03:46:35.660765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.660732 2566 generic.go:356] "Generic (PLEG): container finished" podID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerID="c92c2cb771b0958a6b41b22945f30ea9e3359431029881f87ac740875cefbcf7" exitCode=0 Sep 10 03:46:35.661253 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.660812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" event={"ID":"9101b95c-04af-45d9-afb3-b859ef4fc7d4","Type":"ContainerDied","Data":"c92c2cb771b0958a6b41b22945f30ea9e3359431029881f87ac740875cefbcf7"} Sep 10 03:46:35.663071 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.663041 2566 generic.go:356] "Generic (PLEG): container finished" podID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerID="4d8ef5dd70a70f1a2c0dc8d0087d5197b031dd88b97f7a47c263494013387ed3" exitCode=0 Sep 10 03:46:35.663210 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.663117 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" event={"ID":"2b6c361e-d6e1-4887-85ce-0885289f4c6b","Type":"ContainerDied","Data":"4d8ef5dd70a70f1a2c0dc8d0087d5197b031dd88b97f7a47c263494013387ed3"} Sep 10 03:46:35.665371 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.665346 2566 generic.go:356] "Generic (PLEG): container finished" podID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerID="bee4ab58d2a4aabb03b9074811fa6b997617cf2746651dc1b2d8fafd47a47da9" exitCode=0 Sep 10 03:46:35.665515 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.665420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" event={"ID":"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf","Type":"ContainerDied","Data":"bee4ab58d2a4aabb03b9074811fa6b997617cf2746651dc1b2d8fafd47a47da9"} Sep 10 03:46:35.667665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.667644 2566 generic.go:356] "Generic (PLEG): container finished" podID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerID="3798e53ef73eb03b48d4add591dfdde971b600eb23217bca354a8e3fdcf90541" exitCode=0 Sep 10 03:46:35.667760 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:35.667672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" event={"ID":"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4","Type":"ContainerDied","Data":"3798e53ef73eb03b48d4add591dfdde971b600eb23217bca354a8e3fdcf90541"} Sep 10 03:46:36.807071 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.807044 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:36.844980 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.844947 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:36.849714 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.849688 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-util\") pod \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " Sep 10 03:46:36.849859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.849734 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krvzk\" (UniqueName: \"kubernetes.io/projected/9101b95c-04af-45d9-afb3-b859ef4fc7d4-kube-api-access-krvzk\") pod \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " Sep 10 03:46:36.849859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.849757 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn2hm\" (UniqueName: \"kubernetes.io/projected/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-kube-api-access-pn2hm\") pod \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " Sep 10 03:46:36.849859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.849790 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-util\") pod \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " Sep 10 03:46:36.850031 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.849964 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-bundle\") pod \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\" (UID: \"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf\") " Sep 10 03:46:36.850715 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.850675 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-bundle" (OuterVolumeSpecName: "bundle") pod "bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" (UID: "bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.850968 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.850945 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-bundle\") pod \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\" (UID: \"9101b95c-04af-45d9-afb3-b859ef4fc7d4\") " Sep 10 03:46:36.851266 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.851188 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:36.851693 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.851660 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-bundle" (OuterVolumeSpecName: "bundle") pod "9101b95c-04af-45d9-afb3-b859ef4fc7d4" (UID: "9101b95c-04af-45d9-afb3-b859ef4fc7d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.853030 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.853005 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-kube-api-access-pn2hm" (OuterVolumeSpecName: "kube-api-access-pn2hm") pod "bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" (UID: "bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf"). InnerVolumeSpecName "kube-api-access-pn2hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:46:36.853293 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.853270 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9101b95c-04af-45d9-afb3-b859ef4fc7d4-kube-api-access-krvzk" (OuterVolumeSpecName: "kube-api-access-krvzk") pod "9101b95c-04af-45d9-afb3-b859ef4fc7d4" (UID: "9101b95c-04af-45d9-afb3-b859ef4fc7d4"). InnerVolumeSpecName "kube-api-access-krvzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:46:36.856891 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.856868 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-util" (OuterVolumeSpecName: "util") pod "bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" (UID: "bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.859090 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.859062 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-util" (OuterVolumeSpecName: "util") pod "9101b95c-04af-45d9-afb3-b859ef4fc7d4" (UID: "9101b95c-04af-45d9-afb3-b859ef4fc7d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.871177 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.871134 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:36.873520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.873501 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:36.951410 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951382 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-util\") pod \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " Sep 10 03:46:36.951410 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951414 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-bundle\") pod \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " Sep 10 03:46:36.951645 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951435 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-util\") pod \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " Sep 10 03:46:36.951645 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951462 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgmf6\" (UniqueName: \"kubernetes.io/projected/2b6c361e-d6e1-4887-85ce-0885289f4c6b-kube-api-access-cgmf6\") pod \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\" (UID: \"2b6c361e-d6e1-4887-85ce-0885289f4c6b\") " Sep 10 03:46:36.951645 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951485 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-bundle\") pod \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " Sep 10 03:46:36.951645 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951535 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlsxz\" (UniqueName: \"kubernetes.io/projected/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-kube-api-access-hlsxz\") pod \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\" (UID: \"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4\") " Sep 10 03:46:36.951885 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951700 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:36.951885 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951716 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:36.951885 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951728 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9101b95c-04af-45d9-afb3-b859ef4fc7d4-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:36.951885 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951740 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krvzk\" (UniqueName: \"kubernetes.io/projected/9101b95c-04af-45d9-afb3-b859ef4fc7d4-kube-api-access-krvzk\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:36.951885 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.951756 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn2hm\" (UniqueName: \"kubernetes.io/projected/bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf-kube-api-access-pn2hm\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:36.952287 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.952035 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-bundle" (OuterVolumeSpecName: "bundle") pod "82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" (UID: "82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.952345 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.952265 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-bundle" (OuterVolumeSpecName: "bundle") pod "2b6c361e-d6e1-4887-85ce-0885289f4c6b" (UID: "2b6c361e-d6e1-4887-85ce-0885289f4c6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.953705 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.953676 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-kube-api-access-hlsxz" (OuterVolumeSpecName: "kube-api-access-hlsxz") pod "82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" (UID: "82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4"). InnerVolumeSpecName "kube-api-access-hlsxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:46:36.953930 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.953911 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6c361e-d6e1-4887-85ce-0885289f4c6b-kube-api-access-cgmf6" (OuterVolumeSpecName: "kube-api-access-cgmf6") pod "2b6c361e-d6e1-4887-85ce-0885289f4c6b" (UID: "2b6c361e-d6e1-4887-85ce-0885289f4c6b"). InnerVolumeSpecName "kube-api-access-cgmf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:46:36.957731 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.957691 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-util" (OuterVolumeSpecName: "util") pod "2b6c361e-d6e1-4887-85ce-0885289f4c6b" (UID: "2b6c361e-d6e1-4887-85ce-0885289f4c6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:36.957927 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:36.957905 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-util" (OuterVolumeSpecName: "util") pod "82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" (UID: "82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:46:37.052907 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.052879 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlsxz\" (UniqueName: \"kubernetes.io/projected/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-kube-api-access-hlsxz\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:37.052907 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.052904 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:37.052907 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.052916 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:37.053123 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.052924 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6c361e-d6e1-4887-85ce-0885289f4c6b-util\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:37.053123 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.052933 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgmf6\" (UniqueName: \"kubernetes.io/projected/2b6c361e-d6e1-4887-85ce-0885289f4c6b-kube-api-access-cgmf6\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:37.053123 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.052941 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4-bundle\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:46:37.679176 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.679138 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" Sep 10 03:46:37.679332 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.679175 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847alhhcl" event={"ID":"bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf","Type":"ContainerDied","Data":"566b3981dc5311ca2a702d18118e03738bd13850da19aff1ea78441eeffadcdb"} Sep 10 03:46:37.679332 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.679222 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="566b3981dc5311ca2a702d18118e03738bd13850da19aff1ea78441eeffadcdb" Sep 10 03:46:37.681255 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.681231 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" Sep 10 03:46:37.681255 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.681245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x4flg" event={"ID":"82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4","Type":"ContainerDied","Data":"138be2982dfb8eee8529e94a74d92254ec83ee1196d2ffcaf6098483d850c930"} Sep 10 03:46:37.681428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.681285 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="138be2982dfb8eee8529e94a74d92254ec83ee1196d2ffcaf6098483d850c930" Sep 10 03:46:37.683461 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.683444 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" Sep 10 03:46:37.683461 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.683456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c679rz6" event={"ID":"9101b95c-04af-45d9-afb3-b859ef4fc7d4","Type":"ContainerDied","Data":"4c8ca3e78ccc99ea56b3363b300095cc31725550b09200e1c4db74cf0f33b90a"} Sep 10 03:46:37.683637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.683490 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c8ca3e78ccc99ea56b3363b300095cc31725550b09200e1c4db74cf0f33b90a" Sep 10 03:46:37.685611 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.685588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" event={"ID":"2b6c361e-d6e1-4887-85ce-0885289f4c6b","Type":"ContainerDied","Data":"d5e296abfca5841707361a0aaf9f0eb191af30f9edeb9a4405d347efc7be30d7"} Sep 10 03:46:37.685730 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.685624 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5e296abfca5841707361a0aaf9f0eb191af30f9edeb9a4405d347efc7be30d7" Sep 10 03:46:37.685783 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:37.685727 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn9pb8" Sep 10 03:46:40.216333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:40.216298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:42.050464 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:42.050426 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:44.084689 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084650 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2"] Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084936 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084947 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084959 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="pull" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084964 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="pull" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084975 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084981 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084987 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="extract" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.084993 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="extract" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085001 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="pull" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085006 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="pull" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085012 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085017 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085023 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="pull" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085027 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="pull" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085034 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="extract" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085039 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="extract" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085048 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085053 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="util" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085060 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="extract" Sep 10 03:46:44.085054 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085065 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="extract" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085073 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="pull" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085078 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="pull" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085083 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="extract" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085088 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="extract" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085132 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="82349eb1-b8ef-4f6d-a76a-0eceb01b4ad4" containerName="extract" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085140 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6c361e-d6e1-4887-85ce-0885289f4c6b" containerName="extract" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085148 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd82fbce-5ee6-4f60-91d7-fd7f94eee9cf" containerName="extract" Sep 10 03:46:44.085620 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.085168 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9101b95c-04af-45d9-afb3-b859ef4fc7d4" containerName="extract" Sep 10 03:46:44.089216 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.089195 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:46:44.091884 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.091861 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 03:46:44.091884 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.091879 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2ds69\"" Sep 10 03:46:44.092072 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.091919 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 03:46:44.092072 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.091868 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 03:46:44.100695 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.100671 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2"] Sep 10 03:46:44.104801 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.104775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmsd2\" (UniqueName: \"kubernetes.io/projected/872e7dc9-c09d-4b67-8db2-363e5d629b2d-kube-api-access-zmsd2\") pod \"dns-operator-controller-manager-7b84cd7c9c-tb9z2\" (UID: \"872e7dc9-c09d-4b67-8db2-363e5d629b2d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:46:44.205468 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.205429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmsd2\" (UniqueName: \"kubernetes.io/projected/872e7dc9-c09d-4b67-8db2-363e5d629b2d-kube-api-access-zmsd2\") pod \"dns-operator-controller-manager-7b84cd7c9c-tb9z2\" (UID: \"872e7dc9-c09d-4b67-8db2-363e5d629b2d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:46:44.215109 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.215074 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmsd2\" (UniqueName: \"kubernetes.io/projected/872e7dc9-c09d-4b67-8db2-363e5d629b2d-kube-api-access-zmsd2\") pod \"dns-operator-controller-manager-7b84cd7c9c-tb9z2\" (UID: \"872e7dc9-c09d-4b67-8db2-363e5d629b2d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:46:44.399038 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.399000 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:46:44.632539 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.632449 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:44.678068 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.678042 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2"] Sep 10 03:46:44.680240 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:44.680204 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872e7dc9_c09d_4b67_8db2_363e5d629b2d.slice/crio-64e38533837268fb46e9389d4b58a9150dbec67613fa2b0bdaf9706f80decb36 WatchSource:0}: Error finding container 64e38533837268fb46e9389d4b58a9150dbec67613fa2b0bdaf9706f80decb36: Status 404 returned error can't find the container with id 64e38533837268fb46e9389d4b58a9150dbec67613fa2b0bdaf9706f80decb36 Sep 10 03:46:44.721273 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:44.721240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" event={"ID":"872e7dc9-c09d-4b67-8db2-363e5d629b2d","Type":"ContainerStarted","Data":"64e38533837268fb46e9389d4b58a9150dbec67613fa2b0bdaf9706f80decb36"} Sep 10 03:46:45.032727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:45.032693 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:45.479962 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:45.479923 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:46.756677 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:46.756645 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:48.365400 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.365364 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f"] Sep 10 03:46:48.369970 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.369949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.372080 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.372063 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w7srb\"" Sep 10 03:46:48.379665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.379641 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f"] Sep 10 03:46:48.435916 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.435874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rjps\" (UniqueName: \"kubernetes.io/projected/8d17cd90-a3d0-4824-811a-738ae8f24fde-kube-api-access-2rjps\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.436082 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.435937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d17cd90-a3d0-4824-811a-738ae8f24fde-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.510211 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.510179 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:48.536404 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.536368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rjps\" (UniqueName: \"kubernetes.io/projected/8d17cd90-a3d0-4824-811a-738ae8f24fde-kube-api-access-2rjps\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.536530 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.536413 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d17cd90-a3d0-4824-811a-738ae8f24fde-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.536785 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.536768 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d17cd90-a3d0-4824-811a-738ae8f24fde-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.547194 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.547146 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rjps\" (UniqueName: \"kubernetes.io/projected/8d17cd90-a3d0-4824-811a-738ae8f24fde-kube-api-access-2rjps\") pod \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.647521 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.647440 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:48.681068 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.681037 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:48.955550 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:48.955525 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f"] Sep 10 03:46:48.958462 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:48.958433 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d17cd90_a3d0_4824_811a_738ae8f24fde.slice/crio-f8ce54e57c993144bb1d31511bb8cc99c110f97137d1fb54ce05ae1617389414 WatchSource:0}: Error finding container f8ce54e57c993144bb1d31511bb8cc99c110f97137d1fb54ce05ae1617389414: Status 404 returned error can't find the container with id f8ce54e57c993144bb1d31511bb8cc99c110f97137d1fb54ce05ae1617389414 Sep 10 03:46:49.040390 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:49.040350 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:49.749129 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:49.749092 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" event={"ID":"8d17cd90-a3d0-4824-811a-738ae8f24fde","Type":"ContainerStarted","Data":"f8ce54e57c993144bb1d31511bb8cc99c110f97137d1fb54ce05ae1617389414"} Sep 10 03:46:50.593561 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.592788 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n"] Sep 10 03:46:50.600217 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.600191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:46:50.602969 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.602774 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wscl9\"" Sep 10 03:46:50.608051 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.608018 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n"] Sep 10 03:46:50.636084 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.636051 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:50.653981 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.653877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sm2w\" (UniqueName: \"kubernetes.io/projected/e1f958d5-da05-40eb-aaee-2758f41fab7e-kube-api-access-4sm2w\") pod \"limitador-operator-controller-manager-74495c69f8-n9l4n\" (UID: \"e1f958d5-da05-40eb-aaee-2758f41fab7e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:46:50.754614 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.754496 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sm2w\" (UniqueName: \"kubernetes.io/projected/e1f958d5-da05-40eb-aaee-2758f41fab7e-kube-api-access-4sm2w\") pod \"limitador-operator-controller-manager-74495c69f8-n9l4n\" (UID: \"e1f958d5-da05-40eb-aaee-2758f41fab7e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:46:50.767048 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.767015 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sm2w\" (UniqueName: \"kubernetes.io/projected/e1f958d5-da05-40eb-aaee-2758f41fab7e-kube-api-access-4sm2w\") pod \"limitador-operator-controller-manager-74495c69f8-n9l4n\" (UID: \"e1f958d5-da05-40eb-aaee-2758f41fab7e\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:46:50.916363 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:50.916271 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:46:51.026717 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:51.026668 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:51.295792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:51.295710 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:51.554298 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:51.554274 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n"] Sep 10 03:46:52.774695 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:52.774660 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f958d5_da05_40eb_aaee_2758f41fab7e.slice/crio-df61689efe7655bb39a6e1a431a639087d9486d3babda23aad580433c367ecbb WatchSource:0}: Error finding container df61689efe7655bb39a6e1a431a639087d9486d3babda23aad580433c367ecbb: Status 404 returned error can't find the container with id df61689efe7655bb39a6e1a431a639087d9486d3babda23aad580433c367ecbb Sep 10 03:46:53.129865 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.129773 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7tn7j"] Sep 10 03:46:53.133118 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.133096 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:46:53.135822 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.135797 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-48vxr\"" Sep 10 03:46:53.144102 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.144079 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7tn7j"] Sep 10 03:46:53.177693 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.177659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pcj4\" (UniqueName: \"kubernetes.io/projected/5ac666f2-5166-4e03-97c0-69ee1ed85570-kube-api-access-7pcj4\") pod \"authorino-operator-76b478bd78-7tn7j\" (UID: \"5ac666f2-5166-4e03-97c0-69ee1ed85570\") " pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:46:53.278835 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.278799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pcj4\" (UniqueName: \"kubernetes.io/projected/5ac666f2-5166-4e03-97c0-69ee1ed85570-kube-api-access-7pcj4\") pod \"authorino-operator-76b478bd78-7tn7j\" (UID: \"5ac666f2-5166-4e03-97c0-69ee1ed85570\") " pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:46:53.287295 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.287265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pcj4\" (UniqueName: \"kubernetes.io/projected/5ac666f2-5166-4e03-97c0-69ee1ed85570-kube-api-access-7pcj4\") pod \"authorino-operator-76b478bd78-7tn7j\" (UID: \"5ac666f2-5166-4e03-97c0-69ee1ed85570\") " pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:46:53.443682 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.443653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:46:53.471459 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.471429 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:53.609021 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.608980 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:53.722588 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.722525 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7tn7j"] Sep 10 03:46:53.724639 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:53.724606 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac666f2_5166_4e03_97c0_69ee1ed85570.slice/crio-b1bf0058d1047e0fd7fa71f1f0812ac798323f8de41b5a954df985b281edc762 WatchSource:0}: Error finding container b1bf0058d1047e0fd7fa71f1f0812ac798323f8de41b5a954df985b281edc762: Status 404 returned error can't find the container with id b1bf0058d1047e0fd7fa71f1f0812ac798323f8de41b5a954df985b281edc762 Sep 10 03:46:53.773206 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.773172 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" event={"ID":"5ac666f2-5166-4e03-97c0-69ee1ed85570","Type":"ContainerStarted","Data":"b1bf0058d1047e0fd7fa71f1f0812ac798323f8de41b5a954df985b281edc762"} Sep 10 03:46:53.774549 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.774523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" event={"ID":"e1f958d5-da05-40eb-aaee-2758f41fab7e","Type":"ContainerStarted","Data":"df61689efe7655bb39a6e1a431a639087d9486d3babda23aad580433c367ecbb"} Sep 10 03:46:53.776356 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.776322 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" event={"ID":"8d17cd90-a3d0-4824-811a-738ae8f24fde","Type":"ContainerStarted","Data":"0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b"} Sep 10 03:46:53.776672 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.776411 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:46:53.800353 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:53.800280 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" podStartSLOduration=1.916372086 podStartE2EDuration="5.800255808s" totalImagesPullingTime="3.883883722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:46:53.796850597 +0000 UTC m=+468.601447037" watchObservedRunningTime="2026-09-10 03:46:53.800255808 +0000 UTC m=+468.604852245" Sep 10 03:46:54.649440 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:54.649406 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:54.750494 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:54.750455 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:54.784539 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:54.784501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" event={"ID":"e1f958d5-da05-40eb-aaee-2758f41fab7e","Type":"ContainerStarted","Data":"e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f"} Sep 10 03:46:54.784995 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:54.784710 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:46:54.803934 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:54.803830 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" podStartSLOduration=3.029209785 podStartE2EDuration="4.803813712s" totalImagesPullingTime="1.774603927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:46:54.802339376 +0000 UTC m=+469.606935810" watchObservedRunningTime="2026-09-10 03:46:54.803813712 +0000 UTC m=+469.608410150" Sep 10 03:46:55.791884 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.791834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" event={"ID":"5ac666f2-5166-4e03-97c0-69ee1ed85570","Type":"ContainerStarted","Data":"a58d743ad2ef6bcb88d35bf27b6bfe2e2088f4e0aa2877f1adc497752f7954f8"} Sep 10 03:46:55.792368 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.792064 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:46:55.793654 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.793632 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9"] Sep 10 03:46:55.796963 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.796944 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:55.799275 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.799253 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 03:46:55.799275 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.799269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lk5lq\"" Sep 10 03:46:55.799420 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.799269 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 03:46:55.806772 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.806743 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9"] Sep 10 03:46:55.808960 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.808935 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:55.815997 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.815937 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" podStartSLOduration=1.315337222 podStartE2EDuration="2.815918699s" totalImagesPullingTime="1.500581477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:46:55.815164815 +0000 UTC m=+470.619761246" watchObservedRunningTime="2026-09-10 03:46:55.815918699 +0000 UTC m=+470.620515137" Sep 10 03:46:55.904793 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.904759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7227bac4-7c35-4353-be43-827ef1eb55e2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:55.904793 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.904793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7227bac4-7c35-4353-be43-827ef1eb55e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:55.905017 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.904813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2qt\" (UniqueName: \"kubernetes.io/projected/7227bac4-7c35-4353-be43-827ef1eb55e2-kube-api-access-2r2qt\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:55.934225 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:55.934190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:56.005881 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.005840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7227bac4-7c35-4353-be43-827ef1eb55e2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.005881 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.005878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7227bac4-7c35-4353-be43-827ef1eb55e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.006129 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.005896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2qt\" (UniqueName: \"kubernetes.io/projected/7227bac4-7c35-4353-be43-827ef1eb55e2-kube-api-access-2r2qt\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.006608 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.006584 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7227bac4-7c35-4353-be43-827ef1eb55e2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.008284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.008258 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7227bac4-7c35-4353-be43-827ef1eb55e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.014815 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.014793 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2qt\" (UniqueName: \"kubernetes.io/projected/7227bac4-7c35-4353-be43-827ef1eb55e2-kube-api-access-2r2qt\") pod \"kuadrant-console-plugin-fbdd4f445-85dp9\" (UID: \"7227bac4-7c35-4353-be43-827ef1eb55e2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.106843 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.106762 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" Sep 10 03:46:56.394534 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.394457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9"] Sep 10 03:46:56.397663 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:46:56.397636 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7227bac4_7c35_4353_be43_827ef1eb55e2.slice/crio-49830579e6e69e7cc95e2bad80888e3e2a5953aaf38545779cf362ba5bf22384 WatchSource:0}: Error finding container 49830579e6e69e7cc95e2bad80888e3e2a5953aaf38545779cf362ba5bf22384: Status 404 returned error can't find the container with id 49830579e6e69e7cc95e2bad80888e3e2a5953aaf38545779cf362ba5bf22384 Sep 10 03:46:56.798522 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:56.798488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" event={"ID":"7227bac4-7c35-4353-be43-827ef1eb55e2","Type":"ContainerStarted","Data":"49830579e6e69e7cc95e2bad80888e3e2a5953aaf38545779cf362ba5bf22384"} Sep 10 03:46:59.040822 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:59.040787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:59.427250 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:59.427127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:59.528353 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:59.528112 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:59.830908 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:59.830875 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:46:59.933192 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:46:59.933144 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:00.038736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:00.038702 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:00.099942 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:00.099836 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:01.828971 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:01.828938 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" event={"ID":"7227bac4-7c35-4353-be43-827ef1eb55e2","Type":"ContainerStarted","Data":"4083f4888b0b24a6101639829456fb73c337d62cb357ec110f9bcac15b1d5b2e"} Sep 10 03:47:01.845729 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:01.845676 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-85dp9" podStartSLOduration=2.15149495 podStartE2EDuration="6.845659548s" totalImagesPullingTime="4.694164598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:01.843391072 +0000 UTC m=+476.647987510" watchObservedRunningTime="2026-09-10 03:47:01.845659548 +0000 UTC m=+476.650255985" Sep 10 03:47:04.786986 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:04.786954 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:05.794623 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:05.794587 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:06.261473 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.261431 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:06.364217 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.364170 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:06.554438 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.554356 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt"] Sep 10 03:47:06.559389 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.559367 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.575761 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.575737 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt"] Sep 10 03:47:06.699754 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.699717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb855dc-75b0-4b85-9646-ab17d04f0856-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.699922 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.699810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8wq\" (UniqueName: \"kubernetes.io/projected/3fb855dc-75b0-4b85-9646-ab17d04f0856-kube-api-access-wv8wq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.800459 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.800416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8wq\" (UniqueName: \"kubernetes.io/projected/3fb855dc-75b0-4b85-9646-ab17d04f0856-kube-api-access-wv8wq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.800932 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.800488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb855dc-75b0-4b85-9646-ab17d04f0856-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.800932 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.800884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb855dc-75b0-4b85-9646-ab17d04f0856-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.801027 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.801000 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-7tn7j" Sep 10 03:47:06.813122 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.813047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8wq\" (UniqueName: \"kubernetes.io/projected/3fb855dc-75b0-4b85-9646-ab17d04f0856-kube-api-access-wv8wq\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.868901 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.868874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:06.999866 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:06.999833 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f"] Sep 10 03:47:07.000036 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.000014 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" containerName="manager" containerID="cri-o://0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b" gracePeriod=2 Sep 10 03:47:07.014656 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.014625 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f"] Sep 10 03:47:07.025345 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.025315 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt"] Sep 10 03:47:07.025722 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.025707 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" containerName="manager" Sep 10 03:47:07.025961 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.025725 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" containerName="manager" Sep 10 03:47:07.025961 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.025783 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" containerName="manager" Sep 10 03:47:07.029237 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.029210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.029383 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.029362 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt"] Sep 10 03:47:07.030328 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.030298 2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8d17cd90-a3d0-4824-811a-738ae8f24fde\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-c749f\": pods \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.039448 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.039412 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt"] Sep 10 03:47:07.042562 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.042532 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt"] Sep 10 03:47:07.068818 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.068681 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n"] Sep 10 03:47:07.069219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.069140 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" containerName="manager" containerID="cri-o://e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f" gracePeriod=2 Sep 10 03:47:07.071873 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.071844 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g"] Sep 10 03:47:07.076108 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.076088 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.092737 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.092701 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.096106 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.096074 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.096389 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.096110 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n"] Sep 10 03:47:07.100020 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.099995 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g"] Sep 10 03:47:07.102289 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.102256 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-n9l4n\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:07.102450 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.102294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v6hh\" (UniqueName: \"kubernetes.io/projected/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-kube-api-access-4v6hh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9z5zt\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.102450 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.102335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9z5zt\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.120415 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.120386 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t"] Sep 10 03:47:07.120708 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.120696 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" containerName="manager" Sep 10 03:47:07.120769 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.120709 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" containerName="manager" Sep 10 03:47:07.120811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.120770 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" containerName="manager" Sep 10 03:47:07.123784 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.123764 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:07.135655 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.135623 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t"] Sep 10 03:47:07.140647 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.140611 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.146449 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.146412 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-n9l4n\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:07.203544 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.203504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9z5zt\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.203748 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.203556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2j86\" (UniqueName: \"kubernetes.io/projected/432a0cad-4850-4703-83ae-a2168f599bfe-kube-api-access-h2j86\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tll4g\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.203748 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.203638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432a0cad-4850-4703-83ae-a2168f599bfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tll4g\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.203748 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.203667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2llhx\" (UniqueName: \"kubernetes.io/projected/f43e759f-c919-4c40-9ed0-012860cd88a7-kube-api-access-2llhx\") pod \"limitador-operator-controller-manager-74495c69f8-mrl4t\" (UID: \"f43e759f-c919-4c40-9ed0-012860cd88a7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:07.203918 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.203759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v6hh\" (UniqueName: \"kubernetes.io/projected/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-kube-api-access-4v6hh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9z5zt\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.203975 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.203912 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9z5zt\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.213573 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.212681 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v6hh\" (UniqueName: \"kubernetes.io/projected/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-kube-api-access-4v6hh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9z5zt\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.279343 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.279299 2566 log.go:32] "RunPodSandbox from runtime service failed" err=< Sep 10 03:47:07.279343 ip-10-0-130-142 kubenswrapper[2566]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-lz6kt_kuadrant-system_3fb855dc-75b0-4b85-9646-ab17d04f0856_0(22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-lz6kt to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f" Netns:"/var/run/netns/d1153298-ac81-43f9-ada8-2ae5376cdf64" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-lz6kt;K8S_POD_INFRA_CONTAINER_ID=22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f;K8S_POD_UID=3fb855dc-75b0-4b85-9646-ab17d04f0856" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt/3fb855dc-75b0-4b85-9646-ab17d04f0856:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt 22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:24 [10.133.0.36/23] Sep 10 03:47:07.279343 ip-10-0-130-142 kubenswrapper[2566]: ' Sep 10 03:47:07.279343 ip-10-0-130-142 kubenswrapper[2566]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Sep 10 03:47:07.279343 ip-10-0-130-142 kubenswrapper[2566]: > Sep 10 03:47:07.279661 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.279363 2566 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Sep 10 03:47:07.279661 ip-10-0-130-142 kubenswrapper[2566]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-lz6kt_kuadrant-system_3fb855dc-75b0-4b85-9646-ab17d04f0856_0(22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-lz6kt to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f" Netns:"/var/run/netns/d1153298-ac81-43f9-ada8-2ae5376cdf64" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-lz6kt;K8S_POD_INFRA_CONTAINER_ID=22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f;K8S_POD_UID=3fb855dc-75b0-4b85-9646-ab17d04f0856" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt/3fb855dc-75b0-4b85-9646-ab17d04f0856:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt 22cc55115ec8a6489f292f94e0e39179c83fcb6d7d94fcf2ed92aac4f4d7451f network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:24 [10.133.0.36/23] Sep 10 03:47:07.279661 ip-10-0-130-142 kubenswrapper[2566]: ' Sep 10 03:47:07.279661 ip-10-0-130-142 kubenswrapper[2566]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Sep 10 03:47:07.279661 ip-10-0-130-142 kubenswrapper[2566]: > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:07.297595 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.297576 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.302292 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.302265 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.303736 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.303715 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:07.304230 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.304206 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-n9l4n\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:07.304306 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.304231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432a0cad-4850-4703-83ae-a2168f599bfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tll4g\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.304306 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.304268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2llhx\" (UniqueName: \"kubernetes.io/projected/f43e759f-c919-4c40-9ed0-012860cd88a7-kube-api-access-2llhx\") pod \"limitador-operator-controller-manager-74495c69f8-mrl4t\" (UID: \"f43e759f-c919-4c40-9ed0-012860cd88a7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:07.304385 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.304340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2j86\" (UniqueName: \"kubernetes.io/projected/432a0cad-4850-4703-83ae-a2168f599bfe-kube-api-access-h2j86\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tll4g\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.304609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.304590 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432a0cad-4850-4703-83ae-a2168f599bfe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tll4g\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.309406 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.309381 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-c749f\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.315766 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.315739 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-n9l4n\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:07.324613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.324553 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2llhx\" (UniqueName: \"kubernetes.io/projected/f43e759f-c919-4c40-9ed0-012860cd88a7-kube-api-access-2llhx\") pod \"limitador-operator-controller-manager-74495c69f8-mrl4t\" (UID: \"f43e759f-c919-4c40-9ed0-012860cd88a7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:07.324613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.324594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2j86\" (UniqueName: \"kubernetes.io/projected/432a0cad-4850-4703-83ae-a2168f599bfe-kube-api-access-h2j86\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-tll4g\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.405369 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.405334 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d17cd90-a3d0-4824-811a-738ae8f24fde-extensions-socket-volume\") pod \"8d17cd90-a3d0-4824-811a-738ae8f24fde\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " Sep 10 03:47:07.405528 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.405388 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sm2w\" (UniqueName: \"kubernetes.io/projected/e1f958d5-da05-40eb-aaee-2758f41fab7e-kube-api-access-4sm2w\") pod \"e1f958d5-da05-40eb-aaee-2758f41fab7e\" (UID: \"e1f958d5-da05-40eb-aaee-2758f41fab7e\") " Sep 10 03:47:07.405528 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.405456 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rjps\" (UniqueName: \"kubernetes.io/projected/8d17cd90-a3d0-4824-811a-738ae8f24fde-kube-api-access-2rjps\") pod \"8d17cd90-a3d0-4824-811a-738ae8f24fde\" (UID: \"8d17cd90-a3d0-4824-811a-738ae8f24fde\") " Sep 10 03:47:07.405759 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.405729 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17cd90-a3d0-4824-811a-738ae8f24fde-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d17cd90-a3d0-4824-811a-738ae8f24fde" (UID: "8d17cd90-a3d0-4824-811a-738ae8f24fde"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:47:07.407687 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.407659 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1f958d5-da05-40eb-aaee-2758f41fab7e-kube-api-access-4sm2w" (OuterVolumeSpecName: "kube-api-access-4sm2w") pod "e1f958d5-da05-40eb-aaee-2758f41fab7e" (UID: "e1f958d5-da05-40eb-aaee-2758f41fab7e"). InnerVolumeSpecName "kube-api-access-4sm2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:47:07.407831 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.407697 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d17cd90-a3d0-4824-811a-738ae8f24fde-kube-api-access-2rjps" (OuterVolumeSpecName: "kube-api-access-2rjps") pod "8d17cd90-a3d0-4824-811a-738ae8f24fde" (UID: "8d17cd90-a3d0-4824-811a-738ae8f24fde"). InnerVolumeSpecName "kube-api-access-2rjps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:47:07.439867 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.439837 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.449870 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.449842 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.458041 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.458010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:07.506897 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.506094 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rjps\" (UniqueName: \"kubernetes.io/projected/8d17cd90-a3d0-4824-811a-738ae8f24fde-kube-api-access-2rjps\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:07.506897 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.506120 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d17cd90-a3d0-4824-811a-738ae8f24fde-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:07.506897 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.506131 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sm2w\" (UniqueName: \"kubernetes.io/projected/e1f958d5-da05-40eb-aaee-2758f41fab7e-kube-api-access-4sm2w\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:07.643739 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.643662 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d17cd90-a3d0-4824-811a-738ae8f24fde" path="/var/lib/kubelet/pods/8d17cd90-a3d0-4824-811a-738ae8f24fde/volumes" Sep 10 03:47:07.643978 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.643965 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1f958d5-da05-40eb-aaee-2758f41fab7e" path="/var/lib/kubelet/pods/e1f958d5-da05-40eb-aaee-2758f41fab7e/volumes" Sep 10 03:47:07.727340 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.727313 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt"] Sep 10 03:47:07.729917 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:07.729891 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc149cd7a_d6ea_4ae6_a1c4_e20825f235e2.slice/crio-04c1cef0c1746c7a288cdc669646e50091e9b88fd2691d7ddbd49f6387b579c1 WatchSource:0}: Error finding container 04c1cef0c1746c7a288cdc669646e50091e9b88fd2691d7ddbd49f6387b579c1: Status 404 returned error can't find the container with id 04c1cef0c1746c7a288cdc669646e50091e9b88fd2691d7ddbd49f6387b579c1 Sep 10 03:47:07.746750 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.746626 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g"] Sep 10 03:47:07.749414 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:07.749389 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432a0cad_4850_4703_83ae_a2168f599bfe.slice/crio-fe8b661875ef02ce95e1f72e6c848a46a7fb0d3e904511c98e86490ac49a971a WatchSource:0}: Error finding container fe8b661875ef02ce95e1f72e6c848a46a7fb0d3e904511c98e86490ac49a971a: Status 404 returned error can't find the container with id fe8b661875ef02ce95e1f72e6c848a46a7fb0d3e904511c98e86490ac49a971a Sep 10 03:47:07.756307 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.756244 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t"] Sep 10 03:47:07.758900 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:07.758878 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43e759f_c919_4c40_9ed0_012860cd88a7.slice/crio-2b5f09b1d8b9137b4cb33293c26ffcd72e6d03c159513f8260e997c437564dc4 WatchSource:0}: Error finding container 2b5f09b1d8b9137b4cb33293c26ffcd72e6d03c159513f8260e997c437564dc4: Status 404 returned error can't find the container with id 2b5f09b1d8b9137b4cb33293c26ffcd72e6d03c159513f8260e997c437564dc4 Sep 10 03:47:07.867695 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.867657 2566 generic.go:356] "Generic (PLEG): container finished" podID="e1f958d5-da05-40eb-aaee-2758f41fab7e" containerID="e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f" exitCode=0 Sep 10 03:47:07.868138 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.867711 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-n9l4n" Sep 10 03:47:07.868138 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.867722 2566 scope.go:117] "RemoveContainer" containerID="e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f" Sep 10 03:47:07.869467 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.869438 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d17cd90-a3d0-4824-811a-738ae8f24fde" containerID="0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b" exitCode=0 Sep 10 03:47:07.869906 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.869606 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-c749f" Sep 10 03:47:07.872609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.872298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" event={"ID":"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2","Type":"ContainerStarted","Data":"fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740"} Sep 10 03:47:07.872609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.872351 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" event={"ID":"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2","Type":"ContainerStarted","Data":"04c1cef0c1746c7a288cdc669646e50091e9b88fd2691d7ddbd49f6387b579c1"} Sep 10 03:47:07.872609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.872382 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:07.874614 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.874590 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" event={"ID":"432a0cad-4850-4703-83ae-a2168f599bfe","Type":"ContainerStarted","Data":"80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c"} Sep 10 03:47:07.874709 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.874634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" event={"ID":"432a0cad-4850-4703-83ae-a2168f599bfe","Type":"ContainerStarted","Data":"fe8b661875ef02ce95e1f72e6c848a46a7fb0d3e904511c98e86490ac49a971a"} Sep 10 03:47:07.874709 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.874683 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:07.876491 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.876478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:07.876602 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.876524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" event={"ID":"f43e759f-c919-4c40-9ed0-012860cd88a7","Type":"ContainerStarted","Data":"ffd2aa8b43a13c6ac3c36e01d769107bf1afc7668863cd24676abd1439243bff"} Sep 10 03:47:07.876770 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.876754 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:07.876839 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.876784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" event={"ID":"f43e759f-c919-4c40-9ed0-012860cd88a7","Type":"ContainerStarted","Data":"2b5f09b1d8b9137b4cb33293c26ffcd72e6d03c159513f8260e997c437564dc4"} Sep 10 03:47:07.879485 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.879375 2566 scope.go:117] "RemoveContainer" containerID="e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f" Sep 10 03:47:07.879769 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.879752 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f\": container with ID starting with e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f not found: ID does not exist" containerID="e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f" Sep 10 03:47:07.879847 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.879780 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f"} err="failed to get container status \"e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f\": rpc error: code = NotFound desc = could not find container \"e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f\": container with ID starting with e4dfd14e2defd6871637b65d4c7f64bc8f5a49646599c57015f1d5221633133f not found: ID does not exist" Sep 10 03:47:07.879847 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.879801 2566 scope.go:117] "RemoveContainer" containerID="0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b" Sep 10 03:47:07.885281 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.885260 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:07.887982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.887966 2566 scope.go:117] "RemoveContainer" containerID="0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b" Sep 10 03:47:07.888271 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.888250 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b\": container with ID starting with 0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b not found: ID does not exist" containerID="0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b" Sep 10 03:47:07.888323 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.888277 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b"} err="failed to get container status \"0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b\": rpc error: code = NotFound desc = could not find container \"0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b\": container with ID starting with 0bb31efa748bd83b03648a43bac1e1a61e3a00877557cff3e889a0b449f9f06b not found: ID does not exist" Sep 10 03:47:07.899111 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.899022 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" podStartSLOduration=0.899008289 podStartE2EDuration="899.008289ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:07.89821029 +0000 UTC m=+482.702806729" watchObservedRunningTime="2026-09-10 03:47:07.899008289 +0000 UTC m=+482.703604727" Sep 10 03:47:07.900638 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:07.900610 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="3fb855dc-75b0-4b85-9646-ab17d04f0856" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:07.930592 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.930538 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" podStartSLOduration=0.930522418 podStartE2EDuration="930.522418ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:07.929674862 +0000 UTC m=+482.734271299" watchObservedRunningTime="2026-09-10 03:47:07.930522418 +0000 UTC m=+482.735118857" Sep 10 03:47:07.951116 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:07.951069 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" podStartSLOduration=0.951053114 podStartE2EDuration="951.053114ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:07.949767883 +0000 UTC m=+482.754364311" watchObservedRunningTime="2026-09-10 03:47:07.951053114 +0000 UTC m=+482.755649553" Sep 10 03:47:08.010510 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.010479 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv8wq\" (UniqueName: \"kubernetes.io/projected/3fb855dc-75b0-4b85-9646-ab17d04f0856-kube-api-access-wv8wq\") pod \"3fb855dc-75b0-4b85-9646-ab17d04f0856\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " Sep 10 03:47:08.010680 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.010521 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb855dc-75b0-4b85-9646-ab17d04f0856-extensions-socket-volume\") pod \"3fb855dc-75b0-4b85-9646-ab17d04f0856\" (UID: \"3fb855dc-75b0-4b85-9646-ab17d04f0856\") " Sep 10 03:47:08.010815 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.010788 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb855dc-75b0-4b85-9646-ab17d04f0856-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3fb855dc-75b0-4b85-9646-ab17d04f0856" (UID: "3fb855dc-75b0-4b85-9646-ab17d04f0856"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:47:08.012608 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.012583 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb855dc-75b0-4b85-9646-ab17d04f0856-kube-api-access-wv8wq" (OuterVolumeSpecName: "kube-api-access-wv8wq") pod "3fb855dc-75b0-4b85-9646-ab17d04f0856" (UID: "3fb855dc-75b0-4b85-9646-ab17d04f0856"). InnerVolumeSpecName "kube-api-access-wv8wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:47:08.112203 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.112136 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8wq\" (UniqueName: \"kubernetes.io/projected/3fb855dc-75b0-4b85-9646-ab17d04f0856-kube-api-access-wv8wq\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:08.112203 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.112202 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb855dc-75b0-4b85-9646-ab17d04f0856-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:08.884119 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:08.884090 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:08.886580 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:08.886551 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="3fb855dc-75b0-4b85-9646-ab17d04f0856" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:08.892021 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:08.891995 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-lz6kt\" is forbidden: User \"system:node:ip-10-0-130-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-142.ec2.internal' and this object" podUID="3fb855dc-75b0-4b85-9646-ab17d04f0856" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-lz6kt" Sep 10 03:47:09.649211 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:09.649178 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb855dc-75b0-4b85-9646-ab17d04f0856" path="/var/lib/kubelet/pods/3fb855dc-75b0-4b85-9646-ab17d04f0856/volumes" Sep 10 03:47:11.043014 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:11.042990 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 03:47:11.053271 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:11.053248 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:11.152822 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:11.152786 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:11.904247 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:11.904215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" event={"ID":"872e7dc9-c09d-4b67-8db2-363e5d629b2d","Type":"ContainerStarted","Data":"c884c59b08a1139015567331a2d996a3de9f41f592c327a0c13dfbde9dc60743"} Sep 10 03:47:11.904425 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:11.904339 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:47:11.934206 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:11.934113 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" podStartSLOduration=1.575736163 podStartE2EDuration="27.934091378s" totalImagesPullingTime="26.358355215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:11.932714793 +0000 UTC m=+486.737311231" watchObservedRunningTime="2026-09-10 03:47:11.934091378 +0000 UTC m=+486.738687821" Sep 10 03:47:13.530091 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:13.530060 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:13.630252 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:13.630223 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:18.086808 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.086775 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:18.186637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.186601 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:18.254889 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.254858 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:18.887186 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.887139 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrl4t" Sep 10 03:47:18.887361 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.887307 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:18.887407 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.887377 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:18.991101 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.991070 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt"] Sep 10 03:47:18.991386 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:18.991328 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" podUID="c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" containerName="manager" containerID="cri-o://fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740" gracePeriod=10 Sep 10 03:47:19.236597 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.236572 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:19.314980 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.314943 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-extensions-socket-volume\") pod \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " Sep 10 03:47:19.315176 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.315052 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v6hh\" (UniqueName: \"kubernetes.io/projected/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-kube-api-access-4v6hh\") pod \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\" (UID: \"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2\") " Sep 10 03:47:19.315464 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.315442 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" (UID: "c149cd7a-d6ea-4ae6-a1c4-e20825f235e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:47:19.317226 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.317203 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-kube-api-access-4v6hh" (OuterVolumeSpecName: "kube-api-access-4v6hh") pod "c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" (UID: "c149cd7a-d6ea-4ae6-a1c4-e20825f235e2"). InnerVolumeSpecName "kube-api-access-4v6hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:47:19.416089 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.416014 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:19.416089 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.416042 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v6hh\" (UniqueName: \"kubernetes.io/projected/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2-kube-api-access-4v6hh\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:19.463838 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.463802 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp"] Sep 10 03:47:19.464130 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.464118 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" containerName="manager" Sep 10 03:47:19.464190 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.464131 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" containerName="manager" Sep 10 03:47:19.464227 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.464200 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" containerName="manager" Sep 10 03:47:19.469855 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.469820 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.483185 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.483138 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp"] Sep 10 03:47:19.618102 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.618064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvgs\" (UniqueName: \"kubernetes.io/projected/114e3622-4b8f-4c52-835c-d2bd27803c32-kube-api-access-wtvgs\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d85zp\" (UID: \"114e3622-4b8f-4c52-835c-d2bd27803c32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.618300 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.618108 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/114e3622-4b8f-4c52-835c-d2bd27803c32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d85zp\" (UID: \"114e3622-4b8f-4c52-835c-d2bd27803c32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.719244 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.719205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvgs\" (UniqueName: \"kubernetes.io/projected/114e3622-4b8f-4c52-835c-d2bd27803c32-kube-api-access-wtvgs\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d85zp\" (UID: \"114e3622-4b8f-4c52-835c-d2bd27803c32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.719413 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.719250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/114e3622-4b8f-4c52-835c-d2bd27803c32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d85zp\" (UID: \"114e3622-4b8f-4c52-835c-d2bd27803c32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.719579 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.719564 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/114e3622-4b8f-4c52-835c-d2bd27803c32-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d85zp\" (UID: \"114e3622-4b8f-4c52-835c-d2bd27803c32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.729094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.729067 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvgs\" (UniqueName: \"kubernetes.io/projected/114e3622-4b8f-4c52-835c-d2bd27803c32-kube-api-access-wtvgs\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d85zp\" (UID: \"114e3622-4b8f-4c52-835c-d2bd27803c32\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.780053 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.780016 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:19.958132 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.958098 2566 generic.go:356] "Generic (PLEG): container finished" podID="c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" containerID="fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740" exitCode=0 Sep 10 03:47:19.958333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.958141 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" Sep 10 03:47:19.958333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.958181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" event={"ID":"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2","Type":"ContainerDied","Data":"fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740"} Sep 10 03:47:19.958333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.958232 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt" event={"ID":"c149cd7a-d6ea-4ae6-a1c4-e20825f235e2","Type":"ContainerDied","Data":"04c1cef0c1746c7a288cdc669646e50091e9b88fd2691d7ddbd49f6387b579c1"} Sep 10 03:47:19.958333 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.958254 2566 scope.go:117] "RemoveContainer" containerID="fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740" Sep 10 03:47:19.966605 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.966578 2566 scope.go:117] "RemoveContainer" containerID="fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740" Sep 10 03:47:19.966874 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:19.966854 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740\": container with ID starting with fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740 not found: ID does not exist" containerID="fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740" Sep 10 03:47:19.966972 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.966883 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740"} err="failed to get container status \"fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740\": rpc error: code = NotFound desc = could not find container \"fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740\": container with ID starting with fd1dd0a5cc93c8c617f9e389b7ffda7c8d3696a013a0f5dca84b2cb8616f6740 not found: ID does not exist" Sep 10 03:47:19.976953 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.976892 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt"] Sep 10 03:47:19.993723 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:19.993688 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9z5zt"] Sep 10 03:47:20.054664 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:20.054640 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp"] Sep 10 03:47:20.056746 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:20.056716 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114e3622_4b8f_4c52_835c_d2bd27803c32.slice/crio-1fdb82a3fb268b1b7a0a06a9626abbff96fcc5de693cea58b04e6ea1ef973c33 WatchSource:0}: Error finding container 1fdb82a3fb268b1b7a0a06a9626abbff96fcc5de693cea58b04e6ea1ef973c33: Status 404 returned error can't find the container with id 1fdb82a3fb268b1b7a0a06a9626abbff96fcc5de693cea58b04e6ea1ef973c33 Sep 10 03:47:20.966693 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:20.966661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" event={"ID":"114e3622-4b8f-4c52-835c-d2bd27803c32","Type":"ContainerStarted","Data":"1cdd1887ac05c9ddc2fb0f4047cfea9d73876868dc7a90ee6ee8e1228ea3ca59"} Sep 10 03:47:20.967215 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:20.966720 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" event={"ID":"114e3622-4b8f-4c52-835c-d2bd27803c32","Type":"ContainerStarted","Data":"1fdb82a3fb268b1b7a0a06a9626abbff96fcc5de693cea58b04e6ea1ef973c33"} Sep 10 03:47:20.967215 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:20.966777 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:20.986852 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:20.986802 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" podStartSLOduration=1.986785327 podStartE2EDuration="1.986785327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:20.985237677 +0000 UTC m=+495.789834106" watchObservedRunningTime="2026-09-10 03:47:20.986785327 +0000 UTC m=+495.791381765" Sep 10 03:47:21.642989 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:21.642952 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c149cd7a-d6ea-4ae6-a1c4-e20825f235e2" path="/var/lib/kubelet/pods/c149cd7a-d6ea-4ae6-a1c4-e20825f235e2/volumes" Sep 10 03:47:22.911544 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:22.911517 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tb9z2" Sep 10 03:47:25.132791 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:25.132755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:25.237409 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:25.237378 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:27.667361 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:27.667322 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:29.931431 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:29.931394 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:30.030788 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:30.030692 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:31.974084 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:31.974057 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d85zp" Sep 10 03:47:32.024200 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.024171 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g"] Sep 10 03:47:32.024470 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.024419 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" podUID="432a0cad-4850-4703-83ae-a2168f599bfe" containerName="manager" containerID="cri-o://80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c" gracePeriod=10 Sep 10 03:47:32.260743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.260716 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:32.321944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.321909 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2j86\" (UniqueName: \"kubernetes.io/projected/432a0cad-4850-4703-83ae-a2168f599bfe-kube-api-access-h2j86\") pod \"432a0cad-4850-4703-83ae-a2168f599bfe\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " Sep 10 03:47:32.322142 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.321973 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432a0cad-4850-4703-83ae-a2168f599bfe-extensions-socket-volume\") pod \"432a0cad-4850-4703-83ae-a2168f599bfe\" (UID: \"432a0cad-4850-4703-83ae-a2168f599bfe\") " Sep 10 03:47:32.322373 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.322349 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432a0cad-4850-4703-83ae-a2168f599bfe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "432a0cad-4850-4703-83ae-a2168f599bfe" (UID: "432a0cad-4850-4703-83ae-a2168f599bfe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:47:32.324033 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.324009 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432a0cad-4850-4703-83ae-a2168f599bfe-kube-api-access-h2j86" (OuterVolumeSpecName: "kube-api-access-h2j86") pod "432a0cad-4850-4703-83ae-a2168f599bfe" (UID: "432a0cad-4850-4703-83ae-a2168f599bfe"). InnerVolumeSpecName "kube-api-access-h2j86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:47:32.423219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.423179 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432a0cad-4850-4703-83ae-a2168f599bfe-extensions-socket-volume\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:32.423219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.423210 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2j86\" (UniqueName: \"kubernetes.io/projected/432a0cad-4850-4703-83ae-a2168f599bfe-kube-api-access-h2j86\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:32.619840 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.619737 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:32.720549 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:32.720514 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:33.034826 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.034794 2566 generic.go:356] "Generic (PLEG): container finished" podID="432a0cad-4850-4703-83ae-a2168f599bfe" containerID="80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c" exitCode=0 Sep 10 03:47:33.035311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.034840 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" Sep 10 03:47:33.035311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.034882 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" event={"ID":"432a0cad-4850-4703-83ae-a2168f599bfe","Type":"ContainerDied","Data":"80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c"} Sep 10 03:47:33.035311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.034942 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g" event={"ID":"432a0cad-4850-4703-83ae-a2168f599bfe","Type":"ContainerDied","Data":"fe8b661875ef02ce95e1f72e6c848a46a7fb0d3e904511c98e86490ac49a971a"} Sep 10 03:47:33.035311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.034984 2566 scope.go:117] "RemoveContainer" containerID="80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c" Sep 10 03:47:33.044733 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.044718 2566 scope.go:117] "RemoveContainer" containerID="80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c" Sep 10 03:47:33.045034 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:33.045019 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c\": container with ID starting with 80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c not found: ID does not exist" containerID="80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c" Sep 10 03:47:33.045083 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.045045 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c"} err="failed to get container status \"80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c\": rpc error: code = NotFound desc = could not find container \"80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c\": container with ID starting with 80be3b04d429f539f65e07d19b15d76b34f7ac5eea3d29593c2575e715b7008c not found: ID does not exist" Sep 10 03:47:33.058836 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.058805 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g"] Sep 10 03:47:33.064864 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.064837 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-tll4g"] Sep 10 03:47:33.644271 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:33.644238 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432a0cad-4850-4703-83ae-a2168f599bfe" path="/var/lib/kubelet/pods/432a0cad-4850-4703-83ae-a2168f599bfe/volumes" Sep 10 03:47:35.472714 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.472664 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz"] Sep 10 03:47:35.473136 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.473016 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432a0cad-4850-4703-83ae-a2168f599bfe" containerName="manager" Sep 10 03:47:35.473136 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.473028 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="432a0cad-4850-4703-83ae-a2168f599bfe" containerName="manager" Sep 10 03:47:35.473136 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.473092 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="432a0cad-4850-4703-83ae-a2168f599bfe" containerName="manager" Sep 10 03:47:35.475745 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.475716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.478204 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.478180 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hx865\"" Sep 10 03:47:35.478339 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.478231 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 03:47:35.490104 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.490078 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz"] Sep 10 03:47:35.499575 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.499545 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:35.543047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tv2\" (UniqueName: \"kubernetes.io/projected/978fc35e-174c-4483-9d22-af0144444949-kube-api-access-p5tv2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543047 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978fc35e-174c-4483-9d22-af0144444949-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543080 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978fc35e-174c-4483-9d22-af0144444949-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.543652 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.543336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978fc35e-174c-4483-9d22-af0144444949-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.642080 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.642052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:35.644319 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644301 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644392 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978fc35e-174c-4483-9d22-af0144444949-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644392 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tv2\" (UniqueName: \"kubernetes.io/projected/978fc35e-174c-4483-9d22-af0144444949-kube-api-access-p5tv2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644483 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978fc35e-174c-4483-9d22-af0144444949-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644483 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644483 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644610 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644666 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644722 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978fc35e-174c-4483-9d22-af0144444949-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644815 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644793 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644815 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644807 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.644977 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.645050 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.644988 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.645219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.645199 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978fc35e-174c-4483-9d22-af0144444949-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.646853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.646824 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978fc35e-174c-4483-9d22-af0144444949-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.647094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.647075 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978fc35e-174c-4483-9d22-af0144444949-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.652996 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.652968 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978fc35e-174c-4483-9d22-af0144444949-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.653421 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.653400 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tv2\" (UniqueName: \"kubernetes.io/projected/978fc35e-174c-4483-9d22-af0144444949-kube-api-access-p5tv2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9bpnz\" (UID: \"978fc35e-174c-4483-9d22-af0144444949\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:35.788190 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:35.788078 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:36.069193 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:36.069148 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz"] Sep 10 03:47:36.070835 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:36.070800 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978fc35e_174c_4483_9d22_af0144444949.slice/crio-2177aae078a2bdaa7ff0fda933d337f8c75f9a7b7f29ad31c4477c64392f8dba WatchSource:0}: Error finding container 2177aae078a2bdaa7ff0fda933d337f8c75f9a7b7f29ad31c4477c64392f8dba: Status 404 returned error can't find the container with id 2177aae078a2bdaa7ff0fda933d337f8c75f9a7b7f29ad31c4477c64392f8dba Sep 10 03:47:37.060068 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:37.060028 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" event={"ID":"978fc35e-174c-4483-9d22-af0144444949","Type":"ContainerStarted","Data":"2177aae078a2bdaa7ff0fda933d337f8c75f9a7b7f29ad31c4477c64392f8dba"} Sep 10 03:47:37.933582 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:37.933546 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:38.036574 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:38.036539 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:38.335227 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:38.335191 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:38.396397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:38.396364 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:38.743731 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:38.743696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:38.804424 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:38.804392 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:39.007195 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:39.007131 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:47:39.007369 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:39.007250 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:47:39.007369 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:39.007296 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:47:39.073619 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:39.073581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" event={"ID":"978fc35e-174c-4483-9d22-af0144444949","Type":"ContainerStarted","Data":"c955fb17b69b55c81bf63a28ea0492df67a7f70afc8ffead84da94eaf1107ca1"} Sep 10 03:47:39.094453 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:39.094393 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" podStartSLOduration=1.160449215 podStartE2EDuration="4.094375502s" totalImagesPullingTime="2.933926287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:39.093088317 +0000 UTC m=+513.897684755" watchObservedRunningTime="2026-09-10 03:47:39.094375502 +0000 UTC m=+513.898971940" Sep 10 03:47:39.788963 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:39.788933 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:40.793274 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:40.793246 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:41.083797 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:41.083715 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:41.084905 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:41.084886 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:47:44.943003 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:44.942972 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:45.043364 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:45.043331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:49.743035 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:49.743000 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:49.842838 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:49.842803 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:50.808911 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.808865 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:50.810030 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.810005 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:47:50.813520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.813502 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:50.815786 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.815767 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 03:47:50.821642 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.821616 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:47:50.876511 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.876475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6chkn\" (UniqueName: \"kubernetes.io/projected/2c48848c-d2e3-41ca-8615-4977f3efebae-kube-api-access-6chkn\") pod \"limitador-limitador-8588749977-4jsnc\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:50.876684 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.876621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c48848c-d2e3-41ca-8615-4977f3efebae-config-file\") pod \"limitador-limitador-8588749977-4jsnc\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:50.916019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.915978 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:47:50.919763 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.919727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:50.977393 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.977353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c48848c-d2e3-41ca-8615-4977f3efebae-config-file\") pod \"limitador-limitador-8588749977-4jsnc\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:50.977393 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.977398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6chkn\" (UniqueName: \"kubernetes.io/projected/2c48848c-d2e3-41ca-8615-4977f3efebae-kube-api-access-6chkn\") pod \"limitador-limitador-8588749977-4jsnc\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:50.978006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.977984 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c48848c-d2e3-41ca-8615-4977f3efebae-config-file\") pod \"limitador-limitador-8588749977-4jsnc\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:50.982611 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.982586 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:50.985176 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:50.985134 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6chkn\" (UniqueName: \"kubernetes.io/projected/2c48848c-d2e3-41ca-8615-4977f3efebae-kube-api-access-6chkn\") pod \"limitador-limitador-8588749977-4jsnc\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:51.124411 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.124305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:51.212078 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.212046 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:47:51.216466 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.216444 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.224007 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.223975 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:47:51.258865 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.258832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:47:51.280438 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.280405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpxl\" (UniqueName: \"kubernetes.io/projected/674a52a2-5702-490c-a376-25a5f6316cd0-kube-api-access-fbpxl\") pod \"limitador-limitador-84994f7ffc-5v69j\" (UID: \"674a52a2-5702-490c-a376-25a5f6316cd0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.280603 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.280450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a52a2-5702-490c-a376-25a5f6316cd0-config-file\") pod \"limitador-limitador-84994f7ffc-5v69j\" (UID: \"674a52a2-5702-490c-a376-25a5f6316cd0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.381866 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.381788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpxl\" (UniqueName: \"kubernetes.io/projected/674a52a2-5702-490c-a376-25a5f6316cd0-kube-api-access-fbpxl\") pod \"limitador-limitador-84994f7ffc-5v69j\" (UID: \"674a52a2-5702-490c-a376-25a5f6316cd0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.381866 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.381833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a52a2-5702-490c-a376-25a5f6316cd0-config-file\") pod \"limitador-limitador-84994f7ffc-5v69j\" (UID: \"674a52a2-5702-490c-a376-25a5f6316cd0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.382462 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.382444 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/674a52a2-5702-490c-a376-25a5f6316cd0-config-file\") pod \"limitador-limitador-84994f7ffc-5v69j\" (UID: \"674a52a2-5702-490c-a376-25a5f6316cd0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.389531 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.389505 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpxl\" (UniqueName: \"kubernetes.io/projected/674a52a2-5702-490c-a376-25a5f6316cd0-kube-api-access-fbpxl\") pod \"limitador-limitador-84994f7ffc-5v69j\" (UID: \"674a52a2-5702-490c-a376-25a5f6316cd0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.397417 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.397394 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:47:51.399008 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:51.398984 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c48848c_d2e3_41ca_8615_4977f3efebae.slice/crio-bb325bd7a986d628c06efef8ad9bd67103040cb37f3b000d7af14d966783e6f7 WatchSource:0}: Error finding container bb325bd7a986d628c06efef8ad9bd67103040cb37f3b000d7af14d966783e6f7: Status 404 returned error can't find the container with id bb325bd7a986d628c06efef8ad9bd67103040cb37f3b000d7af14d966783e6f7 Sep 10 03:47:51.528639 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.528599 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:51.615227 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.615194 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df7g2"] Sep 10 03:47:51.619964 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.619937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:51.622392 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.622365 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rhw89\"" Sep 10 03:47:51.624912 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.624868 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df7g2"] Sep 10 03:47:51.649312 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.649241 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:51.685017 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.684984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9n4j\" (UniqueName: \"kubernetes.io/projected/ab0a80dc-ae80-4933-a6b9-699af525c822-kube-api-access-m9n4j\") pod \"authorino-7bcfd8f9cd-df7g2\" (UID: \"ab0a80dc-ae80-4933-a6b9-699af525c822\") " pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:51.734628 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.734595 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:47:51.735875 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.735854 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-hbd9s"] Sep 10 03:47:51.739232 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.739210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:47:51.746772 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.746747 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hbd9s"] Sep 10 03:47:51.786424 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.786395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4w9p\" (UniqueName: \"kubernetes.io/projected/a5bde8ef-2edb-40c5-b801-a0aea05d0a89-kube-api-access-j4w9p\") pod \"authorino-59c974bd48-hbd9s\" (UID: \"a5bde8ef-2edb-40c5-b801-a0aea05d0a89\") " pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:47:51.786600 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.786431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9n4j\" (UniqueName: \"kubernetes.io/projected/ab0a80dc-ae80-4933-a6b9-699af525c822-kube-api-access-m9n4j\") pod \"authorino-7bcfd8f9cd-df7g2\" (UID: \"ab0a80dc-ae80-4933-a6b9-699af525c822\") " pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:51.793803 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.793773 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9n4j\" (UniqueName: \"kubernetes.io/projected/ab0a80dc-ae80-4933-a6b9-699af525c822-kube-api-access-m9n4j\") pod \"authorino-7bcfd8f9cd-df7g2\" (UID: \"ab0a80dc-ae80-4933-a6b9-699af525c822\") " pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:51.800100 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.800064 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:47:51.802918 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:51.802895 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674a52a2_5702_490c_a376_25a5f6316cd0.slice/crio-fecef8287a957583755a60f054670254551665d60984a39ef71d6c16a3fa6c28 WatchSource:0}: Error finding container fecef8287a957583755a60f054670254551665d60984a39ef71d6c16a3fa6c28: Status 404 returned error can't find the container with id fecef8287a957583755a60f054670254551665d60984a39ef71d6c16a3fa6c28 Sep 10 03:47:51.887756 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.887720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4w9p\" (UniqueName: \"kubernetes.io/projected/a5bde8ef-2edb-40c5-b801-a0aea05d0a89-kube-api-access-j4w9p\") pod \"authorino-59c974bd48-hbd9s\" (UID: \"a5bde8ef-2edb-40c5-b801-a0aea05d0a89\") " pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:47:51.896992 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.896961 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4w9p\" (UniqueName: \"kubernetes.io/projected/a5bde8ef-2edb-40c5-b801-a0aea05d0a89-kube-api-access-j4w9p\") pod \"authorino-59c974bd48-hbd9s\" (UID: \"a5bde8ef-2edb-40c5-b801-a0aea05d0a89\") " pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:47:51.931786 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:51.931698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:52.048939 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:52.048911 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:47:52.145284 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:52.145247 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" event={"ID":"2c48848c-d2e3-41ca-8615-4977f3efebae","Type":"ContainerStarted","Data":"bb325bd7a986d628c06efef8ad9bd67103040cb37f3b000d7af14d966783e6f7"} Sep 10 03:47:52.146450 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:52.146428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" event={"ID":"674a52a2-5702-490c-a376-25a5f6316cd0","Type":"ContainerStarted","Data":"fecef8287a957583755a60f054670254551665d60984a39ef71d6c16a3fa6c28"} Sep 10 03:47:52.200997 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:52.200968 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df7g2"] Sep 10 03:47:52.202802 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:52.202772 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab0a80dc_ae80_4933_a6b9_699af525c822.slice/crio-ed1373b2f59143f8aa7b46f1010367946ac4078535924f2a814cadc1a74cd2cf WatchSource:0}: Error finding container ed1373b2f59143f8aa7b46f1010367946ac4078535924f2a814cadc1a74cd2cf: Status 404 returned error can't find the container with id ed1373b2f59143f8aa7b46f1010367946ac4078535924f2a814cadc1a74cd2cf Sep 10 03:47:52.327631 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:52.327595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hbd9s"] Sep 10 03:47:52.329711 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:47:52.329684 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5bde8ef_2edb_40c5_b801_a0aea05d0a89.slice/crio-bf06df63ec5ad579f558fbce3adcbf43b4d150eadf98c3aeb65b87467f1da0ff WatchSource:0}: Error finding container bf06df63ec5ad579f558fbce3adcbf43b4d150eadf98c3aeb65b87467f1da0ff: Status 404 returned error can't find the container with id bf06df63ec5ad579f558fbce3adcbf43b4d150eadf98c3aeb65b87467f1da0ff Sep 10 03:47:53.156035 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.155939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" event={"ID":"ab0a80dc-ae80-4933-a6b9-699af525c822","Type":"ContainerStarted","Data":"ed1373b2f59143f8aa7b46f1010367946ac4078535924f2a814cadc1a74cd2cf"} Sep 10 03:47:53.158656 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.158417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" event={"ID":"2c48848c-d2e3-41ca-8615-4977f3efebae","Type":"ContainerStarted","Data":"7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4"} Sep 10 03:47:53.158656 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.158540 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:47:53.160778 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.160752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hbd9s" event={"ID":"a5bde8ef-2edb-40c5-b801-a0aea05d0a89","Type":"ContainerStarted","Data":"bf06df63ec5ad579f558fbce3adcbf43b4d150eadf98c3aeb65b87467f1da0ff"} Sep 10 03:47:53.163432 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.163393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" event={"ID":"674a52a2-5702-490c-a376-25a5f6316cd0","Type":"ContainerStarted","Data":"9abe6630b742d045be73a0fb51a4e5521d7327c04b33e70aa5130bf84202e70d"} Sep 10 03:47:53.163686 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.163665 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:47:53.177613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.177553 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" podStartSLOduration=1.8579978050000001 podStartE2EDuration="3.177529791s" totalImagesPullingTime="1.319531986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:53.175642035 +0000 UTC m=+527.980238476" watchObservedRunningTime="2026-09-10 03:47:53.177529791 +0000 UTC m=+527.982126232" Sep 10 03:47:53.192852 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:53.192792 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" podStartSLOduration=1.20848827 podStartE2EDuration="2.192769626s" totalImagesPullingTime="984.281356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:53.189565233 +0000 UTC m=+527.994161672" watchObservedRunningTime="2026-09-10 03:47:53.192769626 +0000 UTC m=+527.997366066" Sep 10 03:47:55.178609 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:55.178564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" event={"ID":"ab0a80dc-ae80-4933-a6b9-699af525c822","Type":"ContainerStarted","Data":"2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b"} Sep 10 03:47:55.180106 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:55.180078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hbd9s" event={"ID":"a5bde8ef-2edb-40c5-b801-a0aea05d0a89","Type":"ContainerStarted","Data":"83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a"} Sep 10 03:47:55.198053 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:55.197983 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" podStartSLOduration=2.266047861 podStartE2EDuration="4.197968005s" totalImagesPullingTime="1.931920144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:55.193054049 +0000 UTC m=+529.997650498" watchObservedRunningTime="2026-09-10 03:47:55.197968005 +0000 UTC m=+530.002564477" Sep 10 03:47:55.209269 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:55.209221 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-hbd9s" podStartSLOduration=2.400235538 podStartE2EDuration="4.209206905s" totalImagesPullingTime="1.808971367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:47:55.2081077 +0000 UTC m=+530.012704143" watchObservedRunningTime="2026-09-10 03:47:55.209206905 +0000 UTC m=+530.013803342" Sep 10 03:47:55.231990 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:55.231952 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df7g2"] Sep 10 03:47:57.190853 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:57.190812 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" podUID="ab0a80dc-ae80-4933-a6b9-699af525c822" containerName="authorino" containerID="cri-o://2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b" gracePeriod=30 Sep 10 03:47:57.430106 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:57.430080 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:57.537529 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:57.537439 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9n4j\" (UniqueName: \"kubernetes.io/projected/ab0a80dc-ae80-4933-a6b9-699af525c822-kube-api-access-m9n4j\") pod \"ab0a80dc-ae80-4933-a6b9-699af525c822\" (UID: \"ab0a80dc-ae80-4933-a6b9-699af525c822\") " Sep 10 03:47:57.539513 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:57.539491 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0a80dc-ae80-4933-a6b9-699af525c822-kube-api-access-m9n4j" (OuterVolumeSpecName: "kube-api-access-m9n4j") pod "ab0a80dc-ae80-4933-a6b9-699af525c822" (UID: "ab0a80dc-ae80-4933-a6b9-699af525c822"). InnerVolumeSpecName "kube-api-access-m9n4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:47:57.638895 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:57.638857 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9n4j\" (UniqueName: \"kubernetes.io/projected/ab0a80dc-ae80-4933-a6b9-699af525c822-kube-api-access-m9n4j\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:47:58.197631 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.197597 2566 generic.go:356] "Generic (PLEG): container finished" podID="ab0a80dc-ae80-4933-a6b9-699af525c822" containerID="2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b" exitCode=0 Sep 10 03:47:58.198032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.197637 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" Sep 10 03:47:58.198032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.197660 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" event={"ID":"ab0a80dc-ae80-4933-a6b9-699af525c822","Type":"ContainerDied","Data":"2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b"} Sep 10 03:47:58.198032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.197689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df7g2" event={"ID":"ab0a80dc-ae80-4933-a6b9-699af525c822","Type":"ContainerDied","Data":"ed1373b2f59143f8aa7b46f1010367946ac4078535924f2a814cadc1a74cd2cf"} Sep 10 03:47:58.198032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.197706 2566 scope.go:117] "RemoveContainer" containerID="2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b" Sep 10 03:47:58.206134 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.206117 2566 scope.go:117] "RemoveContainer" containerID="2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b" Sep 10 03:47:58.206449 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:47:58.206429 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b\": container with ID starting with 2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b not found: ID does not exist" containerID="2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b" Sep 10 03:47:58.206539 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.206461 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b"} err="failed to get container status \"2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b\": rpc error: code = NotFound desc = could not find container \"2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b\": container with ID starting with 2e1dead9aafa9f51a7ffb14a703dc704445850f5bca42f21753808dcd3db028b not found: ID does not exist" Sep 10 03:47:58.216162 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.216125 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df7g2"] Sep 10 03:47:58.225464 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:58.221072 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df7g2"] Sep 10 03:47:59.643831 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:47:59.643793 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0a80dc-ae80-4933-a6b9-699af525c822" path="/var/lib/kubelet/pods/ab0a80dc-ae80-4933-a6b9-699af525c822/volumes" Sep 10 03:48:04.173376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.173344 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5v69j" Sep 10 03:48:04.173868 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.173698 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:48:04.233377 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.233336 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:48:04.233613 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.233570 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" podUID="2c48848c-d2e3-41ca-8615-4977f3efebae" containerName="limitador" containerID="cri-o://7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4" gracePeriod=30 Sep 10 03:48:04.783480 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.783456 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:48:04.901737 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.901650 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c48848c-d2e3-41ca-8615-4977f3efebae-config-file\") pod \"2c48848c-d2e3-41ca-8615-4977f3efebae\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " Sep 10 03:48:04.901737 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.901695 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6chkn\" (UniqueName: \"kubernetes.io/projected/2c48848c-d2e3-41ca-8615-4977f3efebae-kube-api-access-6chkn\") pod \"2c48848c-d2e3-41ca-8615-4977f3efebae\" (UID: \"2c48848c-d2e3-41ca-8615-4977f3efebae\") " Sep 10 03:48:04.902022 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.901995 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c48848c-d2e3-41ca-8615-4977f3efebae-config-file" (OuterVolumeSpecName: "config-file") pod "2c48848c-d2e3-41ca-8615-4977f3efebae" (UID: "2c48848c-d2e3-41ca-8615-4977f3efebae"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:48:04.903811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:04.903786 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c48848c-d2e3-41ca-8615-4977f3efebae-kube-api-access-6chkn" (OuterVolumeSpecName: "kube-api-access-6chkn") pod "2c48848c-d2e3-41ca-8615-4977f3efebae" (UID: "2c48848c-d2e3-41ca-8615-4977f3efebae"). InnerVolumeSpecName "kube-api-access-6chkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:48:05.003079 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.003039 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c48848c-d2e3-41ca-8615-4977f3efebae-config-file\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:48:05.003079 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.003075 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6chkn\" (UniqueName: \"kubernetes.io/projected/2c48848c-d2e3-41ca-8615-4977f3efebae-kube-api-access-6chkn\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:48:05.237790 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.237754 2566 generic.go:356] "Generic (PLEG): container finished" podID="2c48848c-d2e3-41ca-8615-4977f3efebae" containerID="7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4" exitCode=0 Sep 10 03:48:05.238205 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.237803 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" Sep 10 03:48:05.238205 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.237841 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" event={"ID":"2c48848c-d2e3-41ca-8615-4977f3efebae","Type":"ContainerDied","Data":"7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4"} Sep 10 03:48:05.238205 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.237899 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4jsnc" event={"ID":"2c48848c-d2e3-41ca-8615-4977f3efebae","Type":"ContainerDied","Data":"bb325bd7a986d628c06efef8ad9bd67103040cb37f3b000d7af14d966783e6f7"} Sep 10 03:48:05.238205 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.237922 2566 scope.go:117] "RemoveContainer" containerID="7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4" Sep 10 03:48:05.247350 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.247331 2566 scope.go:117] "RemoveContainer" containerID="7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4" Sep 10 03:48:05.247634 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:48:05.247615 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4\": container with ID starting with 7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4 not found: ID does not exist" containerID="7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4" Sep 10 03:48:05.247679 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.247644 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4"} err="failed to get container status \"7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4\": rpc error: code = NotFound desc = could not find container \"7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4\": container with ID starting with 7e6e5b2f2fe6ca330b8cf55d6958ad6690327c1cf20eb88425a30ed8de135df4 not found: ID does not exist" Sep 10 03:48:05.259481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.259453 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:48:05.262577 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.262552 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4jsnc"] Sep 10 03:48:05.643538 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:05.643512 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c48848c-d2e3-41ca-8615-4977f3efebae" path="/var/lib/kubelet/pods/2c48848c-d2e3-41ca-8615-4977f3efebae/volumes" Sep 10 03:48:06.582753 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:06.582690 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:06.686824 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:06.686789 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:07.029302 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029269 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-59zhg"] Sep 10 03:48:07.029846 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029821 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c48848c-d2e3-41ca-8615-4977f3efebae" containerName="limitador" Sep 10 03:48:07.029846 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029848 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c48848c-d2e3-41ca-8615-4977f3efebae" containerName="limitador" Sep 10 03:48:07.030005 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029864 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0a80dc-ae80-4933-a6b9-699af525c822" containerName="authorino" Sep 10 03:48:07.030005 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029872 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0a80dc-ae80-4933-a6b9-699af525c822" containerName="authorino" Sep 10 03:48:07.030005 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029955 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0a80dc-ae80-4933-a6b9-699af525c822" containerName="authorino" Sep 10 03:48:07.030005 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.029965 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c48848c-d2e3-41ca-8615-4977f3efebae" containerName="limitador" Sep 10 03:48:07.034406 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.034386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.036821 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.036793 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 03:48:07.036934 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.036844 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 03:48:07.037538 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.037519 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mjmrj\"" Sep 10 03:48:07.037645 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.037528 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 03:48:07.044640 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.044613 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-59zhg"] Sep 10 03:48:07.066583 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.066552 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:07.119484 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.119452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxd5k\" (UniqueName: \"kubernetes.io/projected/4cda93f3-adea-477e-931e-72deb6dfbb24-kube-api-access-pxd5k\") pod \"postgres-69fb4594cf-59zhg\" (UID: \"4cda93f3-adea-477e-931e-72deb6dfbb24\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.119664 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.119497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4cda93f3-adea-477e-931e-72deb6dfbb24-data\") pod \"postgres-69fb4594cf-59zhg\" (UID: \"4cda93f3-adea-477e-931e-72deb6dfbb24\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.220878 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.220839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxd5k\" (UniqueName: \"kubernetes.io/projected/4cda93f3-adea-477e-931e-72deb6dfbb24-kube-api-access-pxd5k\") pod \"postgres-69fb4594cf-59zhg\" (UID: \"4cda93f3-adea-477e-931e-72deb6dfbb24\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.221025 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.220886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4cda93f3-adea-477e-931e-72deb6dfbb24-data\") pod \"postgres-69fb4594cf-59zhg\" (UID: \"4cda93f3-adea-477e-931e-72deb6dfbb24\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.221276 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.221260 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4cda93f3-adea-477e-931e-72deb6dfbb24-data\") pod \"postgres-69fb4594cf-59zhg\" (UID: \"4cda93f3-adea-477e-931e-72deb6dfbb24\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.229056 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.229026 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxd5k\" (UniqueName: \"kubernetes.io/projected/4cda93f3-adea-477e-931e-72deb6dfbb24-kube-api-access-pxd5k\") pod \"postgres-69fb4594cf-59zhg\" (UID: \"4cda93f3-adea-477e-931e-72deb6dfbb24\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.346974 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.346888 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:07.617381 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:07.617350 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-59zhg"] Sep 10 03:48:07.619466 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:48:07.619437 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cda93f3_adea_477e_931e_72deb6dfbb24.slice/crio-e16aef119d18ae9192d0ca46b9859cf6f333e924973231714423675423c77e20 WatchSource:0}: Error finding container e16aef119d18ae9192d0ca46b9859cf6f333e924973231714423675423c77e20: Status 404 returned error can't find the container with id e16aef119d18ae9192d0ca46b9859cf6f333e924973231714423675423c77e20 Sep 10 03:48:08.254168 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:08.254126 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" event={"ID":"4cda93f3-adea-477e-931e-72deb6dfbb24","Type":"ContainerStarted","Data":"e16aef119d18ae9192d0ca46b9859cf6f333e924973231714423675423c77e20"} Sep 10 03:48:10.267549 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:10.267460 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" event={"ID":"4cda93f3-adea-477e-931e-72deb6dfbb24","Type":"ContainerStarted","Data":"4d8a777acb991778fc937a37969d1c7fa44a8ff4611cf4ceb3e8240b35bf6683"} Sep 10 03:48:10.267549 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:10.267523 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:10.284353 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:10.284297 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" podStartSLOduration=0.946543483 podStartE2EDuration="3.284279266s" totalImagesPullingTime="2.337735783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:10.282331023 +0000 UTC m=+545.086927459" watchObservedRunningTime="2026-09-10 03:48:10.284279266 +0000 UTC m=+545.088875744" Sep 10 03:48:16.302725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.302696 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-59zhg" Sep 10 03:48:16.620086 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.619995 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:16.720441 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.720388 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:16.865584 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.865549 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-rf2wm"] Sep 10 03:48:16.874189 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.874092 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:16.876225 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.876202 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-rf2wm"] Sep 10 03:48:16.930039 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.930005 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rf2wm"] Sep 10 03:48:16.930308 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:48:16.930286 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2jrhh], unattached volumes=[], failed to process volumes=[kube-api-access-2jrhh]: context canceled" pod="kuadrant-system/authorino-557f876f69-rf2wm" podUID="5e76ee98-8735-4a7f-bb0e-0f645d924f7e" Sep 10 03:48:16.959899 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.959863 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9nx6t"] Sep 10 03:48:16.963678 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.963658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:16.965814 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.965792 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 03:48:16.968964 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:16.968940 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9nx6t"] Sep 10 03:48:17.008002 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.007963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrhh\" (UniqueName: \"kubernetes.io/projected/5e76ee98-8735-4a7f-bb0e-0f645d924f7e-kube-api-access-2jrhh\") pod \"authorino-557f876f69-rf2wm\" (UID: \"5e76ee98-8735-4a7f-bb0e-0f645d924f7e\") " pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:17.108438 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.108398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qb7p\" (UniqueName: \"kubernetes.io/projected/71b9c830-108b-4464-8233-09ebb4486440-kube-api-access-7qb7p\") pod \"authorino-6d4dfc649f-9nx6t\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.108618 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.108477 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrhh\" (UniqueName: \"kubernetes.io/projected/5e76ee98-8735-4a7f-bb0e-0f645d924f7e-kube-api-access-2jrhh\") pod \"authorino-557f876f69-rf2wm\" (UID: \"5e76ee98-8735-4a7f-bb0e-0f645d924f7e\") " pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:17.108618 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.108508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b9c830-108b-4464-8233-09ebb4486440-tls-cert\") pod \"authorino-6d4dfc649f-9nx6t\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.119598 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.119564 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrhh\" (UniqueName: \"kubernetes.io/projected/5e76ee98-8735-4a7f-bb0e-0f645d924f7e-kube-api-access-2jrhh\") pod \"authorino-557f876f69-rf2wm\" (UID: \"5e76ee98-8735-4a7f-bb0e-0f645d924f7e\") " pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:17.133590 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.133514 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9nx6t"] Sep 10 03:48:17.133777 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:48:17.133760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7qb7p tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" podUID="71b9c830-108b-4464-8233-09ebb4486440" Sep 10 03:48:17.162392 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.162360 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65d7f67f85-x5lqb"] Sep 10 03:48:17.166193 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.166163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.175477 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.175449 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65d7f67f85-x5lqb"] Sep 10 03:48:17.209859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.209820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b9c830-108b-4464-8233-09ebb4486440-tls-cert\") pod \"authorino-6d4dfc649f-9nx6t\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.209859 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.209865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qb7p\" (UniqueName: \"kubernetes.io/projected/71b9c830-108b-4464-8233-09ebb4486440-kube-api-access-7qb7p\") pod \"authorino-6d4dfc649f-9nx6t\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.212273 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.212255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b9c830-108b-4464-8233-09ebb4486440-tls-cert\") pod \"authorino-6d4dfc649f-9nx6t\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.219521 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.219497 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qb7p\" (UniqueName: \"kubernetes.io/projected/71b9c830-108b-4464-8233-09ebb4486440-kube-api-access-7qb7p\") pod \"authorino-6d4dfc649f-9nx6t\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.304727 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.304691 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.305186 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.304691 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:17.310387 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.310354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kgtr\" (UniqueName: \"kubernetes.io/projected/3553c142-4715-4008-b3de-6424741b522a-kube-api-access-5kgtr\") pod \"authorino-65d7f67f85-x5lqb\" (UID: \"3553c142-4715-4008-b3de-6424741b522a\") " pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.310635 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.310467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3553c142-4715-4008-b3de-6424741b522a-tls-cert\") pod \"authorino-65d7f67f85-x5lqb\" (UID: \"3553c142-4715-4008-b3de-6424741b522a\") " pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.313069 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.313050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:17.315903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.315884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:17.411448 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.411336 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qb7p\" (UniqueName: \"kubernetes.io/projected/71b9c830-108b-4464-8233-09ebb4486440-kube-api-access-7qb7p\") pod \"71b9c830-108b-4464-8233-09ebb4486440\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " Sep 10 03:48:17.411448 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.411384 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrhh\" (UniqueName: \"kubernetes.io/projected/5e76ee98-8735-4a7f-bb0e-0f645d924f7e-kube-api-access-2jrhh\") pod \"5e76ee98-8735-4a7f-bb0e-0f645d924f7e\" (UID: \"5e76ee98-8735-4a7f-bb0e-0f645d924f7e\") " Sep 10 03:48:17.411448 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.411423 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b9c830-108b-4464-8233-09ebb4486440-tls-cert\") pod \"71b9c830-108b-4464-8233-09ebb4486440\" (UID: \"71b9c830-108b-4464-8233-09ebb4486440\") " Sep 10 03:48:17.411697 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.411597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3553c142-4715-4008-b3de-6424741b522a-tls-cert\") pod \"authorino-65d7f67f85-x5lqb\" (UID: \"3553c142-4715-4008-b3de-6424741b522a\") " pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.411743 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.411717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kgtr\" (UniqueName: \"kubernetes.io/projected/3553c142-4715-4008-b3de-6424741b522a-kube-api-access-5kgtr\") pod \"authorino-65d7f67f85-x5lqb\" (UID: \"3553c142-4715-4008-b3de-6424741b522a\") " pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.413577 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.413539 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b9c830-108b-4464-8233-09ebb4486440-kube-api-access-7qb7p" (OuterVolumeSpecName: "kube-api-access-7qb7p") pod "71b9c830-108b-4464-8233-09ebb4486440" (UID: "71b9c830-108b-4464-8233-09ebb4486440"). InnerVolumeSpecName "kube-api-access-7qb7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:48:17.413577 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.413548 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b9c830-108b-4464-8233-09ebb4486440-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "71b9c830-108b-4464-8233-09ebb4486440" (UID: "71b9c830-108b-4464-8233-09ebb4486440"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:48:17.413577 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.413573 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e76ee98-8735-4a7f-bb0e-0f645d924f7e-kube-api-access-2jrhh" (OuterVolumeSpecName: "kube-api-access-2jrhh") pod "5e76ee98-8735-4a7f-bb0e-0f645d924f7e" (UID: "5e76ee98-8735-4a7f-bb0e-0f645d924f7e"). InnerVolumeSpecName "kube-api-access-2jrhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:48:17.414122 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.414103 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3553c142-4715-4008-b3de-6424741b522a-tls-cert\") pod \"authorino-65d7f67f85-x5lqb\" (UID: \"3553c142-4715-4008-b3de-6424741b522a\") " pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.421846 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.421822 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kgtr\" (UniqueName: \"kubernetes.io/projected/3553c142-4715-4008-b3de-6424741b522a-kube-api-access-5kgtr\") pod \"authorino-65d7f67f85-x5lqb\" (UID: \"3553c142-4715-4008-b3de-6424741b522a\") " pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.477199 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.477133 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d7f67f85-x5lqb" Sep 10 03:48:17.513168 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.513122 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qb7p\" (UniqueName: \"kubernetes.io/projected/71b9c830-108b-4464-8233-09ebb4486440-kube-api-access-7qb7p\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:48:17.513324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.513177 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrhh\" (UniqueName: \"kubernetes.io/projected/5e76ee98-8735-4a7f-bb0e-0f645d924f7e-kube-api-access-2jrhh\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:48:17.513324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.513194 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b9c830-108b-4464-8233-09ebb4486440-tls-cert\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:48:17.746662 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:17.746636 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65d7f67f85-x5lqb"] Sep 10 03:48:17.748236 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:48:17.748206 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3553c142_4715_4008_b3de_6424741b522a.slice/crio-480b2146f25b834f28cfd384df80e33c8a785a96973a1c645236898d8f2bd59b WatchSource:0}: Error finding container 480b2146f25b834f28cfd384df80e33c8a785a96973a1c645236898d8f2bd59b: Status 404 returned error can't find the container with id 480b2146f25b834f28cfd384df80e33c8a785a96973a1c645236898d8f2bd59b Sep 10 03:48:18.315809 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.315776 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d7f67f85-x5lqb" event={"ID":"3553c142-4715-4008-b3de-6424741b522a","Type":"ContainerStarted","Data":"100f9bf512d2056008e5c71f96bc39db97225e9d303eb6c76d59ce401e035c38"} Sep 10 03:48:18.315809 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.315820 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d7f67f85-x5lqb" event={"ID":"3553c142-4715-4008-b3de-6424741b522a","Type":"ContainerStarted","Data":"480b2146f25b834f28cfd384df80e33c8a785a96973a1c645236898d8f2bd59b"} Sep 10 03:48:18.316376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.315931 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rf2wm" Sep 10 03:48:18.316376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.315942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9nx6t" Sep 10 03:48:18.333048 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.332990 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65d7f67f85-x5lqb" podStartSLOduration=0.871878348 podStartE2EDuration="1.332970563s" totalImagesPullingTime="461.092215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:18.330780878 +0000 UTC m=+553.135377320" watchObservedRunningTime="2026-09-10 03:48:18.332970563 +0000 UTC m=+553.137567003" Sep 10 03:48:18.359711 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.359677 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rf2wm"] Sep 10 03:48:18.365187 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.365141 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hbd9s"] Sep 10 03:48:18.365372 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.365346 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-hbd9s" podUID="a5bde8ef-2edb-40c5-b801-a0aea05d0a89" containerName="authorino" containerID="cri-o://83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a" gracePeriod=30 Sep 10 03:48:18.369754 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.369718 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-rf2wm"] Sep 10 03:48:18.386146 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.386118 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9nx6t"] Sep 10 03:48:18.392786 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.392756 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9nx6t"] Sep 10 03:48:18.591470 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.591439 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:48:18.720964 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.720929 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4w9p\" (UniqueName: \"kubernetes.io/projected/a5bde8ef-2edb-40c5-b801-a0aea05d0a89-kube-api-access-j4w9p\") pod \"a5bde8ef-2edb-40c5-b801-a0aea05d0a89\" (UID: \"a5bde8ef-2edb-40c5-b801-a0aea05d0a89\") " Sep 10 03:48:18.722992 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.722964 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5bde8ef-2edb-40c5-b801-a0aea05d0a89-kube-api-access-j4w9p" (OuterVolumeSpecName: "kube-api-access-j4w9p") pod "a5bde8ef-2edb-40c5-b801-a0aea05d0a89" (UID: "a5bde8ef-2edb-40c5-b801-a0aea05d0a89"). InnerVolumeSpecName "kube-api-access-j4w9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:48:18.821979 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:18.821888 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4w9p\" (UniqueName: \"kubernetes.io/projected/a5bde8ef-2edb-40c5-b801-a0aea05d0a89-kube-api-access-j4w9p\") on node \"ip-10-0-130-142.ec2.internal\" DevicePath \"\"" Sep 10 03:48:19.321980 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.321946 2566 generic.go:356] "Generic (PLEG): container finished" podID="a5bde8ef-2edb-40c5-b801-a0aea05d0a89" containerID="83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a" exitCode=0 Sep 10 03:48:19.322434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.321992 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-hbd9s" Sep 10 03:48:19.322434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.322027 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hbd9s" event={"ID":"a5bde8ef-2edb-40c5-b801-a0aea05d0a89","Type":"ContainerDied","Data":"83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a"} Sep 10 03:48:19.322434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.322066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-hbd9s" event={"ID":"a5bde8ef-2edb-40c5-b801-a0aea05d0a89","Type":"ContainerDied","Data":"bf06df63ec5ad579f558fbce3adcbf43b4d150eadf98c3aeb65b87467f1da0ff"} Sep 10 03:48:19.322434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.322084 2566 scope.go:117] "RemoveContainer" containerID="83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a" Sep 10 03:48:19.331381 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.331363 2566 scope.go:117] "RemoveContainer" containerID="83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a" Sep 10 03:48:19.331684 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:48:19.331664 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a\": container with ID starting with 83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a not found: ID does not exist" containerID="83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a" Sep 10 03:48:19.331749 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.331697 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a"} err="failed to get container status \"83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a\": rpc error: code = NotFound desc = could not find container \"83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a\": container with ID starting with 83eb5920a934e457e8fdd6938602a519c8323e3ea6f7e561147a458a9c39352a not found: ID does not exist" Sep 10 03:48:19.343643 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.343617 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hbd9s"] Sep 10 03:48:19.347590 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.347564 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-hbd9s"] Sep 10 03:48:19.643631 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.643598 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e76ee98-8735-4a7f-bb0e-0f645d924f7e" path="/var/lib/kubelet/pods/5e76ee98-8735-4a7f-bb0e-0f645d924f7e/volumes" Sep 10 03:48:19.643851 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.643839 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b9c830-108b-4464-8233-09ebb4486440" path="/var/lib/kubelet/pods/71b9c830-108b-4464-8233-09ebb4486440/volumes" Sep 10 03:48:19.644034 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:19.644024 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5bde8ef-2edb-40c5-b801-a0aea05d0a89" path="/var/lib/kubelet/pods/a5bde8ef-2edb-40c5-b801-a0aea05d0a89/volumes" Sep 10 03:48:23.277529 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:23.277485 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:23.375752 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:23.375712 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:23.429714 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:23.429682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:23.743217 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:23.743186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:27.002648 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:27.002607 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:27.102754 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:27.102694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:30.710068 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:30.710036 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:48:58.741193 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:48:58.741132 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:00.200313 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.200262 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:00.300977 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.300924 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:00.555214 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.555112 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:00.720217 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.720171 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:00.813181 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.813040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:00.818019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.817986 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6"] Sep 10 03:49:00.818414 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.818388 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5bde8ef-2edb-40c5-b801-a0aea05d0a89" containerName="authorino" Sep 10 03:49:00.818414 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.818412 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5bde8ef-2edb-40c5-b801-a0aea05d0a89" containerName="authorino" Sep 10 03:49:00.818628 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.818520 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5bde8ef-2edb-40c5-b801-a0aea05d0a89" containerName="authorino" Sep 10 03:49:00.821573 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.821556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:00.823860 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.823843 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 03:49:00.835894 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.835863 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6"] Sep 10 03:49:00.867792 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.867757 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vkn2t"] Sep 10 03:49:00.871098 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.871081 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:00.873548 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.873528 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mpzrw\"" Sep 10 03:49:00.883857 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.883831 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vkn2t"] Sep 10 03:49:00.885347 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.885320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16c84472-ae2b-4b10-862c-7664b328a1a4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-k8dt6\" (UID: \"16c84472-ae2b-4b10-862c-7664b328a1a4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:00.885459 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.885404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8c2\" (UniqueName: \"kubernetes.io/projected/16c84472-ae2b-4b10-862c-7664b328a1a4-kube-api-access-9j8c2\") pod \"payload-pre-processing-59fbc47bf8-k8dt6\" (UID: \"16c84472-ae2b-4b10-862c-7664b328a1a4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:00.941977 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.941944 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:49:00.986886 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.986846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cd73b3-6ca2-45dd-9f93-37503a153163-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vkn2t\" (UID: \"30cd73b3-6ca2-45dd-9f93-37503a153163\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:00.987056 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.986924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6j4v\" (UniqueName: \"kubernetes.io/projected/30cd73b3-6ca2-45dd-9f93-37503a153163-kube-api-access-t6j4v\") pod \"payload-processing-5b54b7fbb7-vkn2t\" (UID: \"30cd73b3-6ca2-45dd-9f93-37503a153163\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:00.987056 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.986961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16c84472-ae2b-4b10-862c-7664b328a1a4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-k8dt6\" (UID: \"16c84472-ae2b-4b10-862c-7664b328a1a4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:00.987056 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.986988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8c2\" (UniqueName: \"kubernetes.io/projected/16c84472-ae2b-4b10-862c-7664b328a1a4-kube-api-access-9j8c2\") pod \"payload-pre-processing-59fbc47bf8-k8dt6\" (UID: \"16c84472-ae2b-4b10-862c-7664b328a1a4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:00.987658 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:00.987637 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16c84472-ae2b-4b10-862c-7664b328a1a4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-k8dt6\" (UID: \"16c84472-ae2b-4b10-862c-7664b328a1a4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:01.007311 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.007280 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8c2\" (UniqueName: \"kubernetes.io/projected/16c84472-ae2b-4b10-862c-7664b328a1a4-kube-api-access-9j8c2\") pod \"payload-pre-processing-59fbc47bf8-k8dt6\" (UID: \"16c84472-ae2b-4b10-862c-7664b328a1a4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:01.087549 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.087456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6j4v\" (UniqueName: \"kubernetes.io/projected/30cd73b3-6ca2-45dd-9f93-37503a153163-kube-api-access-t6j4v\") pod \"payload-processing-5b54b7fbb7-vkn2t\" (UID: \"30cd73b3-6ca2-45dd-9f93-37503a153163\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:01.087549 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.087545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cd73b3-6ca2-45dd-9f93-37503a153163-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vkn2t\" (UID: \"30cd73b3-6ca2-45dd-9f93-37503a153163\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:01.088363 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.088338 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30cd73b3-6ca2-45dd-9f93-37503a153163-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vkn2t\" (UID: \"30cd73b3-6ca2-45dd-9f93-37503a153163\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:01.105931 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.105893 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6j4v\" (UniqueName: \"kubernetes.io/projected/30cd73b3-6ca2-45dd-9f93-37503a153163-kube-api-access-t6j4v\") pod \"payload-processing-5b54b7fbb7-vkn2t\" (UID: \"30cd73b3-6ca2-45dd-9f93-37503a153163\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:01.132612 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.132569 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:01.182324 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.182282 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:01.420558 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.420526 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6"] Sep 10 03:49:01.422596 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:49:01.422572 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c84472_ae2b_4b10_862c_7664b328a1a4.slice/crio-d5c9a4444e2156b9e7cf2b46935f8325b8c74b71cf81b5f56888dce868bf2620 WatchSource:0}: Error finding container d5c9a4444e2156b9e7cf2b46935f8325b8c74b71cf81b5f56888dce868bf2620: Status 404 returned error can't find the container with id d5c9a4444e2156b9e7cf2b46935f8325b8c74b71cf81b5f56888dce868bf2620 Sep 10 03:49:01.473263 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.473237 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vkn2t"] Sep 10 03:49:01.474986 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:49:01.474959 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cd73b3_6ca2_45dd_9f93_37503a153163.slice/crio-4f7ee65cfc598e366a80553adfdbb40c50d5c8a784b8ea5392b6ae43196386fe WatchSource:0}: Error finding container 4f7ee65cfc598e366a80553adfdbb40c50d5c8a784b8ea5392b6ae43196386fe: Status 404 returned error can't find the container with id 4f7ee65cfc598e366a80553adfdbb40c50d5c8a784b8ea5392b6ae43196386fe Sep 10 03:49:01.552256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.552215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" event={"ID":"30cd73b3-6ca2-45dd-9f93-37503a153163","Type":"ContainerStarted","Data":"4f7ee65cfc598e366a80553adfdbb40c50d5c8a784b8ea5392b6ae43196386fe"} Sep 10 03:49:01.553650 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:01.553620 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" event={"ID":"16c84472-ae2b-4b10-862c-7664b328a1a4","Type":"ContainerStarted","Data":"d5c9a4444e2156b9e7cf2b46935f8325b8c74b71cf81b5f56888dce868bf2620"} Sep 10 03:49:04.599582 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:04.599548 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" event={"ID":"30cd73b3-6ca2-45dd-9f93-37503a153163","Type":"ContainerStarted","Data":"078bf11bc873281b2e96cb7344c22a38a58d4a00c34cdbc59db6152f2c2849ce"} Sep 10 03:49:04.600040 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:04.599661 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:04.601256 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:04.601233 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" event={"ID":"16c84472-ae2b-4b10-862c-7664b328a1a4","Type":"ContainerStarted","Data":"263b3ffaf03069c96803dc4342db343300da30a3c9b517cc7401ff6d3d901d8b"} Sep 10 03:49:04.601373 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:04.601283 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:04.618347 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:04.618290 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" podStartSLOduration=2.303931452 podStartE2EDuration="4.618275388s" totalImagesPullingTime="2.314343936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:04.615463945 +0000 UTC m=+599.420060380" watchObservedRunningTime="2026-09-10 03:49:04.618275388 +0000 UTC m=+599.422871826" Sep 10 03:49:04.630997 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:04.630953 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" podStartSLOduration=2.270261337 podStartE2EDuration="4.630942612s" totalImagesPullingTime="2.360681275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:04.629621433 +0000 UTC m=+599.434217871" watchObservedRunningTime="2026-09-10 03:49:04.630942612 +0000 UTC m=+599.435539044" Sep 10 03:49:10.634300 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.634266 2566 generic.go:356] "Generic (PLEG): container finished" podID="978fc35e-174c-4483-9d22-af0144444949" containerID="c955fb17b69b55c81bf63a28ea0492df67a7f70afc8ffead84da94eaf1107ca1" exitCode=0 Sep 10 03:49:10.634709 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.634340 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" event={"ID":"978fc35e-174c-4483-9d22-af0144444949","Type":"ContainerDied","Data":"c955fb17b69b55c81bf63a28ea0492df67a7f70afc8ffead84da94eaf1107ca1"} Sep 10 03:49:10.634765 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.634727 2566 scope.go:117] "RemoveContainer" containerID="c955fb17b69b55c81bf63a28ea0492df67a7f70afc8ffead84da94eaf1107ca1" Sep 10 03:49:10.635738 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.635710 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:49:10.635807 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.635777 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:49:10.635843 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.635808 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:49:10.990591 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:10.990553 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:11.084527 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:11.084483 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:49:11.091528 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:11.091496 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:11.645379 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:11.645347 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" event={"ID":"978fc35e-174c-4483-9d22-af0144444949","Type":"ContainerStarted","Data":"a769f9d61a989fb943158f62b6a4511672a98159abccdf48a5ca0b6d1944f06f"} Sep 10 03:49:11.788735 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:11.788696 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:49:11.790038 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:11.790012 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9bpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Sep 10 03:49:11.790193 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:11.790067 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" podUID="978fc35e-174c-4483-9d22-af0144444949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Sep 10 03:49:12.789172 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:12.789113 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9bpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Sep 10 03:49:12.789571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:12.789208 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" podUID="978fc35e-174c-4483-9d22-af0144444949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Sep 10 03:49:13.789349 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:13.789313 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9bpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Sep 10 03:49:13.789712 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:13.789370 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" podUID="978fc35e-174c-4483-9d22-af0144444949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Sep 10 03:49:14.789052 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:14.789013 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9bpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Sep 10 03:49:14.789374 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:14.789071 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" podUID="978fc35e-174c-4483-9d22-af0144444949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Sep 10 03:49:15.608871 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:15.608843 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-k8dt6" Sep 10 03:49:15.609065 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:15.608914 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vkn2t" Sep 10 03:49:15.788574 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:15.788538 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9bpnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Sep 10 03:49:15.788763 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:15.788603 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" podUID="978fc35e-174c-4483-9d22-af0144444949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Sep 10 03:49:16.792928 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:16.792901 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:49:16.793308 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:16.793187 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:49:16.793826 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:16.793806 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9bpnz" Sep 10 03:49:30.298844 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:30.298764 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:30.978905 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:30.978868 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:31.426904 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:31.426812 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:49:39.535090 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.535052 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb"] Sep 10 03:49:39.538761 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.538731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.541045 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.541020 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 03:49:39.541854 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.541837 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-45l5t\"" Sep 10 03:49:39.541946 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.541854 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 03:49:39.541946 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.541877 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 03:49:39.548992 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.548963 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb"] Sep 10 03:49:39.565429 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.565401 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:39.640206 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.640172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88fb0ee7-1e08-4790-b702-f56e33263fb0-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.640397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.640216 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.640397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.640234 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.640397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.640286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5rq\" (UniqueName: \"kubernetes.io/projected/88fb0ee7-1e08-4790-b702-f56e33263fb0-kube-api-access-tk5rq\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.640397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.640367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.640565 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.640453 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.741665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.741625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.741665 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.741670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.741944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.741689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5rq\" (UniqueName: \"kubernetes.io/projected/88fb0ee7-1e08-4790-b702-f56e33263fb0-kube-api-access-tk5rq\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.741944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.741707 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.741944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.741768 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.741944 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.741805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88fb0ee7-1e08-4790-b702-f56e33263fb0-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.742198 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.742107 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.742198 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.742130 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.742332 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.742305 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.744128 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.744106 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88fb0ee7-1e08-4790-b702-f56e33263fb0-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.744258 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.744241 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88fb0ee7-1e08-4790-b702-f56e33263fb0-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.749390 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.749370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5rq\" (UniqueName: \"kubernetes.io/projected/88fb0ee7-1e08-4790-b702-f56e33263fb0-kube-api-access-tk5rq\") pod \"e2e-distinct-simulated-kserve-6685d86975-hkpsb\" (UID: \"88fb0ee7-1e08-4790-b702-f56e33263fb0\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:39.850356 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:39.850257 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:40.127938 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:40.127909 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb"] Sep 10 03:49:40.128995 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:49:40.128972 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88fb0ee7_1e08_4790_b702_f56e33263fb0.slice/crio-c07e51241f25c9615962eecc197796bde8fd335ef58b5d6a4f6e14235e67432d WatchSource:0}: Error finding container c07e51241f25c9615962eecc197796bde8fd335ef58b5d6a4f6e14235e67432d: Status 404 returned error can't find the container with id c07e51241f25c9615962eecc197796bde8fd335ef58b5d6a4f6e14235e67432d Sep 10 03:49:40.130381 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:40.130360 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:49:40.315568 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:40.315530 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:49:40.826874 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:40.826833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerStarted","Data":"c07e51241f25c9615962eecc197796bde8fd335ef58b5d6a4f6e14235e67432d"} Sep 10 03:49:41.833872 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:41.833838 2566 generic.go:356] "Generic (PLEG): container finished" podID="88fb0ee7-1e08-4790-b702-f56e33263fb0" containerID="68f4bca169e7bdd7faeac1a3540379eef6ea0fd4ac80279c1a64f51abbba7ea3" exitCode=0 Sep 10 03:49:41.834283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:41.833904 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerDied","Data":"68f4bca169e7bdd7faeac1a3540379eef6ea0fd4ac80279c1a64f51abbba7ea3"} Sep 10 03:49:41.834283 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:41.834122 2566 scope.go:117] "RemoveContainer" containerID="68f4bca169e7bdd7faeac1a3540379eef6ea0fd4ac80279c1a64f51abbba7ea3" Sep 10 03:49:42.841064 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:42.841024 2566 generic.go:356] "Generic (PLEG): container finished" podID="88fb0ee7-1e08-4790-b702-f56e33263fb0" containerID="a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94" exitCode=0 Sep 10 03:49:42.841502 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:42.841101 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerDied","Data":"a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94"} Sep 10 03:49:42.841502 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:42.841171 2566 scope.go:117] "RemoveContainer" containerID="68f4bca169e7bdd7faeac1a3540379eef6ea0fd4ac80279c1a64f51abbba7ea3" Sep 10 03:49:42.841502 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:42.841453 2566 scope.go:117] "RemoveContainer" containerID="a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94" Sep 10 03:49:42.841669 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:49:42.841650 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:49:42.985233 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:42.985195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:43.848577 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:43.848549 2566 scope.go:117] "RemoveContainer" containerID="a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94" Sep 10 03:49:43.849002 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:49:43.848727 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:49:43.911589 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:43.911552 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:49:49.850376 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:49.850326 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:49.850882 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:49.850401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:49.850882 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:49.850418 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:49.850882 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:49.850431 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:49:49.850882 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:49.850786 2566 scope.go:117] "RemoveContainer" containerID="a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94" Sep 10 03:49:49.851023 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:49:49.850972 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:49:52.736647 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.736614 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf"] Sep 10 03:49:52.741617 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.741595 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.743793 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.743768 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 03:49:52.754846 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.754821 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf"] Sep 10 03:49:52.773266 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.773231 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:49:52.864035 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.863980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.864035 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.864053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.864317 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.864092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.864317 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.864138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6197741-5b26-4647-8122-d93155c03fe7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.864317 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.864178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.864317 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.864215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrt5w\" (UniqueName: \"kubernetes.io/projected/c6197741-5b26-4647-8122-d93155c03fe7-kube-api-access-vrt5w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.965702 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.965652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.965903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.965731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.965903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.965757 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.965903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.965817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6197741-5b26-4647-8122-d93155c03fe7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.965903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.965841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.965903 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.965866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrt5w\" (UniqueName: \"kubernetes.io/projected/c6197741-5b26-4647-8122-d93155c03fe7-kube-api-access-vrt5w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.966190 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.966128 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.966246 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.966210 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.966318 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.966301 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.968079 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.968057 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6197741-5b26-4647-8122-d93155c03fe7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.968512 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.968488 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6197741-5b26-4647-8122-d93155c03fe7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:52.973983 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:52.973961 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrt5w\" (UniqueName: \"kubernetes.io/projected/c6197741-5b26-4647-8122-d93155c03fe7-kube-api-access-vrt5w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkzxf\" (UID: \"c6197741-5b26-4647-8122-d93155c03fe7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:53.052402 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:53.052306 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:49:53.323759 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:53.323732 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf"] Sep 10 03:49:53.325245 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:49:53.325213 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6197741_5b26_4647_8122_d93155c03fe7.slice/crio-9a7c2c62dff9e6483142382203b2408f15842a09501308672e94d10912869d81 WatchSource:0}: Error finding container 9a7c2c62dff9e6483142382203b2408f15842a09501308672e94d10912869d81: Status 404 returned error can't find the container with id 9a7c2c62dff9e6483142382203b2408f15842a09501308672e94d10912869d81 Sep 10 03:49:53.906019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:53.905909 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" event={"ID":"c6197741-5b26-4647-8122-d93155c03fe7","Type":"ContainerStarted","Data":"998ae543a55af78e7f12901dcd68cc2d2147313be3ce6de27ac4dfc28507005d"} Sep 10 03:49:53.906019 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:53.905965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" event={"ID":"c6197741-5b26-4647-8122-d93155c03fe7","Type":"ContainerStarted","Data":"9a7c2c62dff9e6483142382203b2408f15842a09501308672e94d10912869d81"} Sep 10 03:49:53.923190 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:53.923123 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" podStartSLOduration=1.716047104 podStartE2EDuration="1.923102922s" totalImagesPullingTime="207.055818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:53.921747939 +0000 UTC m=+648.726344378" watchObservedRunningTime="2026-09-10 03:49:53.923102922 +0000 UTC m=+648.727699360" Sep 10 03:49:54.014539 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:49:54.014495 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:50:03.052814 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.052771 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:50:03.053340 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.052847 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:50:03.065280 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.065243 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:50:03.581721 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.581688 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:50:03.637870 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.637840 2566 scope.go:117] "RemoveContainer" containerID="a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94" Sep 10 03:50:03.965650 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.965513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerStarted","Data":"381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c"} Sep 10 03:50:03.977463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.977439 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkzxf" Sep 10 03:50:03.984733 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:03.984684 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podStartSLOduration=23.477324683 podStartE2EDuration="24.984668096s" totalImagesPullingTime="1.507343413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:50:03.981962854 +0000 UTC m=+658.786559292" watchObservedRunningTime="2026-09-10 03:50:03.984668096 +0000 UTC m=+658.789264538" Sep 10 03:50:04.973488 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:04.973457 2566 generic.go:356] "Generic (PLEG): container finished" podID="88fb0ee7-1e08-4790-b702-f56e33263fb0" containerID="381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c" exitCode=0 Sep 10 03:50:04.974011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:04.973531 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerDied","Data":"381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c"} Sep 10 03:50:04.974011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:04.973595 2566 scope.go:117] "RemoveContainer" containerID="a0a5d3a1aa6634410cf6eefbf868624761fd5b72b2d2fb1752ac5616b858ef94" Sep 10 03:50:04.974133 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:04.974075 2566 scope.go:117] "RemoveContainer" containerID="381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c" Sep 10 03:50:04.974323 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:04.974298 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:50:05.108203 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:05.108146 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:50:09.850599 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:09.850553 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:09.851016 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:09.850626 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:09.851016 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:09.850649 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:09.851016 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:09.850669 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:09.851124 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:09.851038 2566 scope.go:117] "RemoveContainer" containerID="381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c" Sep 10 03:50:09.851319 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:09.851280 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:50:15.277526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:15.277491 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:50:17.022695 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:17.022646 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:50:23.638520 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:23.638489 2566 scope.go:117] "RemoveContainer" containerID="381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c" Sep 10 03:50:23.639009 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:23.638687 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:50:26.235535 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:26.235500 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:50:31.353987 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.353953 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46"] Sep 10 03:50:31.363458 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.359309 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.363458 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.362498 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 03:50:31.366270 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.366238 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46"] Sep 10 03:50:31.371576 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.371551 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:50:31.396802 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.396758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/739fcf97-5768-493d-9241-565a01e7143b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.396802 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.396810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.397023 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.396887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.397023 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.396919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.397094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.397023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzx2l\" (UniqueName: \"kubernetes.io/projected/739fcf97-5768-493d-9241-565a01e7143b-kube-api-access-bzx2l\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.397094 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.397043 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.497728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.497694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzx2l\" (UniqueName: \"kubernetes.io/projected/739fcf97-5768-493d-9241-565a01e7143b-kube-api-access-bzx2l\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.497728 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.497734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.497999 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.497763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/739fcf97-5768-493d-9241-565a01e7143b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.497999 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.497939 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.497999 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.497990 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.498198 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.498010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.498268 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.498223 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.498345 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.498327 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.498457 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.498433 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.500120 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.500096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/739fcf97-5768-493d-9241-565a01e7143b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.500300 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.500283 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/739fcf97-5768-493d-9241-565a01e7143b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.504875 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.504853 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzx2l\" (UniqueName: \"kubernetes.io/projected/739fcf97-5768-493d-9241-565a01e7143b-kube-api-access-bzx2l\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-f8j46\" (UID: \"739fcf97-5768-493d-9241-565a01e7143b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.672583 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.672488 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:31.948217 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:31.947982 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46"] Sep 10 03:50:31.950452 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:50:31.950429 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod739fcf97_5768_493d_9241_565a01e7143b.slice/crio-2e9109fe5a11d94b04e5d712f23fefe89d19f87e0ded393bb0033801afbd9ed0 WatchSource:0}: Error finding container 2e9109fe5a11d94b04e5d712f23fefe89d19f87e0ded393bb0033801afbd9ed0: Status 404 returned error can't find the container with id 2e9109fe5a11d94b04e5d712f23fefe89d19f87e0ded393bb0033801afbd9ed0 Sep 10 03:50:32.127280 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:32.127248 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerStarted","Data":"2e9109fe5a11d94b04e5d712f23fefe89d19f87e0ded393bb0033801afbd9ed0"} Sep 10 03:50:33.134119 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:33.134088 2566 generic.go:356] "Generic (PLEG): container finished" podID="739fcf97-5768-493d-9241-565a01e7143b" containerID="56282164a413a51009cdfe92e5b382a8e4eaf5202530e477792e361d1184c5d6" exitCode=0 Sep 10 03:50:33.134532 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:33.134182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerDied","Data":"56282164a413a51009cdfe92e5b382a8e4eaf5202530e477792e361d1184c5d6"} Sep 10 03:50:33.134532 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:33.134404 2566 scope.go:117] "RemoveContainer" containerID="56282164a413a51009cdfe92e5b382a8e4eaf5202530e477792e361d1184c5d6" Sep 10 03:50:33.530839 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:33.530801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5v69j"] Sep 10 03:50:34.145405 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:34.145316 2566 generic.go:356] "Generic (PLEG): container finished" podID="739fcf97-5768-493d-9241-565a01e7143b" containerID="fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798" exitCode=0 Sep 10 03:50:34.145895 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:34.145437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerDied","Data":"fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798"} Sep 10 03:50:34.145895 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:34.145498 2566 scope.go:117] "RemoveContainer" containerID="56282164a413a51009cdfe92e5b382a8e4eaf5202530e477792e361d1184c5d6" Sep 10 03:50:34.146067 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:34.146046 2566 scope.go:117] "RemoveContainer" containerID="fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798" Sep 10 03:50:34.146303 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:34.146279 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:50:35.159506 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:35.159465 2566 scope.go:117] "RemoveContainer" containerID="fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798" Sep 10 03:50:35.159993 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:35.159685 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:50:37.637832 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:37.637799 2566 scope.go:117] "RemoveContainer" containerID="381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c" Sep 10 03:50:38.177481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:38.177395 2566 generic.go:356] "Generic (PLEG): container finished" podID="88fb0ee7-1e08-4790-b702-f56e33263fb0" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" exitCode=0 Sep 10 03:50:38.177481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:38.177463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerDied","Data":"0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566"} Sep 10 03:50:38.177670 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:38.177522 2566 scope.go:117] "RemoveContainer" containerID="381c4995f1c214c71848573440808d6557c0eb9df84bf3e3a1d20e86e5df934c" Sep 10 03:50:38.177895 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:38.177874 2566 scope.go:117] "RemoveContainer" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" Sep 10 03:50:38.178118 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:38.178100 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:50:39.850643 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:39.850605 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:39.851044 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:39.850664 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:39.851044 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:39.850680 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:39.851044 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:39.850697 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:50:39.851186 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:39.851051 2566 scope.go:117] "RemoveContainer" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" Sep 10 03:50:39.851279 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:39.851257 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:50:41.672994 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:41.672958 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:41.673397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:41.673007 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:41.673397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:41.673018 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:41.673397 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:41.673026 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:50:41.673526 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:41.673409 2566 scope.go:117] "RemoveContainer" containerID="fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798" Sep 10 03:50:41.673585 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:41.673565 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:50:54.638276 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:54.638244 2566 scope.go:117] "RemoveContainer" containerID="fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798" Sep 10 03:50:55.272968 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:55.272935 2566 generic.go:356] "Generic (PLEG): container finished" podID="739fcf97-5768-493d-9241-565a01e7143b" containerID="5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d" exitCode=0 Sep 10 03:50:55.273144 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:55.273007 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerDied","Data":"5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d"} Sep 10 03:50:55.273144 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:55.273059 2566 scope.go:117] "RemoveContainer" containerID="fbb7994a9bb799fe3ec590a58dceda5dc10c0cddf9da153c388f1d4012aea798" Sep 10 03:50:55.273425 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:55.273405 2566 scope.go:117] "RemoveContainer" containerID="5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d" Sep 10 03:50:55.273620 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:55.273601 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:50:55.640987 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:50:55.640895 2566 scope.go:117] "RemoveContainer" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" Sep 10 03:50:55.641429 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:50:55.641047 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:51:01.673676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:01.673592 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:01.673676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:01.673639 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:01.673676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:01.673649 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:01.673676 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:01.673659 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:01.674129 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:01.674006 2566 scope.go:117] "RemoveContainer" containerID="5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d" Sep 10 03:51:01.674216 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:01.674197 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:51:08.637913 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:08.637881 2566 scope.go:117] "RemoveContainer" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" Sep 10 03:51:08.638359 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:08.638118 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:51:13.638488 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:13.638453 2566 scope.go:117] "RemoveContainer" containerID="5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d" Sep 10 03:51:13.638962 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:13.638672 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:51:19.638134 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:19.638091 2566 scope.go:117] "RemoveContainer" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" Sep 10 03:51:20.415108 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:20.415076 2566 generic.go:356] "Generic (PLEG): container finished" podID="88fb0ee7-1e08-4790-b702-f56e33263fb0" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" exitCode=0 Sep 10 03:51:20.415334 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:20.415124 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerDied","Data":"ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364"} Sep 10 03:51:20.415334 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:20.415200 2566 scope.go:117] "RemoveContainer" containerID="0b58c7aacfcb110d035c8b3f6993a1b94c36ecbf1512f8b386d6a043d667f566" Sep 10 03:51:20.415544 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:20.415517 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:51:20.415727 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:20.415707 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:51:25.640514 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:25.640485 2566 scope.go:117] "RemoveContainer" containerID="5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d" Sep 10 03:51:26.450433 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:26.450397 2566 generic.go:356] "Generic (PLEG): container finished" podID="739fcf97-5768-493d-9241-565a01e7143b" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" exitCode=0 Sep 10 03:51:26.450672 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:26.450472 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerDied","Data":"43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc"} Sep 10 03:51:26.450672 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:26.450531 2566 scope.go:117] "RemoveContainer" containerID="5784cf40192fb2fde5deb1f5f17361f12523d87f4242d87bc2523af6410d3a8d" Sep 10 03:51:26.450880 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:26.450861 2566 scope.go:117] "RemoveContainer" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" Sep 10 03:51:26.451065 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:26.451042 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:51:29.850975 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:29.850939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:51:29.851529 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:29.851012 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:51:29.851529 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:29.851036 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:51:29.851529 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:29.851056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:51:29.851695 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:29.851592 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:51:29.851846 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:29.851823 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:51:31.673431 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:31.673391 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:31.673831 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:31.673441 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:31.673831 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:31.673454 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:31.673831 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:31.673468 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:51:31.673937 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:31.673871 2566 scope.go:117] "RemoveContainer" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" Sep 10 03:51:31.674066 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:31.674047 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:51:43.637584 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:43.637546 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:51:43.638078 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:43.637774 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:51:44.637612 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:44.637576 2566 scope.go:117] "RemoveContainer" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" Sep 10 03:51:44.638025 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:44.637769 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:51:55.641723 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:55.641686 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:51:55.642136 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:55.641884 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:51:59.637635 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:51:59.637601 2566 scope.go:117] "RemoveContainer" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" Sep 10 03:51:59.638099 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:51:59.637827 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:52:10.638428 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:10.638394 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:52:10.638817 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:10.638608 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:52:11.637884 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:11.637854 2566 scope.go:117] "RemoveContainer" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" Sep 10 03:52:12.713589 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:12.713553 2566 generic.go:356] "Generic (PLEG): container finished" podID="739fcf97-5768-493d-9241-565a01e7143b" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" exitCode=0 Sep 10 03:52:12.714065 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:12.713627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerDied","Data":"64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b"} Sep 10 03:52:12.714065 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:12.713675 2566 scope.go:117] "RemoveContainer" containerID="43be3224435718c01b5b13bcc6bac20d89d2a40c0a853b41790f33b1a8275dcc" Sep 10 03:52:12.714065 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:12.714054 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:52:12.714308 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:12.714286 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:52:21.673469 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:21.673428 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:52:21.673860 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:21.673482 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:52:21.673860 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:21.673498 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:52:21.673860 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:21.673509 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:52:21.673974 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:21.673902 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:52:21.674138 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:21.674117 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:52:24.638265 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:24.638231 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:52:24.638657 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:24.638415 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:52:33.637726 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:33.637628 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:52:33.638340 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:33.637813 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:52:37.638553 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:37.638515 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:52:37.638953 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:37.638778 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:52:48.638223 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:48.638190 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:52:48.638601 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:48.638373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:52:51.638568 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:51.638541 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:52:51.927883 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:51.927847 2566 generic.go:356] "Generic (PLEG): container finished" podID="88fb0ee7-1e08-4790-b702-f56e33263fb0" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" exitCode=0 Sep 10 03:52:51.928041 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:51.927919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" event={"ID":"88fb0ee7-1e08-4790-b702-f56e33263fb0","Type":"ContainerDied","Data":"72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876"} Sep 10 03:52:51.928041 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:51.927983 2566 scope.go:117] "RemoveContainer" containerID="ba34f4368d0ac9c2e4f19b009e3391c6225cafc8df7a1214fde73712bd056364" Sep 10 03:52:51.928432 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:51.928409 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:52:51.928666 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:51.928647 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:52:59.850368 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:59.850327 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:52:59.850841 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:59.850537 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:52:59.850841 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:59.850586 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:52:59.850841 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:59.850622 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" Sep 10 03:52:59.851177 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:59.851126 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:52:59.851463 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:59.851442 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:52:59.974440 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:52:59.974411 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:52:59.974625 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:52:59.974603 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:53:00.637849 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:00.637820 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:53:00.638023 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:00.637986 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:53:10.637718 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:10.637679 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:53:10.638258 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:10.637922 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:53:11.637660 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:11.637626 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:53:11.637851 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:11.637788 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:53:24.638207 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:24.638145 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:53:24.638588 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:24.638282 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:53:24.638588 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:24.638426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:53:24.638588 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:24.638426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:53:33.482093 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:33.482059 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:53:33.535268 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:33.535236 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:53:36.638440 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:36.638408 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:53:36.638835 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:36.638605 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:53:37.637647 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:37.637611 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:53:38.186422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:38.186333 2566 generic.go:356] "Generic (PLEG): container finished" podID="739fcf97-5768-493d-9241-565a01e7143b" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" exitCode=0 Sep 10 03:53:38.186422 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:38.186385 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" event={"ID":"739fcf97-5768-493d-9241-565a01e7143b","Type":"ContainerDied","Data":"5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220"} Sep 10 03:53:38.186851 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:38.186429 2566 scope.go:117] "RemoveContainer" containerID="64980d65f9089d2339611ae517e40a62148785d677db40acfbcdabb0510fee7b" Sep 10 03:53:38.186851 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:38.186796 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:53:38.187022 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:38.187002 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:53:41.673195 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:41.673136 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:53:41.673725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:41.673211 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:53:41.673725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:41.673223 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:53:41.673725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:41.673232 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" Sep 10 03:53:41.673725 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:41.673592 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:53:41.673885 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:41.673756 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:53:50.637509 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:50.637470 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:53:50.637898 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:50.637661 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:53:55.641890 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:53:55.641862 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:53:55.642276 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:53:55.642051 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:54:03.637818 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:03.637790 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:54:03.638233 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:03.637946 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:54:10.638297 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:10.638261 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:54:10.640508 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:10.638450 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:54:14.638387 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:14.638357 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:54:14.638873 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:14.638537 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:54:15.912775 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:15.912740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65d7f67f85-x5lqb_3553c142-4715-4008-b3de-6424741b522a/authorino/0.log" Sep 10 03:54:22.955441 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:22.955399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-vh97j_6983443d-ea9d-4b2b-b886-3bc0a837dbe3/manager/0.log" Sep 10 03:54:22.962208 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:22.962181 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-vh97j_6983443d-ea9d-4b2b-b886-3bc0a837dbe3/copy-manifests/0.log" Sep 10 03:54:23.456477 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:23.456449 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-59zhg_4cda93f3-adea-477e-931e-72deb6dfbb24/postgres/0.log" Sep 10 03:54:24.341426 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:24.341364 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65d7f67f85-x5lqb_3553c142-4715-4008-b3de-6424741b522a/authorino/0.log" Sep 10 03:54:24.471038 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:24.471006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-7tn7j_5ac666f2-5166-4e03-97c0-69ee1ed85570/manager/0.log" Sep 10 03:54:24.609560 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:24.609481 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-tb9z2_872e7dc9-c09d-4b67-8db2-363e5d629b2d/manager/0.log" Sep 10 03:54:24.638348 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:24.638316 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:54:24.638525 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:24.638507 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:54:24.737862 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:24.737834 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-85dp9_7227bac4-7c35-4353-be43-827ef1eb55e2/kuadrant-console-plugin/0.log" Sep 10 03:54:24.882911 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:24.882832 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-d85zp_114e3622-4b8f-4c52-835c-d2bd27803c32/manager/0.log" Sep 10 03:54:25.020524 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:25.020497 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5v69j_674a52a2-5702-490c-a376-25a5f6316cd0/limitador/0.log" Sep 10 03:54:25.155190 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:25.155092 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mrl4t_f43e759f-c919-4c40-9ed0-012860cd88a7/manager/0.log" Sep 10 03:54:25.953445 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:25.953414 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7878b9b57-vz6wg_722340e1-ea7a-4406-aa14-8ba6a08910d8/kube-auth-proxy/0.log" Sep 10 03:54:26.086578 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:26.086553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/1.log" Sep 10 03:54:26.213079 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:26.212999 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-k8dt6_16c84472-ae2b-4b10-862c-7664b328a1a4/payload-pre-processing/0.log" Sep 10 03:54:26.341981 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:26.341935 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vkn2t_30cd73b3-6ca2-45dd-9f93-37503a153163/payload-processing/0.log" Sep 10 03:54:26.638323 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:26.638243 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:54:26.638466 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:26.638406 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:54:27.005982 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:27.005955 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-hkpsb_88fb0ee7-1e08-4790-b702-f56e33263fb0/main/5.log" Sep 10 03:54:27.255809 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:27.255780 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vkzxf_c6197741-5b26-4647-8122-d93155c03fe7/main/0.log" Sep 10 03:54:27.629336 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:27.629306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_739fcf97-5768-493d-9241-565a01e7143b/main/5.log" Sep 10 03:54:34.309236 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.309193 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gvppc/must-gather-8qml8"] Sep 10 03:54:34.311936 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.311914 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.314507 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.314482 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gvppc\"/\"default-dockercfg-hwbmm\"" Sep 10 03:54:34.314637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.314481 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gvppc\"/\"openshift-service-ca.crt\"" Sep 10 03:54:34.314637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.314486 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gvppc\"/\"kube-root-ca.crt\"" Sep 10 03:54:34.320531 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.320506 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gvppc/must-gather-8qml8"] Sep 10 03:54:34.325761 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.325736 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:54:34.380447 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.380412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gskdv\" (UniqueName: \"kubernetes.io/projected/6643ce56-5d3e-41f8-bba0-eb99717c9bf0-kube-api-access-gskdv\") pod \"must-gather-8qml8\" (UID: \"6643ce56-5d3e-41f8-bba0-eb99717c9bf0\") " pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.380637 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.380471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6643ce56-5d3e-41f8-bba0-eb99717c9bf0-must-gather-output\") pod \"must-gather-8qml8\" (UID: \"6643ce56-5d3e-41f8-bba0-eb99717c9bf0\") " pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.481823 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.481786 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gskdv\" (UniqueName: \"kubernetes.io/projected/6643ce56-5d3e-41f8-bba0-eb99717c9bf0-kube-api-access-gskdv\") pod \"must-gather-8qml8\" (UID: \"6643ce56-5d3e-41f8-bba0-eb99717c9bf0\") " pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.482006 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.481839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6643ce56-5d3e-41f8-bba0-eb99717c9bf0-must-gather-output\") pod \"must-gather-8qml8\" (UID: \"6643ce56-5d3e-41f8-bba0-eb99717c9bf0\") " pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.482260 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.482239 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6643ce56-5d3e-41f8-bba0-eb99717c9bf0-must-gather-output\") pod \"must-gather-8qml8\" (UID: \"6643ce56-5d3e-41f8-bba0-eb99717c9bf0\") " pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.490726 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.490698 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gskdv\" (UniqueName: \"kubernetes.io/projected/6643ce56-5d3e-41f8-bba0-eb99717c9bf0-kube-api-access-gskdv\") pod \"must-gather-8qml8\" (UID: \"6643ce56-5d3e-41f8-bba0-eb99717c9bf0\") " pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.621811 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.621722 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gvppc/must-gather-8qml8" Sep 10 03:54:34.893045 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:34.893019 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gvppc/must-gather-8qml8"] Sep 10 03:54:34.894965 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:54:34.894937 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6643ce56_5d3e_41f8_bba0_eb99717c9bf0.slice/crio-a3c5ee000864ee45ba227fd8d4af957940a7dd9594e6be9ff1d352ec24cb5b8e WatchSource:0}: Error finding container a3c5ee000864ee45ba227fd8d4af957940a7dd9594e6be9ff1d352ec24cb5b8e: Status 404 returned error can't find the container with id a3c5ee000864ee45ba227fd8d4af957940a7dd9594e6be9ff1d352ec24cb5b8e Sep 10 03:54:35.512780 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:35.512745 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/must-gather-8qml8" event={"ID":"6643ce56-5d3e-41f8-bba0-eb99717c9bf0","Type":"ContainerStarted","Data":"a3c5ee000864ee45ba227fd8d4af957940a7dd9594e6be9ff1d352ec24cb5b8e"} Sep 10 03:54:35.562435 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:35.562400 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" limit=1024 Sep 10 03:54:36.523240 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:36.523206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/must-gather-8qml8" event={"ID":"6643ce56-5d3e-41f8-bba0-eb99717c9bf0","Type":"ContainerStarted","Data":"d83c677b3c6914f798f0edc074ff35b1291803fbe4757e2727e24e8b2e7e418c"} Sep 10 03:54:36.523747 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:36.523263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/must-gather-8qml8" event={"ID":"6643ce56-5d3e-41f8-bba0-eb99717c9bf0","Type":"ContainerStarted","Data":"3fe057c62de712ad507e3de8daf639ac9a4d9be3792acbf519a88554fd2ccc40"} Sep 10 03:54:36.541981 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:36.541919 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gvppc/must-gather-8qml8" podStartSLOduration=1.869271902 podStartE2EDuration="2.541900811s" totalImagesPullingTime="672.628909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:54:36.538414279 +0000 UTC m=+931.343010720" watchObservedRunningTime="2026-09-10 03:54:36.541900811 +0000 UTC m=+931.346497248" Sep 10 03:54:37.282484 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:37.282445 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jxlz4_bf56d3ca-0c64-4c9f-a822-565d97259dd1/global-pull-secret-syncer/0.log" Sep 10 03:54:37.342476 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:37.342445 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7v2jq_91840637-38fe-40c5-841a-4ce3e56f47af/konnectivity-agent/0.log" Sep 10 03:54:37.418010 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:37.417978 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-142.ec2.internal_2f0198fac28ce54a3ba5394c28e56a3d/haproxy/0.log" Sep 10 03:54:39.642043 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:39.641995 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:54:39.642543 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:39.642275 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:54:39.642690 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:39.642667 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:54:39.642876 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:39.642852 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:54:41.557809 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.557774 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65d7f67f85-x5lqb_3553c142-4715-4008-b3de-6424741b522a/authorino/0.log" Sep 10 03:54:41.594390 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.594357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-7tn7j_5ac666f2-5166-4e03-97c0-69ee1ed85570/manager/0.log" Sep 10 03:54:41.630175 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.630130 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-tb9z2_872e7dc9-c09d-4b67-8db2-363e5d629b2d/manager/0.log" Sep 10 03:54:41.671291 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.671248 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-85dp9_7227bac4-7c35-4353-be43-827ef1eb55e2/kuadrant-console-plugin/0.log" Sep 10 03:54:41.733073 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.732998 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-d85zp_114e3622-4b8f-4c52-835c-d2bd27803c32/manager/0.log" Sep 10 03:54:41.762720 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.762695 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5v69j_674a52a2-5702-490c-a376-25a5f6316cd0/limitador/0.log" Sep 10 03:54:41.800033 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:41.799994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mrl4t_f43e759f-c919-4c40-9ed0-012860cd88a7/manager/0.log" Sep 10 03:54:43.365532 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.365497 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/alertmanager/0.log" Sep 10 03:54:43.390873 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.390843 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/config-reloader/0.log" Sep 10 03:54:43.416464 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.416437 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/kube-rbac-proxy-web/0.log" Sep 10 03:54:43.443043 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.443013 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/kube-rbac-proxy/0.log" Sep 10 03:54:43.468039 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.468011 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/kube-rbac-proxy-metric/0.log" Sep 10 03:54:43.493287 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.493261 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/prom-label-proxy/0.log" Sep 10 03:54:43.528973 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.528946 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_26cd8277-631d-4931-a7f5-d56ef0fd77f3/init-config-reloader/0.log" Sep 10 03:54:43.823838 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.823803 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7sbzf_dc671265-07ae-4103-b879-fa11241a7f5d/node-exporter/0.log" Sep 10 03:54:43.846909 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.846865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7sbzf_dc671265-07ae-4103-b879-fa11241a7f5d/kube-rbac-proxy/0.log" Sep 10 03:54:43.871120 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:43.871087 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7sbzf_dc671265-07ae-4103-b879-fa11241a7f5d/init-textfile/0.log" Sep 10 03:54:44.304438 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:44.304398 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-254xc_c9c79be3-f511-492d-bff2-3bac64dd0ae5/prometheus-operator-admission-webhook/0.log" Sep 10 03:54:44.355058 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:44.355024 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbc5c6777-b4bdx_00eede8f-aa55-4553-a6ef-47b687cd4a87/telemeter-client/0.log" Sep 10 03:54:44.414979 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:44.414941 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbc5c6777-b4bdx_00eede8f-aa55-4553-a6ef-47b687cd4a87/reload/0.log" Sep 10 03:54:44.436787 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:44.436750 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbc5c6777-b4bdx_00eede8f-aa55-4553-a6ef-47b687cd4a87/kube-rbac-proxy/0.log" Sep 10 03:54:47.429371 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.429335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-nvdm4_1f83ee4c-3e0c-4f22-acdb-454f56982d0d/download-server/0.log" Sep 10 03:54:47.728481 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.728447 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn"] Sep 10 03:54:47.734447 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.734420 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.741773 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.741711 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn"] Sep 10 03:54:47.837142 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.837105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-proc\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.837142 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.837168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkcz\" (UniqueName: \"kubernetes.io/projected/e72fdad3-7183-4419-acad-8bd068e3c95c-kube-api-access-phkcz\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.837434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.837259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-podres\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.837434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.837316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-lib-modules\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.837434 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.837346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-sys\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.938233 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.938193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-proc\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.938457 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.938424 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-proc\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.938571 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.938556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkcz\" (UniqueName: \"kubernetes.io/projected/e72fdad3-7183-4419-acad-8bd068e3c95c-kube-api-access-phkcz\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.939025 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.939002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-podres\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.939414 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.939398 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-lib-modules\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.939560 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.939265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-podres\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.939646 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.939521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-lib-modules\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.939763 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.939750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-sys\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.940052 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.939870 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e72fdad3-7183-4419-acad-8bd068e3c95c-sys\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:47.947681 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:47.947655 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkcz\" (UniqueName: \"kubernetes.io/projected/e72fdad3-7183-4419-acad-8bd068e3c95c-kube-api-access-phkcz\") pod \"perf-node-gather-daemonset-4b5rn\" (UID: \"e72fdad3-7183-4419-acad-8bd068e3c95c\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:48.056030 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:48.055924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:48.357463 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:48.357430 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn"] Sep 10 03:54:48.358896 ip-10-0-130-142 kubenswrapper[2566]: W0910 03:54:48.358859 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode72fdad3_7183_4419_acad_8bd068e3c95c.slice/crio-ff06abebe7075deadc8baa7a7515ddf187fa2c2ffd0d45f0c20a0201795bc39e WatchSource:0}: Error finding container ff06abebe7075deadc8baa7a7515ddf187fa2c2ffd0d45f0c20a0201795bc39e: Status 404 returned error can't find the container with id ff06abebe7075deadc8baa7a7515ddf187fa2c2ffd0d45f0c20a0201795bc39e Sep 10 03:54:48.630525 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:48.630441 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" event={"ID":"e72fdad3-7183-4419-acad-8bd068e3c95c","Type":"ContainerStarted","Data":"9438f3c3cc0516579bdcf10d96d1110a882be05c0296733bdd571aebd10a2d80"} Sep 10 03:54:48.630525 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:48.630503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" event={"ID":"e72fdad3-7183-4419-acad-8bd068e3c95c","Type":"ContainerStarted","Data":"ff06abebe7075deadc8baa7a7515ddf187fa2c2ffd0d45f0c20a0201795bc39e"} Sep 10 03:54:48.630940 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:48.630531 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:48.648522 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:48.648469 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" podStartSLOduration=1.6484528790000001 podStartE2EDuration="1.648452879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:54:48.64597894 +0000 UTC m=+943.450575377" watchObservedRunningTime="2026-09-10 03:54:48.648452879 +0000 UTC m=+943.453049377" Sep 10 03:54:49.340356 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:49.340320 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-85g9d_ce762875-56c5-4d4b-be65-437d29a2faca/dns/0.log" Sep 10 03:54:49.367617 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:49.367585 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-85g9d_ce762875-56c5-4d4b-be65-437d29a2faca/kube-rbac-proxy/0.log" Sep 10 03:54:49.416121 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:49.416091 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95fzq_bafa2588-753b-4d1c-9854-03d99c67062f/dns-node-resolver/0.log" Sep 10 03:54:49.961515 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:49.961480 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64b6d9b9bd-lkhz2_3c917861-19d9-40a2-8001-487ee1d88737/registry/0.log" Sep 10 03:54:50.006102 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:50.006061 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lssfz_88ba748b-ef29-4bdc-a330-a6b6d95121aa/node-ca/0.log" Sep 10 03:54:50.638419 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:50.638379 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:54:50.638669 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:50.638636 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:54:50.639186 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:50.639143 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:54:50.639392 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:54:50.639371 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:54:51.088029 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:51.088001 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7878b9b57-vz6wg_722340e1-ea7a-4406-aa14-8ba6a08910d8/kube-auth-proxy/0.log" Sep 10 03:54:51.119002 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:51.118971 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/1.log" Sep 10 03:54:51.119893 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:51.119863 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/0.log" Sep 10 03:54:51.143485 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:51.143457 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-k8dt6_16c84472-ae2b-4b10-862c-7664b328a1a4/payload-pre-processing/0.log" Sep 10 03:54:51.168804 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:51.168770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vkn2t_30cd73b3-6ca2-45dd-9f93-37503a153163/payload-processing/0.log" Sep 10 03:54:51.889052 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:51.889021 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbscm_e36a3a11-7dea-4c1f-917f-02a93918a190/serve-healthcheck-canary/0.log" Sep 10 03:54:52.539488 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:52.539454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sh4n8_4465e614-8d9c-4493-a7b2-275c639f88ad/kube-rbac-proxy/0.log" Sep 10 03:54:52.563390 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:52.563356 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sh4n8_4465e614-8d9c-4493-a7b2-275c639f88ad/exporter/0.log" Sep 10 03:54:52.586416 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:52.586380 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sh4n8_4465e614-8d9c-4493-a7b2-275c639f88ad/extractor/0.log" Sep 10 03:54:54.649173 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:54.649132 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-4b5rn" Sep 10 03:54:55.020170 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:55.020120 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-vh97j_6983443d-ea9d-4b2b-b886-3bc0a837dbe3/manager/0.log" Sep 10 03:54:55.039408 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:55.039380 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-vh97j_6983443d-ea9d-4b2b-b886-3bc0a837dbe3/copy-manifests/0.log" Sep 10 03:54:58.307144 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:58.307110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7878b9b57-vz6wg_722340e1-ea7a-4406-aa14-8ba6a08910d8/kube-auth-proxy/0.log" Sep 10 03:54:58.330416 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:58.330384 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/1.log" Sep 10 03:54:58.331072 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:58.331052 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/0.log" Sep 10 03:54:58.342205 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:58.342180 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-k8dt6_16c84472-ae2b-4b10-862c-7664b328a1a4/payload-pre-processing/0.log" Sep 10 03:54:58.356575 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:58.356550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vkn2t_30cd73b3-6ca2-45dd-9f93-37503a153163/payload-processing/0.log" Sep 10 03:54:59.656032 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:59.655992 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7878b9b57-vz6wg_722340e1-ea7a-4406-aa14-8ba6a08910d8/kube-auth-proxy/0.log" Sep 10 03:54:59.680124 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:59.680085 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/1.log" Sep 10 03:54:59.680874 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:59.680851 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9bpnz_978fc35e-174c-4483-9d22-af0144444949/istio-proxy/0.log" Sep 10 03:54:59.694432 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:59.694400 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-k8dt6_16c84472-ae2b-4b10-862c-7664b328a1a4/payload-pre-processing/0.log" Sep 10 03:54:59.711321 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:54:59.711246 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vkn2t_30cd73b3-6ca2-45dd-9f93-37503a153163/payload-processing/0.log" Sep 10 03:55:01.638359 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:01.638325 2566 scope.go:117] "RemoveContainer" containerID="72745a79f66c2017663db1f81c27b1993e937e0694af3dc647451cc2d509d876" Sep 10 03:55:01.639008 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:55:01.638549 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-hkpsb_llm(88fb0ee7-1e08-4790-b702-f56e33263fb0)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-hkpsb" podUID="88fb0ee7-1e08-4790-b702-f56e33263fb0" Sep 10 03:55:02.638137 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:02.638107 2566 scope.go:117] "RemoveContainer" containerID="5e32d487c9576fde28a6b238a9abc49bd122417130f88dc9b80d082904985220" Sep 10 03:55:02.638379 ip-10-0-130-142 kubenswrapper[2566]: E0910 03:55:02.638351 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-f8j46_llm(739fcf97-5768-493d-9241-565a01e7143b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-f8j46" podUID="739fcf97-5768-493d-9241-565a01e7143b" Sep 10 03:55:03.148011 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.147981 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-69jck_3bad94b7-374a-439c-92bf-0fbcaff626c3/kube-multus/0.log" Sep 10 03:55:03.172098 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.172071 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/kube-multus-additional-cni-plugins/0.log" Sep 10 03:55:03.193647 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.193622 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/egress-router-binary-copy/0.log" Sep 10 03:55:03.216113 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.216083 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/cni-plugins/0.log" Sep 10 03:55:03.238453 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.238425 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/bond-cni-plugin/0.log" Sep 10 03:55:03.260219 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.260191 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/routeoverride-cni/0.log" Sep 10 03:55:03.282314 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.282280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/whereabouts-cni-bincopy/0.log" Sep 10 03:55:03.306036 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.306004 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpk8r_3616b002-6af6-476c-aa9b-488e86caa6e4/whereabouts-cni/0.log" Sep 10 03:55:03.703751 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.703723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-djlkd_d370d3ab-9d24-43c3-9eaa-2916f5aa97fc/network-metrics-daemon/0.log" Sep 10 03:55:03.723141 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:03.723112 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-djlkd_d370d3ab-9d24-43c3-9eaa-2916f5aa97fc/kube-rbac-proxy/0.log" Sep 10 03:55:04.616715 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.616682 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/ovn-controller/0.log" Sep 10 03:55:04.635565 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.635537 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/ovn-acl-logging/0.log" Sep 10 03:55:04.662001 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.661973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/kube-rbac-proxy-node/0.log" Sep 10 03:55:04.686262 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.686232 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 03:55:04.708242 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.708206 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/northd/0.log" Sep 10 03:55:04.730242 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.730210 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/nbdb/0.log" Sep 10 03:55:04.751898 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.751867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/sbdb/0.log" Sep 10 03:55:04.813343 ip-10-0-130-142 kubenswrapper[2566]: I0910 03:55:04.813295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lmn64_4f3fb80e-96cf-4bce-ab53-df7d2a5ec849/ovnkube-controller/0.log"