Jul 10 21:21:16.135668 ip-10-0-133-215 systemd[1]: Starting Kubernetes Kubelet... Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.531821 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537264 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537280 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537284 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537287 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537290 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537294 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537297 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 21:21:16.566337 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537301 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537304 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537307 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537310 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537312 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537315 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537318 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537320 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537323 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537326 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537329 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537331 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537334 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537337 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537343 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537347 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537351 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537354 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537357 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 21:21:16.567607 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537376 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537379 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537383 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537385 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537389 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537392 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537394 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537397 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537400 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537402 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537405 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537407 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537410 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537413 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537416 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537419 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537421 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537425 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537429 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 21:21:16.568210 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537432 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537435 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537438 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537441 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537443 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537446 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537448 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537451 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537454 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537458 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537460 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537463 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537466 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537469 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537471 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537474 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537476 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537479 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537482 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537485 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 21:21:16.569458 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537487 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537490 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537493 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537495 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537498 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537501 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537503 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537505 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537508 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537510 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537513 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537516 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537519 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537522 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537526 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537529 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537532 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537534 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537537 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537540 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 21:21:16.570086 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537544 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537547 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537550 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537552 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537555 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537558 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537561 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537564 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537566 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537569 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537572 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537575 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537577 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.537580 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538319 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538326 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538329 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538333 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538338 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 21:21:16.570819 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538342 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538345 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538347 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538350 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538353 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538356 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538376 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538388 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538391 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538394 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538397 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538400 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538402 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538404 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538407 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538410 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538412 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538415 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538417 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538420 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 21:21:16.571355 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538425 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538428 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538431 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538434 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538437 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538440 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538442 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538445 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538448 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538450 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538453 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538455 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538458 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538462 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538465 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538468 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538471 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538474 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538477 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 21:21:16.572071 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538480 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538483 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538487 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538490 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538493 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538495 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538498 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538500 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538503 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538506 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538508 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538511 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538513 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538516 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538518 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538521 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538524 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538527 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538529 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 21:21:16.572643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538533 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538538 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538541 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538544 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538547 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538549 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538552 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538554 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538557 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538559 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538563 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538565 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538568 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538570 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538573 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538576 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538579 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538581 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538584 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538586 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 21:21:16.573208 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538589 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538591 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538594 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538596 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538598 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538601 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538604 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538606 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538612 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538615 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538617 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538620 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538622 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538625 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538628 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.538630 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539025 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539030 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539034 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539037 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 21:21:16.573937 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539040 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539043 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539045 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539048 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539050 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539054 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539057 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539061 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539063 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539066 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539068 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539071 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539073 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539077 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539081 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539083 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539086 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539088 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539091 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 21:21:16.574541 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539093 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539097 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539100 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539102 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539105 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539107 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539110 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539112 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539117 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539122 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539125 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539129 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539131 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539134 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539137 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539141 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539144 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539147 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539150 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 21:21:16.575243 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539152 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539155 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539158 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539160 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539163 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539165 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539168 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539170 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539172 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539175 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539178 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539180 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539183 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539185 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539189 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539192 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539194 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539197 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539199 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539202 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 21:21:16.575792 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539204 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539206 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539210 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539213 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539215 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539218 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539220 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539223 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539225 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539227 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539230 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539232 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539235 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539237 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539241 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539244 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539247 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539249 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539252 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539254 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 21:21:16.576382 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539256 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539259 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539261 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539264 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539266 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539269 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539273 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539276 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539278 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539281 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539283 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539286 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539289 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539291 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539295 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539297 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.539300 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539394 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539405 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539415 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539422 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 21:21:16.576971 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539428 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539431 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539436 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539440 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539443 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539446 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539451 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539455 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539458 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539461 2584 flags.go:64] FLAG: --cgroup-root="" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539463 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539466 2584 flags.go:64] FLAG: --client-ca-file="" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539469 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539472 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539476 2584 flags.go:64] FLAG: --cluster-domain="" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539479 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539482 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539487 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539490 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539494 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539497 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539501 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539504 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539507 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 10 21:21:16.577625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539510 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539515 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539518 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539521 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539525 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539528 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539531 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539534 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539537 2584 flags.go:64] FLAG: --enable-server="true" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539539 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539547 2584 flags.go:64] FLAG: --event-burst="100" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539550 2584 flags.go:64] FLAG: --event-qps="50" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539553 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539555 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539559 2584 flags.go:64] FLAG: --eviction-hard="" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539563 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539566 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539569 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539572 2584 flags.go:64] FLAG: --eviction-soft="" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539575 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539578 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539581 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539584 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539586 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539589 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 21:21:16.578302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539594 2584 flags.go:64] FLAG: --feature-gates="" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539597 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539600 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539603 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539606 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539609 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539612 2584 flags.go:64] FLAG: --help="false" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539615 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-133-215.ec2.internal" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539620 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539623 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539625 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539629 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539632 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539635 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539638 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539641 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539644 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539647 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539650 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539652 2584 flags.go:64] FLAG: --kube-reserved="" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539655 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539658 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539661 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539664 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 21:21:16.579706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539667 2584 flags.go:64] FLAG: --lock-file="" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539670 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539673 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539676 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539681 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539684 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539687 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539689 2584 flags.go:64] FLAG: --logging-format="text" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539694 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539697 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539701 2584 flags.go:64] FLAG: --manifest-url="" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539704 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539708 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539711 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539715 2584 flags.go:64] FLAG: --max-pods="110" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539718 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539722 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539725 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539728 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539731 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539734 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539737 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539744 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539748 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539751 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 21:21:16.580926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539754 2584 flags.go:64] FLAG: --pod-cidr="" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539757 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539763 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539766 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539769 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539771 2584 flags.go:64] FLAG: --port="10250" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539774 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539778 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2ed55471b176b6f" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539782 2584 flags.go:64] FLAG: --qos-reserved="" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539785 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539787 2584 flags.go:64] FLAG: --register-node="true" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539790 2584 flags.go:64] FLAG: --register-with-taints="" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539794 2584 flags.go:64] FLAG: --registry-burst="10" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539797 2584 flags.go:64] FLAG: --registry-qps="5" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539800 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539803 2584 flags.go:64] FLAG: --reserved-memory="" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539808 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539811 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539814 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539817 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539819 2584 flags.go:64] FLAG: --runonce="false" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539822 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539825 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539829 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539832 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 21:21:16.839467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539835 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 21:21:16.607068 ip-10-0-133-215 systemd[1]: Started Kubernetes Kubelet. Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539838 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539841 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539844 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539847 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539850 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539853 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539856 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539859 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539862 2584 flags.go:64] FLAG: --system-cgroups="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539865 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539871 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539873 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539876 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539880 2584 flags.go:64] FLAG: --tls-min-version="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539884 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539886 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539889 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539892 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539895 2584 flags.go:64] FLAG: --v="2" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539899 2584 flags.go:64] FLAG: --version="false" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539903 2584 flags.go:64] FLAG: --vmodule="" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539906 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.539911 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540083 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 21:21:16.856643 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540093 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540097 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540100 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540103 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540106 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540109 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540112 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540115 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540117 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540120 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540123 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540125 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540128 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540130 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540133 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540136 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540139 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540142 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540144 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540146 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 21:21:16.858996 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540149 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540152 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540155 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540158 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540161 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540163 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540169 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540171 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540174 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540177 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540180 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540183 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540186 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540189 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540192 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540195 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540197 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540200 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540202 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540205 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 21:21:16.860119 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540207 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540210 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540212 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540215 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540217 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540220 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540222 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540225 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540227 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540230 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540232 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540235 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540237 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540240 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540242 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540245 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540247 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540249 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540253 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540256 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 21:21:16.861721 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540260 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540262 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540265 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540267 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540270 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540273 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540276 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540279 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540281 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540284 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540286 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540289 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540291 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540294 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540296 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540299 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540303 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540308 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540311 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 21:21:16.862520 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540314 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540317 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540320 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540324 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540327 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540330 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540333 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540336 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540339 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540341 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540344 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540348 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540351 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540355 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540358 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540381 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540386 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540389 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 21:21:16.864893 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.540391 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.540398 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.547643 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.547662 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.547682 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.547692 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547748 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547754 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547757 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547760 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547763 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547767 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547770 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547773 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 21:21:16.865840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547776 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547779 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547783 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547785 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547788 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547791 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547793 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547796 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547799 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547801 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547804 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547807 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547810 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547813 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547815 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547818 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547820 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547824 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547827 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547829 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 21:21:16.867005 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547832 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547835 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547837 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547840 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547843 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547845 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547848 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547850 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547853 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547855 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547858 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547860 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547863 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547865 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547868 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547870 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547873 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547875 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547878 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547880 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 21:21:16.867822 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547883 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547886 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547889 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547891 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547894 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547897 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547901 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547905 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547908 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547915 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547917 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547920 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547923 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547925 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547928 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547931 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547934 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547938 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547941 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 21:21:16.869369 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547944 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547947 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547950 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547952 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547955 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547958 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547960 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547963 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547965 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547968 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547971 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547973 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547976 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547978 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547981 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547985 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547989 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547992 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547995 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 21:21:16.870166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.547999 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548002 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548004 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548010 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548013 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548015 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548018 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548021 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548023 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548026 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548028 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548031 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548033 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.548039 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548154 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 21:21:16.871756 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548159 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548162 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548166 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548168 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548171 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548174 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548177 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548179 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548182 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548184 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548187 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548190 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548192 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548195 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548197 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548200 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548202 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548205 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548208 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548211 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 21:21:16.872503 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548215 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548219 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548222 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548226 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548230 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548232 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548235 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548238 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548240 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548243 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548245 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548248 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548250 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548254 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548257 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548260 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548263 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548266 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 21:21:16.874056 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548269 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548272 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548274 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548277 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548280 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548283 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548285 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548287 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548290 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548292 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548295 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548298 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548300 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548303 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548307 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548311 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548313 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548316 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548318 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548321 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 10 21:21:16.874840 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548324 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548326 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548329 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548331 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548334 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548336 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548339 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548342 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548344 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548347 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548349 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548352 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548354 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548374 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548379 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548384 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548388 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548392 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548396 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 21:21:16.876456 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548398 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548401 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548403 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548406 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548409 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548411 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548414 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548418 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548423 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548425 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548428 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548431 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548433 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548436 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548439 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548441 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548444 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548447 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548449 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548452 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 21:21:16.877227 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:16.548455 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.548460 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.548594 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.550590 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.552159 2584 server.go:1019] "Starting client certificate rotation" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.552256 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.552300 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.554474 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.555625 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.570981 2584 log.go:25] "Validated CRI v1 runtime API" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.573252 2584 log.go:25] "Validated CRI v1 image API" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.574824 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 21:21:16.878804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.579663 2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9c02ad10-6bee-4eb4-a1df-f493b25d7505:/dev/nvme0n1p4 fc469589-3e24-4459-b2b8-8d7a9d940baa:/dev/nvme0n1p3] Jul 10 21:21:16.879578 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.579685 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.585396 2584 manager.go:216] Machine: {Timestamp:2026-07-10 21:21:16.584142418 +0000 UTC m=+0.337644287 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100176 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27f6ed075be3591153678849fef393 SystemUUID:ec27f6ed-075b-e359-1153-678849fef393 BootID:3bb7ab5e-b512-46dc-9db4-650e6044f0d2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:39:76:83:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:39:76:83:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:bd:b6:73:ec:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.585510 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.585646 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.586837 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.588685 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.588717 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 21:21:16.880354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.589574 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.589584 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.589592 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.590302 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.591689 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595054 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595205 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595238 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595253 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595271 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595282 2584 kubelet.go:398] "Adding apiserver pod source" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595292 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595704 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.595720 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.598542 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600486 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600520 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600684 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600703 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600715 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600765 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600787 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.600805 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.601174 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.601181 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.601189 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.601196 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.601216 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.601225 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.602192 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.602202 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.606036 2584 server.go:1268] "Started kubelet" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.606139 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.606145 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.606238 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.609092 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.612125 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.613642 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.613656 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 21:21:16.880750 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.613829 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.613483 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-215.ec2.internal.18c10a8101659ac5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-215.ec2.internal,UID:ip-10-0-133-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-215.ec2.internal,},FirstTimestamp:2026-07-10 21:21:16.605921989 +0000 UTC m=+0.359423861,LastTimestamp:2026-07-10 21:21:16.605921989 +0000 UTC m=+0.359423861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-215.ec2.internal,}" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.614787 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.616664 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfhr9" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.618666 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.618686 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.618756 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619344 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619382 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619412 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619539 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619547 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619730 2584 factory.go:55] Registering systemd factory Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.619767 2584 factory.go:223] Registration of the systemd container factory successfully Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.620004 2584 factory.go:153] Registering CRI-O factory Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.620017 2584 factory.go:223] Registration of the crio container factory successfully Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.620075 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.620105 2584 factory.go:103] Registering Raw factory Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.620122 2584 manager.go:1196] Started watching for new ooms in manager Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.620658 2584 manager.go:349] Starting recovery of all containers Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.626084 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfhr9" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.628014 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.628137 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.631088 2584 manager.go:354] Recovery completed Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.641581 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.643580 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.643606 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.643618 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644134 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644145 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644162 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644147 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.881929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644868 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644894 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.644904 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.645345 2584 policy_none.go:49] "None policy: Start" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.645358 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.645369 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.646337 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-215.ec2.internal.18c10a8103a465d0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-215.ec2.internal,UID:ip-10-0-133-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-215.ec2.internal,},FirstTimestamp:2026-07-10 21:21:16.643591632 +0000 UTC m=+0.397093504,LastTimestamp:2026-07-10 21:21:16.643591632 +0000 UTC m=+0.397093504,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-215.ec2.internal,}" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.646507 2584 policy_none.go:47] "Start" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697152 2584 manager.go:337] "Starting Device Plugin manager" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.697370 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697384 2584 server.go:87] "Starting device plugin registration server" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697685 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697697 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697792 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697876 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.697885 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.698533 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.698595 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.803995 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.805079 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.805110 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.805122 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.805150 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-215.ec2.internal" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.814093 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-215.ec2.internal" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.814116 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-215.ec2.internal\": node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.827352 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.844210 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.845777 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.845831 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.845868 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.845930 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 21:21:16.883110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.850517 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:16.928161 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.946352 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal"] Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.946450 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.948728 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.948773 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.948785 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.950167 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.950312 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.950386 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.951853 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.951870 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.951883 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.951898 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.951901 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.951914 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.953458 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.953482 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.954336 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientMemory" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.954361 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 21:21:16.987434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:16.954370 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeHasSufficientPID" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.011306 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-215.ec2.internal\" not found" node="ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.016405 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-215.ec2.internal\" not found" node="ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.029294 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.121059 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe505f46f1b45635c364d3034a731eed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal\" (UID: \"fe505f46f1b45635c364d3034a731eed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.121094 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe505f46f1b45635c364d3034a731eed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal\" (UID: \"fe505f46f1b45635c364d3034a731eed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.121116 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/031319088d640a8fab42271de4675103-config\") pod \"kube-apiserver-proxy-ip-10-0-133-215.ec2.internal\" (UID: \"031319088d640a8fab42271de4675103\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.129730 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.226351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe505f46f1b45635c364d3034a731eed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal\" (UID: \"fe505f46f1b45635c364d3034a731eed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.226409 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe505f46f1b45635c364d3034a731eed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal\" (UID: \"fe505f46f1b45635c364d3034a731eed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.226434 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/031319088d640a8fab42271de4675103-config\") pod \"kube-apiserver-proxy-ip-10-0-133-215.ec2.internal\" (UID: \"031319088d640a8fab42271de4675103\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.226433 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe505f46f1b45635c364d3034a731eed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal\" (UID: \"fe505f46f1b45635c364d3034a731eed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.226476 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/031319088d640a8fab42271de4675103-config\") pod \"kube-apiserver-proxy-ip-10-0-133-215.ec2.internal\" (UID: \"031319088d640a8fab42271de4675103\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.226511 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe505f46f1b45635c364d3034a731eed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal\" (UID: \"fe505f46f1b45635c364d3034a731eed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.274079 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.230799 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.528748 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.313797 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.528748 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.319842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.528748 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.331644 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.528748 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.431967 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.715004 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.532962 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.715004 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.550983 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 21:21:17.715004 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.551193 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 21:21:17.715004 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.630261 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 21:16:17 +0000 UTC" deadline="2027-12-30 05:08:57.552406461 +0000 UTC" Jul 10 21:21:17.715004 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.630289 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12895h47m39.922121416s" Jul 10 21:21:17.715004 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.633016 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.734496 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.733449 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.836737 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:17.834586 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-215.ec2.internal\" not found" Jul 10 21:21:17.938526 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.858483 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 21:21:17.938526 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.919788 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.938526 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.932057 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 21:21:17.938526 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.934221 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" Jul 10 21:21:17.947876 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:17.945324 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 21:21:18.150630 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.150601 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 21:21:18.242820 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.242782 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe505f46f1b45635c364d3034a731eed.slice/crio-90a6b126818f3bd0a22219df9a5a2ef7f76ecdca463416370ee610617b84772b WatchSource:0}: Error finding container 90a6b126818f3bd0a22219df9a5a2ef7f76ecdca463416370ee610617b84772b: Status 404 returned error can't find the container with id 90a6b126818f3bd0a22219df9a5a2ef7f76ecdca463416370ee610617b84772b Jul 10 21:21:18.250797 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.250772 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 21:21:18.255318 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.255292 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031319088d640a8fab42271de4675103.slice/crio-f5a9a0d8a5b94e3aeb12c15d734cca5e5016a88c7975bd1d50bc9e314c286ea2 WatchSource:0}: Error finding container f5a9a0d8a5b94e3aeb12c15d734cca5e5016a88c7975bd1d50bc9e314c286ea2: Status 404 returned error can't find the container with id f5a9a0d8a5b94e3aeb12c15d734cca5e5016a88c7975bd1d50bc9e314c286ea2 Jul 10 21:21:18.555016 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.554924 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 21:21:18.597511 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.597476 2584 apiserver.go:52] "Watching apiserver" Jul 10 21:21:18.605799 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.605767 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 21:21:18.606438 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.606396 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-bkl6p","openshift-dns/node-resolver-lpmxw","openshift-multus/multus-2cwrg","openshift-network-diagnostics/network-check-target-mltmx","openshift-image-registry/node-ca-8ml6k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal","openshift-multus/multus-additional-cni-plugins-kbgrd","openshift-multus/network-metrics-daemon-rqxlb","openshift-network-operator/iptables-alerter-c94jh","openshift-ovn-kubernetes/ovnkube-node-984zm","kube-system/global-pull-secret-syncer-x6qht","kube-system/konnectivity-agent-phllf","kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s"] Jul 10 21:21:18.609041 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.609016 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.611291 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.611225 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.611396 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.611323 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:18.612335 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.612299 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 21:21:18.612471 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.612398 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.612553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.612488 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.612640 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.612612 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 21:21:18.612903 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.612883 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 21:21:18.613053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.613037 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qsz77\"" Jul 10 21:21:18.613746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.613721 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.615947 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.615920 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:18.616047 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.615994 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:18.616244 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.616220 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 21:21:18.616327 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.616249 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7v5bn\"" Jul 10 21:21:18.618678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.618656 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.619171 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.619146 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 21:21:18.620815 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.620792 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.621165 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.621143 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.621391 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.621349 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.621503 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.621487 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 21:21:18.621568 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.621535 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k57g9\"" Jul 10 21:21:18.623147 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.623125 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 21:21:18.623263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.623209 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.623365 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.623344 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.623677 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.623657 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.623927 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.623907 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbrw2\"" Jul 10 21:21:18.625682 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.625660 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 21:21:18.625782 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.625751 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.625840 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.625789 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.626025 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.626008 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:18.626114 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.626091 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:18.627001 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.626805 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rgjzk\"" Jul 10 21:21:18.628596 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.628573 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.631255 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.631238 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.631356 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.631327 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.632134 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.632116 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.632531 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.632514 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-klbsf\"" Jul 10 21:21:18.636770 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.636407 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.637202 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637177 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a526c132-4aa9-4d61-9200-2837910d5036-host\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.637303 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637239 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtdd\" (UniqueName: \"kubernetes.io/projected/a526c132-4aa9-4d61-9200-2837910d5036-kube-api-access-9dtdd\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.637303 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637268 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-cnibin\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.637445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09212ae0-8295-4ea0-9733-b1d3fce33035-dbus\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.637521 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637502 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-multus-certs\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.637579 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637530 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.637579 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637573 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-socket-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637593 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-os-release\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637628 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637690 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637733 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-k8s-cni-cncf-io\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637762 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a526c132-4aa9-4d61-9200-2837910d5036-serviceca\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637795 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-cnibin\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cabc80a-2151-4a91-a311-497a9de223e5-cni-binary-copy\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.637870 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637856 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-socket-dir-parent\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637886 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-cni-multus\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637914 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-conf-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-registration-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637963 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-device-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.637985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cabc80a-2151-4a91-a311-497a9de223e5-multus-daemon-config\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-etc-selinux\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638051 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-system-cni-dir\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638115 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-cni-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638142 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-etc-kubernetes\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638214 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr7xc\" (UniqueName: \"kubernetes.io/projected/5cabc80a-2151-4a91-a311-497a9de223e5-kube-api-access-qr7xc\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638254 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638283 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-system-cni-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638307 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-netns\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-cni-bin\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-kubelet\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638404 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638429 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-sys-fs\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638454 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09212ae0-8295-4ea0-9733-b1d3fce33035-kubelet-config\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638498 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-922dm\" (UniqueName: \"kubernetes.io/projected/13bba8d7-9caf-46c6-8788-db3ba0828325-kube-api-access-922dm\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638577 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9fb\" (UniqueName: \"kubernetes.io/projected/6c85aef8-05f9-4817-9616-9283952dd98d-kube-api-access-4l9fb\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638602 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-os-release\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.638810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638627 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-hostroot\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.639368 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.638998 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.639987 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.639893 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.639987 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.639907 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 21:21:18.640192 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.639959 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 21:21:18.640192 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.640179 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.640344 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.640278 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 21:21:18.640432 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.640382 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cqfbj\"" Jul 10 21:21:18.640516 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.640475 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 21:21:18.640659 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.640522 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dqhx\"" Jul 10 21:21:18.640909 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.640892 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 21:21:18.641501 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.641453 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 21:21:18.641668 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.641645 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 21:21:18.642467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.642431 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 21:21:18.642628 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.642610 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pnnkk\"" Jul 10 21:21:18.643832 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.643805 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 21:21:18.671576 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.671546 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vbb26" Jul 10 21:21:18.683781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.683754 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vbb26" Jul 10 21:21:18.720733 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.720705 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 21:21:18.739185 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-socket-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.739185 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739087 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3caa1730-b530-42fe-8626-91237cfb5a26-iptables-alerter-script\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.739185 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739163 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.739525 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3caa1730-b530-42fe-8626-91237cfb5a26-host-slash\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.739525 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739235 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-kubernetes\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.739525 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739431 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-socket-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.739525 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739498 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysctl-conf\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.739525 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739526 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-systemd\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739560 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-lib-modules\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739591 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739622 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-systemd\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739651 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-cnibin\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cabc80a-2151-4a91-a311-497a9de223e5-cni-binary-copy\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739751 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-socket-dir-parent\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.739926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.739878 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-cnibin\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.740311 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740274 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-socket-dir-parent\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.740407 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740382 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-cni-multus\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.740488 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-conf-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.740488 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740470 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-registration-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.740603 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740535 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cabc80a-2151-4a91-a311-497a9de223e5-multus-daemon-config\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.740603 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740573 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-etc-selinux\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.740797 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740601 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-system-cni-dir\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.740797 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740676 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq89s\" (UniqueName: \"kubernetes.io/projected/3caa1730-b530-42fe-8626-91237cfb5a26-kube-api-access-vq89s\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.740797 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740707 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-tmp-dir\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.740797 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740739 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-registration-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.740797 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740785 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-run-netns\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-conf-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740854 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-cni-multus\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740866 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-device-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740862 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cabc80a-2151-4a91-a311-497a9de223e5-cni-binary-copy\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740898 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-system-cni-dir\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.740985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-cni-netd\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741010 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-etc-selinux\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741022 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-device-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.741048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741051 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-cni-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741077 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr7xc\" (UniqueName: \"kubernetes.io/projected/5cabc80a-2151-4a91-a311-497a9de223e5-kube-api-access-qr7xc\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ffb\" (UniqueName: \"kubernetes.io/projected/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-kube-api-access-s4ffb\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741148 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-systemd-units\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-var-lib-kubelet\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741206 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-tuned\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741233 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zsjb\" (UniqueName: \"kubernetes.io/projected/60c868cc-7053-4da4-aa64-0ce65224e4eb-kube-api-access-2zsjb\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741253 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-multus-cni-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741281 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-kubelet\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741350 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-sys-fs\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741401 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09212ae0-8295-4ea0-9733-b1d3fce33035-kubelet-config\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741457 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-log-socket\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741461 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cabc80a-2151-4a91-a311-497a9de223e5-multus-daemon-config\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.741590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-env-overrides\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741559 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-sys-fs\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741548 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovn-node-metrics-cert\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741593 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09212ae0-8295-4ea0-9733-b1d3fce33035-kubelet-config\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741616 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-922dm\" (UniqueName: \"kubernetes.io/projected/13bba8d7-9caf-46c6-8788-db3ba0828325-kube-api-access-922dm\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741632 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-kubelet\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741645 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-etc-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-modprobe-d\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtdd\" (UniqueName: \"kubernetes.io/projected/a526c132-4aa9-4d61-9200-2837910d5036-kube-api-access-9dtdd\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741804 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-cnibin\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741834 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09212ae0-8295-4ea0-9733-b1d3fce33035-dbus\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741874 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-multus-certs\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741954 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09212ae0-8295-4ea0-9733-b1d3fce33035-dbus\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.742154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.741979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742004 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-cnibin\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742033 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-os-release\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742073 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742125 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-os-release\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742163 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-hosts-file\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742177 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13bba8d7-9caf-46c6-8788-db3ba0828325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742187 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-kubelet\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742226 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysctl-d\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742253 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-k8s-cni-cncf-io\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742290 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a526c132-4aa9-4d61-9200-2837910d5036-serviceca\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-run\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742339 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c868cc-7053-4da4-aa64-0ce65224e4eb-tmp\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.742822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742360 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-slash\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742411 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysconfig\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742500 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-etc-kubernetes\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742616 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-var-lib-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742655 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-ovn\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742685 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-node-log\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovnkube-script-lib\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.742727 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742773 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/259b83cc-695a-4aa7-abf1-2a80b02ec3f6-agent-certs\") pod \"konnectivity-agent-phllf\" (UID: \"259b83cc-695a-4aa7-abf1-2a80b02ec3f6\") " pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742815 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.742829 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:19.242792283 +0000 UTC m=+2.996294163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742228 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-multus-certs\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742874 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c85aef8-05f9-4817-9616-9283952dd98d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.743263 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742877 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-system-cni-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742904 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-etc-kubernetes\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.742935 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-netns\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743003 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-system-cni-dir\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-cni-bin\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743025 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-k8s-cni-cncf-io\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743090 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-run-netns\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-host-var-lib-cni-bin\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743100 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9klb\" (UniqueName: \"kubernetes.io/projected/63ae0429-5bf0-491c-bff1-7b7957d3d956-kube-api-access-q9klb\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743130 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743146 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9fb\" (UniqueName: \"kubernetes.io/projected/6c85aef8-05f9-4817-9616-9283952dd98d-kube-api-access-4l9fb\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743170 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzt2\" (UniqueName: \"kubernetes.io/projected/041c0aac-c728-43d5-972a-42029ab6f2fa-kube-api-access-zwzt2\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743091 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a526c132-4aa9-4d61-9200-2837910d5036-serviceca\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.743985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743186 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-cni-bin\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743286 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovnkube-config\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743336 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/259b83cc-695a-4aa7-abf1-2a80b02ec3f6-konnectivity-ca\") pod \"konnectivity-agent-phllf\" (UID: \"259b83cc-695a-4aa7-abf1-2a80b02ec3f6\") " pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743368 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c85aef8-05f9-4817-9616-9283952dd98d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743390 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-os-release\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743521 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-os-release\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-hostroot\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743595 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a526c132-4aa9-4d61-9200-2837910d5036-host\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743631 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cabc80a-2151-4a91-a311-497a9de223e5-hostroot\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743675 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-run-ovn-kubernetes\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-sys\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743770 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a526c132-4aa9-4d61-9200-2837910d5036-host\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.744862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.743782 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-host\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.755749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.755713 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 21:21:18.760605 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.759874 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:18.760605 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.759902 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:18.760605 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.759917 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:18.760605 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.760007 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:21:19.2599809 +0000 UTC m=+3.013482782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:18.765622 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.765174 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtdd\" (UniqueName: \"kubernetes.io/projected/a526c132-4aa9-4d61-9200-2837910d5036-kube-api-access-9dtdd\") pod \"node-ca-8ml6k\" (UID: \"a526c132-4aa9-4d61-9200-2837910d5036\") " pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.766280 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.766196 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9fb\" (UniqueName: \"kubernetes.io/projected/6c85aef8-05f9-4817-9616-9283952dd98d-kube-api-access-4l9fb\") pod \"multus-additional-cni-plugins-kbgrd\" (UID: \"6c85aef8-05f9-4817-9616-9283952dd98d\") " pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.766720 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.766696 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr7xc\" (UniqueName: \"kubernetes.io/projected/5cabc80a-2151-4a91-a311-497a9de223e5-kube-api-access-qr7xc\") pod \"multus-2cwrg\" (UID: \"5cabc80a-2151-4a91-a311-497a9de223e5\") " pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.768665 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.768645 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-922dm\" (UniqueName: \"kubernetes.io/projected/13bba8d7-9caf-46c6-8788-db3ba0828325-kube-api-access-922dm\") pod \"aws-ebs-csi-driver-node-z857s\" (UID: \"13bba8d7-9caf-46c6-8788-db3ba0828325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.844297 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-var-lib-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844297 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844246 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-ovn\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844297 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844273 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-node-log\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844297 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovnkube-script-lib\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/259b83cc-695a-4aa7-abf1-2a80b02ec3f6-agent-certs\") pod \"konnectivity-agent-phllf\" (UID: \"259b83cc-695a-4aa7-abf1-2a80b02ec3f6\") " pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844355 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844382 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9klb\" (UniqueName: \"kubernetes.io/projected/63ae0429-5bf0-491c-bff1-7b7957d3d956-kube-api-access-q9klb\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzt2\" (UniqueName: \"kubernetes.io/projected/041c0aac-c728-43d5-972a-42029ab6f2fa-kube-api-access-zwzt2\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844452 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-cni-bin\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844476 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovnkube-config\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844500 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/259b83cc-695a-4aa7-abf1-2a80b02ec3f6-konnectivity-ca\") pod \"konnectivity-agent-phllf\" (UID: \"259b83cc-695a-4aa7-abf1-2a80b02ec3f6\") " pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844531 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-run-ovn-kubernetes\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844555 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-sys\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844579 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-host\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844607 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3caa1730-b530-42fe-8626-91237cfb5a26-iptables-alerter-script\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.844652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844633 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3caa1730-b530-42fe-8626-91237cfb5a26-host-slash\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844686 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-kubernetes\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844709 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysctl-conf\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-systemd\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-lib-modules\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-systemd\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq89s\" (UniqueName: \"kubernetes.io/projected/3caa1730-b530-42fe-8626-91237cfb5a26-kube-api-access-vq89s\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-tmp-dir\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-run-netns\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844917 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-cni-netd\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ffb\" (UniqueName: \"kubernetes.io/projected/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-kube-api-access-s4ffb\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.844979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-systemd-units\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-var-lib-kubelet\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.845301 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845043 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-tuned\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845070 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zsjb\" (UniqueName: \"kubernetes.io/projected/60c868cc-7053-4da4-aa64-0ce65224e4eb-kube-api-access-2zsjb\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-log-socket\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845168 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-env-overrides\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845194 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovn-node-metrics-cert\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-etc-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845256 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-modprobe-d\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845286 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-hosts-file\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845355 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-kubelet\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845383 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysctl-d\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845409 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-run\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845432 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c868cc-7053-4da4-aa64-0ce65224e4eb-tmp\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-slash\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845539 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysconfig\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845718 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysconfig\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.846781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845790 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-var-lib-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845846 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-ovn\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.846781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.845882 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-node-log\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.847813 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-tmp-dir\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.847955 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:18.848027 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:21:19.348008935 +0000 UTC m=+3.101510811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848326 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-var-lib-kubelet\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848396 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-run-netns\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848463 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-cni-netd\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848498 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-etc-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848504 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-cni-bin\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848645 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-modprobe-d\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848694 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-openvswitch\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848745 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-hosts-file\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848783 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-systemd-units\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848796 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovnkube-script-lib\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.849931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848833 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3caa1730-b530-42fe-8626-91237cfb5a26-host-slash\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-run-ovn-kubernetes\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848891 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-log-socket\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.848938 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-sys\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849000 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-host\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849155 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-kubelet\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849247 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-kubernetes\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849403 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysctl-conf\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849471 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-run-systemd\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849532 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3caa1730-b530-42fe-8626-91237cfb5a26-iptables-alerter-script\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849631 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-run\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849664 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-lib-modules\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849784 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-sysctl-d\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849837 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63ae0429-5bf0-491c-bff1-7b7957d3d956-host-slash\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.850706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849883 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-env-overrides\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.851533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.849889 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-systemd\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.851533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.850246 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovnkube-config\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.851533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.850653 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/259b83cc-695a-4aa7-abf1-2a80b02ec3f6-konnectivity-ca\") pod \"konnectivity-agent-phllf\" (UID: \"259b83cc-695a-4aa7-abf1-2a80b02ec3f6\") " pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.853377 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.853326 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" event={"ID":"031319088d640a8fab42271de4675103","Type":"ContainerStarted","Data":"f5a9a0d8a5b94e3aeb12c15d734cca5e5016a88c7975bd1d50bc9e314c286ea2"} Jul 10 21:21:18.854592 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.854536 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63ae0429-5bf0-491c-bff1-7b7957d3d956-ovn-node-metrics-cert\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.854758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.854736 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60c868cc-7053-4da4-aa64-0ce65224e4eb-etc-tuned\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.856252 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.856180 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" event={"ID":"fe505f46f1b45635c364d3034a731eed","Type":"ContainerStarted","Data":"90a6b126818f3bd0a22219df9a5a2ef7f76ecdca463416370ee610617b84772b"} Jul 10 21:21:18.856897 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.856853 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/259b83cc-695a-4aa7-abf1-2a80b02ec3f6-agent-certs\") pod \"konnectivity-agent-phllf\" (UID: \"259b83cc-695a-4aa7-abf1-2a80b02ec3f6\") " pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:18.857174 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.857136 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60c868cc-7053-4da4-aa64-0ce65224e4eb-tmp\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.861160 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.861104 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzt2\" (UniqueName: \"kubernetes.io/projected/041c0aac-c728-43d5-972a-42029ab6f2fa-kube-api-access-zwzt2\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:18.861924 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.861881 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zsjb\" (UniqueName: \"kubernetes.io/projected/60c868cc-7053-4da4-aa64-0ce65224e4eb-kube-api-access-2zsjb\") pod \"tuned-bkl6p\" (UID: \"60c868cc-7053-4da4-aa64-0ce65224e4eb\") " pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.862781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.862281 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ffb\" (UniqueName: \"kubernetes.io/projected/61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c-kube-api-access-s4ffb\") pod \"node-resolver-lpmxw\" (UID: \"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c\") " pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.862781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.862743 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9klb\" (UniqueName: \"kubernetes.io/projected/63ae0429-5bf0-491c-bff1-7b7957d3d956-kube-api-access-q9klb\") pod \"ovnkube-node-984zm\" (UID: \"63ae0429-5bf0-491c-bff1-7b7957d3d956\") " pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.863281 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.863256 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq89s\" (UniqueName: \"kubernetes.io/projected/3caa1730-b530-42fe-8626-91237cfb5a26-kube-api-access-vq89s\") pod \"iptables-alerter-c94jh\" (UID: \"3caa1730-b530-42fe-8626-91237cfb5a26\") " pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.923313 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.923045 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" Jul 10 21:21:18.931770 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.931609 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cwrg" Jul 10 21:21:18.938030 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.937998 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c85aef8_05f9_4817_9616_9283952dd98d.slice/crio-e74d1b00bc562b265d8ce865090078af7d4d2ddb26b123605a8d28192f334160 WatchSource:0}: Error finding container e74d1b00bc562b265d8ce865090078af7d4d2ddb26b123605a8d28192f334160: Status 404 returned error can't find the container with id e74d1b00bc562b265d8ce865090078af7d4d2ddb26b123605a8d28192f334160 Jul 10 21:21:18.943461 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.942802 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ml6k" Jul 10 21:21:18.946363 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.946337 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cabc80a_2151_4a91_a311_497a9de223e5.slice/crio-cbc1e238fe908d9ed2b5847215aa26fc96487d14a297819b66552ad98e899e08 WatchSource:0}: Error finding container cbc1e238fe908d9ed2b5847215aa26fc96487d14a297819b66552ad98e899e08: Status 404 returned error can't find the container with id cbc1e238fe908d9ed2b5847215aa26fc96487d14a297819b66552ad98e899e08 Jul 10 21:21:18.949689 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.949664 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" Jul 10 21:21:18.957162 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.957120 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda526c132_4aa9_4d61_9200_2837910d5036.slice/crio-1111154dcefdad9a73b667115b79ff46ce296c2fe058027030ecd70c9eb92c66 WatchSource:0}: Error finding container 1111154dcefdad9a73b667115b79ff46ce296c2fe058027030ecd70c9eb92c66: Status 404 returned error can't find the container with id 1111154dcefdad9a73b667115b79ff46ce296c2fe058027030ecd70c9eb92c66 Jul 10 21:21:18.958488 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.958289 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c94jh" Jul 10 21:21:18.966996 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.966969 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lpmxw" Jul 10 21:21:18.975047 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.975017 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:18.976477 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.976417 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3caa1730_b530_42fe_8626_91237cfb5a26.slice/crio-fc6f53940eec3976111ce1db3fba7c1e4318d3d4d7febee2d532097b20a90449 WatchSource:0}: Error finding container fc6f53940eec3976111ce1db3fba7c1e4318d3d4d7febee2d532097b20a90449: Status 404 returned error can't find the container with id fc6f53940eec3976111ce1db3fba7c1e4318d3d4d7febee2d532097b20a90449 Jul 10 21:21:18.978689 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:18.978571 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bba8d7_9caf_46c6_8788_db3ba0828325.slice/crio-990be6f1acc3b17d69db36b419cbf9ddbad8b3a28e470b9e4eb9d3a07600a70f WatchSource:0}: Error finding container 990be6f1acc3b17d69db36b419cbf9ddbad8b3a28e470b9e4eb9d3a07600a70f: Status 404 returned error can't find the container with id 990be6f1acc3b17d69db36b419cbf9ddbad8b3a28e470b9e4eb9d3a07600a70f Jul 10 21:21:18.983245 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.983226 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" Jul 10 21:21:18.989325 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:18.989299 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:19.008348 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.008319 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 21:21:19.010198 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:21:19.010075 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259b83cc_695a_4aa7_abf1_2a80b02ec3f6.slice/crio-406aa3d9cecc8015f3a3e766c0c2c4fa50670caa8349a425055560fd7b4490f2 WatchSource:0}: Error finding container 406aa3d9cecc8015f3a3e766c0c2c4fa50670caa8349a425055560fd7b4490f2: Status 404 returned error can't find the container with id 406aa3d9cecc8015f3a3e766c0c2c4fa50670caa8349a425055560fd7b4490f2 Jul 10 21:21:19.249075 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.248986 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:19.249254 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.249182 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:19.249318 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.249282 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:20.249252104 +0000 UTC m=+4.002753967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:19.354114 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.354077 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:19.354299 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.354171 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:21:20.354147485 +0000 UTC m=+4.107649347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:19.354299 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.353702 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:19.354434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.354293 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:19.354490 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.354439 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:19.354490 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.354456 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:19.354490 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.354468 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:19.354633 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.354518 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:21:20.354504449 +0000 UTC m=+4.108006306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:19.687047 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.686866 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 21:16:19 +0000 UTC" deadline="2028-01-17 07:02:54.048077102 +0000 UTC" Jul 10 21:21:19.687047 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.686932 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13329h41m34.361149028s" Jul 10 21:21:19.846938 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.846896 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:19.847811 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:19.847042 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:19.861369 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.861283 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-phllf" event={"ID":"259b83cc-695a-4aa7-abf1-2a80b02ec3f6","Type":"ContainerStarted","Data":"406aa3d9cecc8015f3a3e766c0c2c4fa50670caa8349a425055560fd7b4490f2"} Jul 10 21:21:19.864961 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.864877 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"644e4d23c67f476558c4966d544190fb803666a9e7349a064752a4a997da5c10"} Jul 10 21:21:19.873545 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.873510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c94jh" event={"ID":"3caa1730-b530-42fe-8626-91237cfb5a26","Type":"ContainerStarted","Data":"fc6f53940eec3976111ce1db3fba7c1e4318d3d4d7febee2d532097b20a90449"} Jul 10 21:21:19.882017 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.881987 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" event={"ID":"13bba8d7-9caf-46c6-8788-db3ba0828325","Type":"ContainerStarted","Data":"990be6f1acc3b17d69db36b419cbf9ddbad8b3a28e470b9e4eb9d3a07600a70f"} Jul 10 21:21:19.890394 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.890361 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ml6k" event={"ID":"a526c132-4aa9-4d61-9200-2837910d5036","Type":"ContainerStarted","Data":"1111154dcefdad9a73b667115b79ff46ce296c2fe058027030ecd70c9eb92c66"} Jul 10 21:21:19.900401 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.900369 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerStarted","Data":"e74d1b00bc562b265d8ce865090078af7d4d2ddb26b123605a8d28192f334160"} Jul 10 21:21:19.903198 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.903167 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" event={"ID":"60c868cc-7053-4da4-aa64-0ce65224e4eb","Type":"ContainerStarted","Data":"b30962014309235bcd1af9b5b7a4a765afb93e3c8729ef53da7e0aa79f7f56b0"} Jul 10 21:21:19.905627 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.905603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lpmxw" event={"ID":"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c","Type":"ContainerStarted","Data":"b8484551c1f8019cc4e95fb7791f785cc45963a641f231b99ac0c9078bc59418"} Jul 10 21:21:19.908028 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:19.907972 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cwrg" event={"ID":"5cabc80a-2151-4a91-a311-497a9de223e5","Type":"ContainerStarted","Data":"cbc1e238fe908d9ed2b5847215aa26fc96487d14a297819b66552ad98e899e08"} Jul 10 21:21:20.261814 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.261772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:20.262030 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.261941 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:20.262030 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.262024 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:22.262003693 +0000 UTC m=+6.015505558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:20.362497 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.362378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:20.362497 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.362490 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:20.362804 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.362624 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:20.362804 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.362689 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:21:22.362668969 +0000 UTC m=+6.116170833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:20.363135 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.363114 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:20.363211 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.363145 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:20.363211 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.363159 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:20.363211 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.363206 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:21:22.363189936 +0000 UTC m=+6.116691796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:20.687654 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.687548 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 21:16:19 +0000 UTC" deadline="2028-01-24 20:02:33.514747678 +0000 UTC" Jul 10 21:21:20.687654 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.687592 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13510h41m12.827161144s" Jul 10 21:21:20.846568 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.846532 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:20.846754 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.846680 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:20.847259 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:20.847214 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:20.847706 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:20.847341 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:21.846102 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:21.846071 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:21.846297 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:21.846209 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:22.279061 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:22.278980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:22.279569 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.279130 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:22.279569 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.279213 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:26.279187295 +0000 UTC m=+10.032689177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:22.380145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:22.380218 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.380379 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.380401 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.380434 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.380485 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.380513 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:21:26.380491494 +0000 UTC m=+10.133993356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:22.380917 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.380551 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:21:26.380531528 +0000 UTC m=+10.134033391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:22.847948 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:22.847908 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:22.848147 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.848063 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:22.848622 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:22.848596 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:22.848764 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:22.848732 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:23.846993 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:23.846958 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:23.847584 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:23.847118 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:24.846329 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:24.846157 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:24.846329 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:24.846212 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:24.846569 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:24.846320 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:24.846569 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:24.846486 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:25.846985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:25.846942 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:25.847550 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:25.847091 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:26.320356 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:26.320256 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:26.320562 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.320440 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:26.320562 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.320528 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:34.320505989 +0000 UTC m=+18.074007852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:26.420830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:26.420781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:26.421018 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:26.420878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:26.421018 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.420957 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:26.421166 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.421022 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:26.421166 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.421047 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:26.421166 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.421050 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:21:34.421025686 +0000 UTC m=+18.174527547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:26.421166 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.421060 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:26.421166 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.421112 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:21:34.421094618 +0000 UTC m=+18.174596480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:26.847894 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:26.847540 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:26.847894 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.847672 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:26.847894 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:26.847725 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:26.847894 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:26.847859 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:27.846274 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:27.846235 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:27.846484 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:27.846394 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:28.846879 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:28.846774 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:28.847343 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:28.846918 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:28.847343 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:28.847326 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:28.847484 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:28.847440 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:29.846233 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:29.846200 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:29.846407 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:29.846300 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:30.846406 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:30.846314 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:30.846406 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:30.846329 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:30.846833 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:30.846446 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:30.846833 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:30.846567 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:31.846795 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:31.846487 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:31.847224 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:31.846908 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:32.846753 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:32.846680 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:32.846948 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:32.846686 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:32.846948 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:32.846916 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:32.846948 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:32.846821 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:33.847043 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:33.846999 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:33.847615 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:33.847140 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:34.381737 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:34.381694 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:34.381893 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.381863 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:34.381952 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.381940 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.381923146 +0000 UTC m=+34.135425003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:34.482890 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:34.482797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:34.482890 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:34.482874 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:34.483099 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.482972 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:34.483099 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.483029 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.483016347 +0000 UTC m=+34.236518204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:34.483099 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.482973 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:34.483099 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.483080 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:34.483099 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.483096 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:34.483321 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.483141 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:21:50.483128206 +0000 UTC m=+34.236630081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:34.846504 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:34.846417 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:34.846504 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:34.846446 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:34.846715 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.846554 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:34.846715 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:34.846685 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:35.846921 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:35.846715 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:35.847388 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:35.847012 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:36.847567 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:36.847536 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:36.848032 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:36.847653 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:36.848032 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:36.847719 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:36.848032 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:36.847807 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:37.846148 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:37.846110 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:37.846310 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:37.846229 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:38.847221 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.846902 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:38.847221 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:38.847089 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:38.848048 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.847930 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:38.848048 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:38.848037 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:38.955789 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.954357 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lpmxw" event={"ID":"61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c","Type":"ContainerStarted","Data":"94b2f8cef8410702e090e848f8298dbe11ed6f8aa64fa48f4dbb17d23c791b7c"} Jul 10 21:21:38.959800 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.959774 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cwrg" event={"ID":"5cabc80a-2151-4a91-a311-497a9de223e5","Type":"ContainerStarted","Data":"382d4f4cb6efe9590bcf3bef90fa2021facdee2b3a2e83648525bb8f7449fc44"} Jul 10 21:21:38.963583 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.963545 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-phllf" event={"ID":"259b83cc-695a-4aa7-abf1-2a80b02ec3f6","Type":"ContainerStarted","Data":"122382f5d4518d11b17f504d0b393596aba993905c982ee13c3b7c321bd0ac9e"} Jul 10 21:21:38.966197 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.966170 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:21:38.966583 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.966558 2584 generic.go:356] "Generic (PLEG): container finished" podID="63ae0429-5bf0-491c-bff1-7b7957d3d956" containerID="8c7ee05a1b722cf9f7a78a8992093c39c7329e1e86b50ba7d662bb6cda22c030" exitCode=1 Jul 10 21:21:38.966673 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.966655 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"ec730e4bd1d6a762e2397d3feec650887a2d81617ca51817c3faba5ec12e22b8"} Jul 10 21:21:38.966756 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.966741 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerDied","Data":"8c7ee05a1b722cf9f7a78a8992093c39c7329e1e86b50ba7d662bb6cda22c030"} Jul 10 21:21:38.966814 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.966801 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"c640885f5a57c7374947ca582ce1de4a80a9f23488c422ba36718e1c22edc643"} Jul 10 21:21:38.968274 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.968253 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" event={"ID":"13bba8d7-9caf-46c6-8788-db3ba0828325","Type":"ContainerStarted","Data":"e4d66e2dffa196d6bf839b9cf53c76bf917a59dc4d045f07deaa385e5a1dcc77"} Jul 10 21:21:38.969900 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.969877 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ml6k" event={"ID":"a526c132-4aa9-4d61-9200-2837910d5036","Type":"ContainerStarted","Data":"60ccb93e3ac8ef56f9a36e8d81d7b07631a89f1fef5f79e3f758db9c5df4e1dd"} Jul 10 21:21:38.971553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.971525 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerStarted","Data":"0702db88832b4037602d2dd9379438a4c7965f75342db284484dcfccf0acc5c7"} Jul 10 21:21:38.973239 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.973214 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" event={"ID":"031319088d640a8fab42271de4675103","Type":"ContainerStarted","Data":"039ff8478e980a027e01c340b6ad595d163cab278d2ba23aa60d23be4fea1db5"} Jul 10 21:21:38.974430 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:38.974411 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" event={"ID":"60c868cc-7053-4da4-aa64-0ce65224e4eb","Type":"ContainerStarted","Data":"bccaaf2b05acedc3a7d772829663527563b17e51ce7e78a4ffff3e80e0a34272"} Jul 10 21:21:39.000461 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.000225 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lpmxw" podStartSLOduration=2.398418716 podStartE2EDuration="22.000203864s" totalImagesPullingTime="19.601785148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:38.9717225 +0000 UTC m=+22.725224379" watchObservedRunningTime="2026-07-10 21:21:39.000203864 +0000 UTC m=+22.753705765" Jul 10 21:21:39.035255 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.035200 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2cwrg" podStartSLOduration=2.348150145 podStartE2EDuration="22.035180327s" totalImagesPullingTime="19.687030182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:39.035145613 +0000 UTC m=+22.788647496" watchObservedRunningTime="2026-07-10 21:21:39.035180327 +0000 UTC m=+22.788682202" Jul 10 21:21:39.062157 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.061962 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-phllf" podStartSLOduration=2.490062554 podStartE2EDuration="22.061946259s" totalImagesPullingTime="19.571883705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:39.061845355 +0000 UTC m=+22.815347234" watchObservedRunningTime="2026-07-10 21:21:39.061946259 +0000 UTC m=+22.815448137" Jul 10 21:21:39.109161 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.109107 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8ml6k" podStartSLOduration=10.60950419 podStartE2EDuration="22.109086767s" totalImagesPullingTime="11.499582577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:39.108599271 +0000 UTC m=+22.862101152" watchObservedRunningTime="2026-07-10 21:21:39.109086767 +0000 UTC m=+22.862588646" Jul 10 21:21:39.109565 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.109540 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-215.ec2.internal" podStartSLOduration=21.109531327 podStartE2EDuration="21.109531327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:39.088284419 +0000 UTC m=+22.841786299" watchObservedRunningTime="2026-07-10 21:21:39.109531327 +0000 UTC m=+22.863033204" Jul 10 21:21:39.133299 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.133251 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bkl6p" podStartSLOduration=2.555532193 podStartE2EDuration="22.133236387s" totalImagesPullingTime="19.577704194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:39.132980373 +0000 UTC m=+22.886482252" watchObservedRunningTime="2026-07-10 21:21:39.133236387 +0000 UTC m=+22.886738265" Jul 10 21:21:39.846681 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.846637 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:39.846875 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:39.846750 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:39.979437 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.979413 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:21:39.980121 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.979725 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"cb040dcbbfc0215a9f1b2cb82084d196aa9ec727c40e129c57685561261d30e5"} Jul 10 21:21:39.980121 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.979797 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"5dc05dce55e557187335189c1a4fb3c34551716337117d7ef6f3540abb66af96"} Jul 10 21:21:39.980121 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.979828 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"81b16c61a23a69e1568c23608ef2cc3a9f7cfbc967474f23841f5f57f867ea5d"} Jul 10 21:21:39.981046 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.981024 2584 generic.go:356] "Generic (PLEG): container finished" podID="6c85aef8-05f9-4817-9616-9283952dd98d" containerID="0702db88832b4037602d2dd9379438a4c7965f75342db284484dcfccf0acc5c7" exitCode=0 Jul 10 21:21:39.981148 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.981094 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerDied","Data":"0702db88832b4037602d2dd9379438a4c7965f75342db284484dcfccf0acc5c7"} Jul 10 21:21:39.982445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.982425 2584 generic.go:356] "Generic (PLEG): container finished" podID="fe505f46f1b45635c364d3034a731eed" containerID="ff71d9e5a50cd37b68fc12872937cb39bb6241a6eb9c755baac01c166ac18d58" exitCode=0 Jul 10 21:21:39.982536 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:39.982520 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" event={"ID":"fe505f46f1b45635c364d3034a731eed","Type":"ContainerDied","Data":"ff71d9e5a50cd37b68fc12872937cb39bb6241a6eb9c755baac01c166ac18d58"} Jul 10 21:21:40.200292 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.200259 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 21:21:40.713943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.713813 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T21:21:40.200282518Z","UUID":"69568586-4eb3-4c0a-a080-8a8064da6e41","Handler":null,"Name":"","Endpoint":""} Jul 10 21:21:40.716212 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.716182 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 21:21:40.716386 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.716229 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 21:21:40.846611 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.846578 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:40.846611 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.846598 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:40.846856 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:40.846717 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:40.846856 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:40.846843 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:40.987297 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.987250 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" event={"ID":"13bba8d7-9caf-46c6-8788-db3ba0828325","Type":"ContainerStarted","Data":"c14f6b7985aa35bde3ed62a0665662a9c5f36356d85c4a4ba600f4deba1b585e"} Jul 10 21:21:40.989456 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.989416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" event={"ID":"fe505f46f1b45635c364d3034a731eed","Type":"ContainerStarted","Data":"ba6e8637b18d30257aea261d6440f6e30a09ef2ec88fba2ca2d4b7146eebd982"} Jul 10 21:21:40.991235 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:40.991112 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c94jh" event={"ID":"3caa1730-b530-42fe-8626-91237cfb5a26","Type":"ContainerStarted","Data":"d183ad5ae476bc0f4890c15e50afef373d890d614e1637aa25218e148b999275"} Jul 10 21:21:41.006622 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.006566 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-215.ec2.internal" podStartSLOduration=23.006545123 podStartE2EDuration="23.006545123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:41.006486239 +0000 UTC m=+24.759988122" watchObservedRunningTime="2026-07-10 21:21:41.006545123 +0000 UTC m=+24.760047002" Jul 10 21:21:41.023556 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.023499 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c94jh" podStartSLOduration=8.851781816 podStartE2EDuration="24.023480422s" totalImagesPullingTime="15.171698606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:41.023112759 +0000 UTC m=+24.776614639" watchObservedRunningTime="2026-07-10 21:21:41.023480422 +0000 UTC m=+24.776982300" Jul 10 21:21:41.606406 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.606305 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:41.808794 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.808756 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:41.809315 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.809296 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:41.846862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.846830 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:41.847211 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:41.847169 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:41.996358 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.996332 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:21:41.996792 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.996718 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"8a637469f8ab960ad8cd1dfc0b774cb83dc3dde25e634df7e08c4318477050df"} Jul 10 21:21:41.998732 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.998698 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" event={"ID":"13bba8d7-9caf-46c6-8788-db3ba0828325","Type":"ContainerStarted","Data":"420198b429b20b868c9961d0452fcaf52309445b8e2b18fd0fbcde45daf56ea6"} Jul 10 21:21:41.999411 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:41.999393 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-phllf" Jul 10 21:21:42.019192 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:42.019144 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z857s" podStartSLOduration=3.151984856 podStartE2EDuration="25.01912887s" totalImagesPullingTime="21.867144014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:42.018577916 +0000 UTC m=+25.772079794" watchObservedRunningTime="2026-07-10 21:21:42.01912887 +0000 UTC m=+25.772630749" Jul 10 21:21:42.846481 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:42.846248 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:42.846648 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:42.846299 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:42.846648 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:42.846578 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:42.846780 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:42.846644 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:43.846229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:43.846126 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:43.847098 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:43.846248 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:44.007483 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:44.007453 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:21:44.007908 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:44.007877 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"c0a11183717dc390458dc697a5a177e702337efcb1bd6215d0428da96b6db792"} Jul 10 21:21:44.008289 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:44.008269 2584 scope.go:117] "RemoveContainer" containerID="8c7ee05a1b722cf9f7a78a8992093c39c7329e1e86b50ba7d662bb6cda22c030" Jul 10 21:21:44.847271 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:44.847089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:44.847706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:44.847089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:44.847706 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:44.847402 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:44.850593 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:44.847980 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:45.847101 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:45.847067 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:45.847289 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:45.847184 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:45.932120 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:45.932077 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6qht"] Jul 10 21:21:45.932532 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:45.932212 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:45.932532 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:45.932300 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:45.934258 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:45.934234 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rqxlb"] Jul 10 21:21:45.934431 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:45.934346 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:45.934497 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:45.934477 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:45.934965 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:45.934947 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mltmx"] Jul 10 21:21:46.017212 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.017185 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:21:46.017587 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.017562 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" event={"ID":"63ae0429-5bf0-491c-bff1-7b7957d3d956","Type":"ContainerStarted","Data":"1e9f1f0c0681d9b919f9ae96b19fcbf6b0e93054b04a88481d6b73e928224db1"} Jul 10 21:21:46.017777 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.017761 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:46.017887 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.017832 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:46.017887 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.017880 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:46.019587 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.019563 2584 generic.go:356] "Generic (PLEG): container finished" podID="6c85aef8-05f9-4817-9616-9283952dd98d" containerID="d47cce60de00691ca944adb989169884b42a2258653b52d79944bbe75b46ef7c" exitCode=0 Jul 10 21:21:46.019696 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.019633 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:46.019696 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.019637 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerDied","Data":"d47cce60de00691ca944adb989169884b42a2258653b52d79944bbe75b46ef7c"} Jul 10 21:21:46.019869 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:46.019837 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:46.034626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.034602 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:46.034745 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.034709 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:21:46.055836 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:46.055774 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" podStartSLOduration=9.395208833 podStartE2EDuration="29.055755332s" totalImagesPullingTime="19.660546499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:46.053269699 +0000 UTC m=+29.806771576" watchObservedRunningTime="2026-07-10 21:21:46.055755332 +0000 UTC m=+29.809257211" Jul 10 21:21:47.023351 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:47.023309 2584 generic.go:356] "Generic (PLEG): container finished" podID="6c85aef8-05f9-4817-9616-9283952dd98d" containerID="beebf142573831363ca18330a360ae2b5410e79df98075723b302eb38d4074ab" exitCode=0 Jul 10 21:21:47.023721 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:47.023396 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerDied","Data":"beebf142573831363ca18330a360ae2b5410e79df98075723b302eb38d4074ab"} Jul 10 21:21:47.846387 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:47.846196 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:47.846555 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:47.846196 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:47.846555 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:47.846468 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:47.846555 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:47.846196 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:47.846555 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:47.846532 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:47.846698 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:47.846618 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:48.027653 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:48.027621 2584 generic.go:356] "Generic (PLEG): container finished" podID="6c85aef8-05f9-4817-9616-9283952dd98d" containerID="a80fed87adf6c2a332854f490cac5ef26b17f7b0f031c6e0b82d95fe11fbf0d7" exitCode=0 Jul 10 21:21:48.028055 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:48.027703 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerDied","Data":"a80fed87adf6c2a332854f490cac5ef26b17f7b0f031c6e0b82d95fe11fbf0d7"} Jul 10 21:21:48.038063 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:48.038031 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" podUID="63ae0429-5bf0-491c-bff1-7b7957d3d956" containerName="ovnkube-controller" probeResult="failure" output="" Jul 10 21:21:49.846488 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:49.846459 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:49.846488 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:49.846484 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:49.847012 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:49.846459 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:49.847012 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:49.846582 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6qht" podUID="09212ae0-8295-4ea0-9733-b1d3fce33035" Jul 10 21:21:49.847012 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:49.846649 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqxlb" podUID="041c0aac-c728-43d5-972a-42029ab6f2fa" Jul 10 21:21:49.847012 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:49.846698 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mltmx" podUID="20856626-33b3-4eef-b34e-7130a49dc16f" Jul 10 21:21:50.410035 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:50.409996 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:50.410203 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.410157 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:50.410278 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.410226 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret podName:09212ae0-8295-4ea0-9733-b1d3fce33035 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:22.4102045 +0000 UTC m=+66.163706361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret") pod "global-pull-secret-syncer-x6qht" (UID: "09212ae0-8295-4ea0-9733-b1d3fce33035") : object "kube-system"/"original-pull-secret" not registered Jul 10 21:21:50.510720 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:50.510688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:50.510904 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:50.510759 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:50.510904 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.510885 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 21:21:50.510904 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.510899 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:50.511052 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.510911 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 21:21:50.511052 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.510927 2584 projected.go:196] Error preparing data for projected volume kube-api-access-wb2vr for pod openshift-network-diagnostics/network-check-target-mltmx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:50.511052 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.510964 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs podName:041c0aac-c728-43d5-972a-42029ab6f2fa nodeName:}" failed. No retries permitted until 2026-07-10 21:22:22.510943997 +0000 UTC m=+66.264445854 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs") pod "network-metrics-daemon-rqxlb" (UID: "041c0aac-c728-43d5-972a-42029ab6f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 21:21:50.511052 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:21:50.510985 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr podName:20856626-33b3-4eef-b34e-7130a49dc16f nodeName:}" failed. No retries permitted until 2026-07-10 21:22:22.510973749 +0000 UTC m=+66.264475606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb2vr" (UniqueName: "kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr") pod "network-check-target-mltmx" (UID: "20856626-33b3-4eef-b34e-7130a49dc16f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 21:21:51.571458 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.571431 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-215.ec2.internal" event="NodeReady" Jul 10 21:21:51.572064 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.571568 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 21:21:51.580658 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.580633 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpmxw_61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c/dns-node-resolver/0.log" Jul 10 21:21:51.846164 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.846091 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:21:51.846316 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.846107 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:21:51.846419 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.846246 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:21:51.850694 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.850667 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 21:21:51.850694 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.850666 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 21:21:51.851339 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.851323 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nklrg\"" Jul 10 21:21:51.851412 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.851340 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j44v2\"" Jul 10 21:21:51.855394 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.851936 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 21:21:51.855394 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:51.852566 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 21:21:52.542323 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:52.542298 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ml6k_a526c132-4aa9-4d61-9200-2837910d5036/node-ca/0.log" Jul 10 21:21:53.041547 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:53.041513 2584 generic.go:356] "Generic (PLEG): container finished" podID="6c85aef8-05f9-4817-9616-9283952dd98d" containerID="c5971e260be68f72d102982994212683a3965d2894e5d4f74450c8c2c21e90b1" exitCode=0 Jul 10 21:21:53.041933 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:53.041574 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerDied","Data":"c5971e260be68f72d102982994212683a3965d2894e5d4f74450c8c2c21e90b1"} Jul 10 21:21:54.046811 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:54.046781 2584 generic.go:356] "Generic (PLEG): container finished" podID="6c85aef8-05f9-4817-9616-9283952dd98d" containerID="dba119d47302c289f5f54cd51eb1683b5f644b179ac14116d8f93c8fbfe35a83" exitCode=0 Jul 10 21:21:54.046811 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:54.046817 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerDied","Data":"dba119d47302c289f5f54cd51eb1683b5f644b179ac14116d8f93c8fbfe35a83"} Jul 10 21:21:55.052770 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:21:55.052587 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" event={"ID":"6c85aef8-05f9-4817-9616-9283952dd98d","Type":"ContainerStarted","Data":"82a729a98591d18fcfad1ebef9d6a018e1f270107b40990a6d1af83e78ea7908"} Jul 10 21:22:12.657193 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.657133 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kbgrd" podStartSLOduration=29.722710295 podStartE2EDuration="55.657117659s" totalImagesPullingTime="25.934407364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:21:55.083005979 +0000 UTC m=+38.836507858" watchObservedRunningTime="2026-07-10 21:22:12.657117659 +0000 UTC m=+56.410619537" Jul 10 21:22:12.657707 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.657696 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mmmbn"] Jul 10 21:22:12.659479 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.659463 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.684747 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:12.684702 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-133-215.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-215.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jul 10 21:22:12.685132 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:12.684726 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-133-215.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-215.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jul 10 21:22:12.685281 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:12.684814 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-215.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-215.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 10 21:22:12.685390 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:12.684856 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-215.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-215.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 10 21:22:12.685487 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:12.684960 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-f6m5r\" is forbidden: User \"system:node:ip-10-0-133-215.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-215.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f6m5r\"" type="*v1.Secret" Jul 10 21:22:12.685583 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:12.685070 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-mmmbn\" is forbidden: User \"system:node:ip-10-0-133-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-133-215.ec2.internal' and this object" podUID="c8a9399d-334a-4414-8122-6174cb193b68" pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.715426 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.715387 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pw44w"] Jul 10 21:22:12.717234 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.717218 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.721382 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.721326 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hw29l\"" Jul 10 21:22:12.723923 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.723902 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 21:22:12.724055 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.724033 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 21:22:12.748018 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.747985 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mmmbn"] Jul 10 21:22:12.750501 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.750473 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pw44w"] Jul 10 21:22:12.763105 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763071 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8a9399d-334a-4414-8122-6174cb193b68-data-volume\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.763105 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763107 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a9399d-334a-4414-8122-6174cb193b68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.763314 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763125 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5t5\" (UniqueName: \"kubernetes.io/projected/c8a9399d-334a-4414-8122-6174cb193b68-kube-api-access-tw5t5\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.763314 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-tmp-dir\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.763314 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763222 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8a9399d-334a-4414-8122-6174cb193b68-crio-socket\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.763314 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763250 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vg47\" (UniqueName: \"kubernetes.io/projected/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-kube-api-access-2vg47\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.763314 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763270 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a9399d-334a-4414-8122-6174cb193b68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.763527 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-metrics-tls\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.763527 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.763391 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-config-volume\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.806348 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.806310 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n748z"] Jul 10 21:22:12.808136 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.808114 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.811695 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.811676 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 21:22:12.811922 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.811909 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jkgdz\"" Jul 10 21:22:12.812027 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.812007 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 21:22:12.812073 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.812030 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 21:22:12.817585 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.817560 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7549dc445d-sn8ts"] Jul 10 21:22:12.819177 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.819162 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.822902 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.822869 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 21:22:12.823029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.822923 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lkx9k\"" Jul 10 21:22:12.823029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.822994 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 21:22:12.823029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.822999 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 21:22:12.830866 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.830848 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 21:22:12.839604 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.839580 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n748z"] Jul 10 21:22:12.861832 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.861798 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7549dc445d-sn8ts"] Jul 10 21:22:12.864035 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864006 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c041912-2698-45c2-844a-7662622a2685-registry-certificates\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864164 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864052 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-tmp-dir\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.864164 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864082 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c041912-2698-45c2-844a-7662622a2685-trusted-ca\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864164 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864139 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8a9399d-334a-4414-8122-6174cb193b68-crio-socket\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.864326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864173 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vg47\" (UniqueName: \"kubernetes.io/projected/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-kube-api-access-2vg47\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.864326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864203 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-registry-tls\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864230 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c041912-2698-45c2-844a-7662622a2685-installation-pull-secrets\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a9399d-334a-4414-8122-6174cb193b68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.864326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864284 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-bound-sa-token\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864291 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8a9399d-334a-4414-8122-6174cb193b68-crio-socket\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864347 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4n2s\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-kube-api-access-z4n2s\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864397 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-tmp-dir\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-metrics-tls\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-config-volume\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864471 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c041912-2698-45c2-844a-7662622a2685-image-registry-private-configuration\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864503 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzjh\" (UniqueName: \"kubernetes.io/projected/585b4b7e-839f-488e-b12c-587c0cbe4227-kube-api-access-4lzjh\") pod \"ingress-canary-n748z\" (UID: \"585b4b7e-839f-488e-b12c-587c0cbe4227\") " pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.864624 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864527 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c041912-2698-45c2-844a-7662622a2685-ca-trust-extracted\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.864916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864632 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8a9399d-334a-4414-8122-6174cb193b68-data-volume\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.864916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864666 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a9399d-334a-4414-8122-6174cb193b68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.864916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864695 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5t5\" (UniqueName: \"kubernetes.io/projected/c8a9399d-334a-4414-8122-6174cb193b68-kube-api-access-tw5t5\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.864916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.864721 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/585b4b7e-839f-488e-b12c-587c0cbe4227-cert\") pod \"ingress-canary-n748z\" (UID: \"585b4b7e-839f-488e-b12c-587c0cbe4227\") " pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.865132 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.865088 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8a9399d-334a-4414-8122-6174cb193b68-data-volume\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:12.865132 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.865124 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-config-volume\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.868761 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.868740 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-metrics-tls\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.875560 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.875539 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vg47\" (UniqueName: \"kubernetes.io/projected/b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f-kube-api-access-2vg47\") pod \"dns-default-pw44w\" (UID: \"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f\") " pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:12.965321 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-registry-tls\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965321 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965266 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c041912-2698-45c2-844a-7662622a2685-installation-pull-secrets\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965321 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-bound-sa-token\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965591 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965322 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4n2s\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-kube-api-access-z4n2s\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965591 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965398 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c041912-2698-45c2-844a-7662622a2685-image-registry-private-configuration\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965591 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzjh\" (UniqueName: \"kubernetes.io/projected/585b4b7e-839f-488e-b12c-587c0cbe4227-kube-api-access-4lzjh\") pod \"ingress-canary-n748z\" (UID: \"585b4b7e-839f-488e-b12c-587c0cbe4227\") " pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.965591 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965448 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c041912-2698-45c2-844a-7662622a2685-ca-trust-extracted\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965591 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965512 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/585b4b7e-839f-488e-b12c-587c0cbe4227-cert\") pod \"ingress-canary-n748z\" (UID: \"585b4b7e-839f-488e-b12c-587c0cbe4227\") " pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.965591 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c041912-2698-45c2-844a-7662622a2685-registry-certificates\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965880 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965684 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c041912-2698-45c2-844a-7662622a2685-trusted-ca\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.965974 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.965949 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c041912-2698-45c2-844a-7662622a2685-ca-trust-extracted\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.966430 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.966406 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c041912-2698-45c2-844a-7662622a2685-registry-certificates\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.966666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.966646 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c041912-2698-45c2-844a-7662622a2685-trusted-ca\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.968002 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.967970 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c041912-2698-45c2-844a-7662622a2685-installation-pull-secrets\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.968079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.968000 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/585b4b7e-839f-488e-b12c-587c0cbe4227-cert\") pod \"ingress-canary-n748z\" (UID: \"585b4b7e-839f-488e-b12c-587c0cbe4227\") " pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.968166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.968148 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c041912-2698-45c2-844a-7662622a2685-image-registry-private-configuration\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.968339 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.968322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-registry-tls\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.977038 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.977012 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4n2s\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-kube-api-access-z4n2s\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:12.977122 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.977010 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzjh\" (UniqueName: \"kubernetes.io/projected/585b4b7e-839f-488e-b12c-587c0cbe4227-kube-api-access-4lzjh\") pod \"ingress-canary-n748z\" (UID: \"585b4b7e-839f-488e-b12c-587c0cbe4227\") " pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:12.977813 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:12.977796 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c041912-2698-45c2-844a-7662622a2685-bound-sa-token\") pod \"image-registry-7549dc445d-sn8ts\" (UID: \"2c041912-2698-45c2-844a-7662622a2685\") " pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:13.027068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.027036 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:13.116864 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.116838 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n748z" Jul 10 21:22:13.128174 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.128143 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:13.168354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.168327 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pw44w"] Jul 10 21:22:13.255955 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.255928 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n748z"] Jul 10 21:22:13.259653 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:13.259625 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585b4b7e_839f_488e_b12c_587c0cbe4227.slice/crio-439225d9b91816541f2cee363b6a1d42befe0c5e7b91ecd5c8a9092aaf846bfb WatchSource:0}: Error finding container 439225d9b91816541f2cee363b6a1d42befe0c5e7b91ecd5c8a9092aaf846bfb: Status 404 returned error can't find the container with id 439225d9b91816541f2cee363b6a1d42befe0c5e7b91ecd5c8a9092aaf846bfb Jul 10 21:22:13.278775 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.278743 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7549dc445d-sn8ts"] Jul 10 21:22:13.282452 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:13.282419 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c041912_2698_45c2_844a_7662622a2685.slice/crio-dcb5616f0abc1f3a2a9f905fa34cec741479a026eeb934cc9fb24b19156131b1 WatchSource:0}: Error finding container dcb5616f0abc1f3a2a9f905fa34cec741479a026eeb934cc9fb24b19156131b1: Status 404 returned error can't find the container with id dcb5616f0abc1f3a2a9f905fa34cec741479a026eeb934cc9fb24b19156131b1 Jul 10 21:22:13.576205 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.576110 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f6m5r\"" Jul 10 21:22:13.795727 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.795696 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 21:22:13.805493 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.805453 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a9399d-334a-4414-8122-6174cb193b68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:13.865782 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:13.865704 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition Jul 10 21:22:13.865943 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:13.865797 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a9399d-334a-4414-8122-6174cb193b68-insights-runtime-extractor-tls podName:c8a9399d-334a-4414-8122-6174cb193b68 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:14.36577684 +0000 UTC m=+58.119278700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a9399d-334a-4414-8122-6174cb193b68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mmmbn" (UID: "c8a9399d-334a-4414-8122-6174cb193b68") : failed to sync secret cache: timed out waiting for the condition Jul 10 21:22:13.874177 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:13.874146 2584 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 10 21:22:13.894582 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:13.894289 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 21:22:13.894582 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:13.894312 2584 projected.go:196] Error preparing data for projected volume kube-api-access-tw5t5 for pod openshift-insights/insights-runtime-extractor-mmmbn: failed to sync configmap cache: timed out waiting for the condition Jul 10 21:22:13.894582 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:13.894412 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a9399d-334a-4414-8122-6174cb193b68-kube-api-access-tw5t5 podName:c8a9399d-334a-4414-8122-6174cb193b68 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:14.39439381 +0000 UTC m=+58.147895682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tw5t5" (UniqueName: "kubernetes.io/projected/c8a9399d-334a-4414-8122-6174cb193b68-kube-api-access-tw5t5") pod "insights-runtime-extractor-mmmbn" (UID: "c8a9399d-334a-4414-8122-6174cb193b68") : failed to sync configmap cache: timed out waiting for the condition Jul 10 21:22:14.094750 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.094709 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n748z" event={"ID":"585b4b7e-839f-488e-b12c-587c0cbe4227","Type":"ContainerStarted","Data":"439225d9b91816541f2cee363b6a1d42befe0c5e7b91ecd5c8a9092aaf846bfb"} Jul 10 21:22:14.096992 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.096960 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" event={"ID":"2c041912-2698-45c2-844a-7662622a2685","Type":"ContainerStarted","Data":"6a6c1da367dec810237f8e750e86c79eb6faeee8eaf09a2d0c71e21704d708b5"} Jul 10 21:22:14.097127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.097005 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" event={"ID":"2c041912-2698-45c2-844a-7662622a2685","Type":"ContainerStarted","Data":"dcb5616f0abc1f3a2a9f905fa34cec741479a026eeb934cc9fb24b19156131b1"} Jul 10 21:22:14.097127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.097072 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:14.098461 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.098405 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pw44w" event={"ID":"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f","Type":"ContainerStarted","Data":"7f2a0f43ec1d0a5b025bc8cf8a1aeee0513ff742e9cb230844dbafead6d47866"} Jul 10 21:22:14.120989 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.120907 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 21:22:14.122977 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.122844 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" podStartSLOduration=2.122826356 podStartE2EDuration="2.122826356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:14.121689658 +0000 UTC m=+57.875191552" watchObservedRunningTime="2026-07-10 21:22:14.122826356 +0000 UTC m=+57.876328212" Jul 10 21:22:14.262769 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.262740 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 21:22:14.378198 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.378118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a9399d-334a-4414-8122-6174cb193b68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:14.380575 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.380540 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a9399d-334a-4414-8122-6174cb193b68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:14.479063 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.479019 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5t5\" (UniqueName: \"kubernetes.io/projected/c8a9399d-334a-4414-8122-6174cb193b68-kube-api-access-tw5t5\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:14.482441 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.482400 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5t5\" (UniqueName: \"kubernetes.io/projected/c8a9399d-334a-4414-8122-6174cb193b68-kube-api-access-tw5t5\") pod \"insights-runtime-extractor-mmmbn\" (UID: \"c8a9399d-334a-4414-8122-6174cb193b68\") " pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:14.768478 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.768439 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mmmbn" Jul 10 21:22:14.905103 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:14.905062 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mmmbn"] Jul 10 21:22:14.910132 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:14.910092 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a9399d_334a_4414_8122_6174cb193b68.slice/crio-f2e961f7497b8dc0061c6f9f59489256f317158f79ef20dbbbc7d11d5595abd5 WatchSource:0}: Error finding container f2e961f7497b8dc0061c6f9f59489256f317158f79ef20dbbbc7d11d5595abd5: Status 404 returned error can't find the container with id f2e961f7497b8dc0061c6f9f59489256f317158f79ef20dbbbc7d11d5595abd5 Jul 10 21:22:15.103307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:15.103267 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pw44w" event={"ID":"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f","Type":"ContainerStarted","Data":"f193dc69f1f06de31833d530f81b39562ce859649c0dd11ae57ed5af9dde6d0e"} Jul 10 21:22:15.103472 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:15.103340 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pw44w" event={"ID":"b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f","Type":"ContainerStarted","Data":"701f52fc5b51bceaa3e90060e4b6be998ecd1561965919b4c11bdf88996ac149"} Jul 10 21:22:15.103830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:15.103664 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:15.104854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:15.104828 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmmbn" event={"ID":"c8a9399d-334a-4414-8122-6174cb193b68","Type":"ContainerStarted","Data":"f2e961f7497b8dc0061c6f9f59489256f317158f79ef20dbbbc7d11d5595abd5"} Jul 10 21:22:15.125230 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:15.125163 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pw44w" podStartSLOduration=1.4373308790000001 podStartE2EDuration="3.125141701s" totalImagesPullingTime="1.687810822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:15.124214951 +0000 UTC m=+58.877716828" watchObservedRunningTime="2026-07-10 21:22:15.125141701 +0000 UTC m=+58.878643582" Jul 10 21:22:17.099642 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.099607 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5"] Jul 10 21:22:17.101636 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.101611 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:17.104129 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.104101 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 21:22:17.104259 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.104127 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v6twc\"" Jul 10 21:22:17.110849 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.110819 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n748z" event={"ID":"585b4b7e-839f-488e-b12c-587c0cbe4227","Type":"ContainerStarted","Data":"615d9782731467584b7971001995b37cc7d572737cc2a4f11f59feaef46a2643"} Jul 10 21:22:17.147079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.147021 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n748z" podStartSLOduration=2.202597799 podStartE2EDuration="5.146997563s" totalImagesPullingTime="2.944399764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:17.140066851 +0000 UTC m=+60.893568729" watchObservedRunningTime="2026-07-10 21:22:17.146997563 +0000 UTC m=+60.900499442" Jul 10 21:22:17.147894 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.147849 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5"] Jul 10 21:22:17.202392 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.202251 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9e58a9a-4a0b-4006-b19d-6a6618caf1c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-ps5m5\" (UID: \"e9e58a9a-4a0b-4006-b19d-6a6618caf1c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:17.303137 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.303102 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9e58a9a-4a0b-4006-b19d-6a6618caf1c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-ps5m5\" (UID: \"e9e58a9a-4a0b-4006-b19d-6a6618caf1c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:17.303320 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:17.303266 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 10 21:22:17.303396 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:17.303347 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e58a9a-4a0b-4006-b19d-6a6618caf1c8-tls-certificates podName:e9e58a9a-4a0b-4006-b19d-6a6618caf1c8 nodeName:}" failed. No retries permitted until 2026-07-10 21:22:17.803329638 +0000 UTC m=+61.556831495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e9e58a9a-4a0b-4006-b19d-6a6618caf1c8-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-ps5m5" (UID: "e9e58a9a-4a0b-4006-b19d-6a6618caf1c8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 10 21:22:17.446610 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.446532 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-k4r9x"] Jul 10 21:22:17.448552 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.448529 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:17.450962 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.450937 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 21:22:17.451082 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.450940 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5xtrt\"" Jul 10 21:22:17.451326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.451299 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 21:22:17.462252 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.462226 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-k4r9x"] Jul 10 21:22:17.504479 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.504443 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2ld\" (UniqueName: \"kubernetes.io/projected/616fdfab-149d-4ff6-9869-61b75480ea6d-kube-api-access-px2ld\") pod \"downloads-68c9cbb497-k4r9x\" (UID: \"616fdfab-149d-4ff6-9869-61b75480ea6d\") " pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:17.605047 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.605009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2ld\" (UniqueName: \"kubernetes.io/projected/616fdfab-149d-4ff6-9869-61b75480ea6d-kube-api-access-px2ld\") pod \"downloads-68c9cbb497-k4r9x\" (UID: \"616fdfab-149d-4ff6-9869-61b75480ea6d\") " pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:17.614533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.614499 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2ld\" (UniqueName: \"kubernetes.io/projected/616fdfab-149d-4ff6-9869-61b75480ea6d-kube-api-access-px2ld\") pod \"downloads-68c9cbb497-k4r9x\" (UID: \"616fdfab-149d-4ff6-9869-61b75480ea6d\") " pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:17.759833 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.759797 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:17.806715 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.806668 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9e58a9a-4a0b-4006-b19d-6a6618caf1c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-ps5m5\" (UID: \"e9e58a9a-4a0b-4006-b19d-6a6618caf1c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:17.809510 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:17.809473 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9e58a9a-4a0b-4006-b19d-6a6618caf1c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-ps5m5\" (UID: \"e9e58a9a-4a0b-4006-b19d-6a6618caf1c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:18.013147 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:18.013057 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:18.039544 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:18.039511 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-984zm" Jul 10 21:22:19.775007 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:19.774975 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5"] Jul 10 21:22:19.778972 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:19.778949 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e58a9a_4a0b_4006_b19d_6a6618caf1c8.slice/crio-ea7a9c58e1ff910c0371f06e79c19d4b178a7006b3fd8a3e1ce1326f247e7aea WatchSource:0}: Error finding container ea7a9c58e1ff910c0371f06e79c19d4b178a7006b3fd8a3e1ce1326f247e7aea: Status 404 returned error can't find the container with id ea7a9c58e1ff910c0371f06e79c19d4b178a7006b3fd8a3e1ce1326f247e7aea Jul 10 21:22:19.789970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:19.789943 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-k4r9x"] Jul 10 21:22:19.794373 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:19.794334 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616fdfab_149d_4ff6_9869_61b75480ea6d.slice/crio-c95a0d3213d2f02e3d6043079306e821fbaecb24032f8d3b61e6f2ba142280e6 WatchSource:0}: Error finding container c95a0d3213d2f02e3d6043079306e821fbaecb24032f8d3b61e6f2ba142280e6: Status 404 returned error can't find the container with id c95a0d3213d2f02e3d6043079306e821fbaecb24032f8d3b61e6f2ba142280e6 Jul 10 21:22:20.121775 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:20.121731 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-k4r9x" event={"ID":"616fdfab-149d-4ff6-9869-61b75480ea6d","Type":"ContainerStarted","Data":"c95a0d3213d2f02e3d6043079306e821fbaecb24032f8d3b61e6f2ba142280e6"} Jul 10 21:22:20.123563 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:20.123515 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmmbn" event={"ID":"c8a9399d-334a-4414-8122-6174cb193b68","Type":"ContainerStarted","Data":"aea3dd323b87ea647d15a5fa7223e79fb4dea5972f4649e6ca1f78bdb4ef36bc"} Jul 10 21:22:20.124788 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:20.124760 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" event={"ID":"e9e58a9a-4a0b-4006-b19d-6a6618caf1c8","Type":"ContainerStarted","Data":"ea7a9c58e1ff910c0371f06e79c19d4b178a7006b3fd8a3e1ce1326f247e7aea"} Jul 10 21:22:21.130833 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:21.130788 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmmbn" event={"ID":"c8a9399d-334a-4414-8122-6174cb193b68","Type":"ContainerStarted","Data":"39fbe118abe274cdf638b3e167872fda5953f593a561f3ed07b816e365b72fa8"} Jul 10 21:22:22.137057 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.137017 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" event={"ID":"e9e58a9a-4a0b-4006-b19d-6a6618caf1c8","Type":"ContainerStarted","Data":"58e712c3c4c6d4d5f698a90c8e3b00c7c52261cad679174a9df9c5b91090d08a"} Jul 10 21:22:22.137546 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.137320 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:22.142984 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.142934 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" Jul 10 21:22:22.154741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.154680 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-ps5m5" podStartSLOduration=3.857547675 podStartE2EDuration="5.154657037s" totalImagesPullingTime="1.297109362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:22.154529425 +0000 UTC m=+65.908031306" watchObservedRunningTime="2026-07-10 21:22:22.154657037 +0000 UTC m=+65.908158896" Jul 10 21:22:22.447739 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.447657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:22:22.450596 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.450547 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 21:22:22.461781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.461693 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09212ae0-8295-4ea0-9733-b1d3fce33035-original-pull-secret\") pod \"global-pull-secret-syncer-x6qht\" (UID: \"09212ae0-8295-4ea0-9733-b1d3fce33035\") " pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:22:22.469854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.469806 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6qht" Jul 10 21:22:22.548513 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.548477 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:22:22.548725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.548550 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:22:22.551036 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.551009 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 21:22:22.551174 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.551100 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 21:22:22.561021 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.560985 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 21:22:22.562026 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.562000 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/041c0aac-c728-43d5-972a-42029ab6f2fa-metrics-certs\") pod \"network-metrics-daemon-rqxlb\" (UID: \"041c0aac-c728-43d5-972a-42029ab6f2fa\") " pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:22:22.571874 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.571804 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb2vr\" (UniqueName: \"kubernetes.io/projected/20856626-33b3-4eef-b34e-7130a49dc16f-kube-api-access-wb2vr\") pod \"network-check-target-mltmx\" (UID: \"20856626-33b3-4eef-b34e-7130a49dc16f\") " pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:22:22.761950 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.761925 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j44v2\"" Jul 10 21:22:22.767478 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.767401 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nklrg\"" Jul 10 21:22:22.770377 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.770339 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqxlb" Jul 10 21:22:22.775614 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:22.775587 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:22:23.184670 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.184627 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mltmx"] Jul 10 21:22:23.198780 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.198753 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vb6l8"] Jul 10 21:22:23.209686 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:23.209655 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09212ae0_8295_4ea0_9733_b1d3fce33035.slice/crio-682479beec788d618ef0a416c5d16308f3ecab61a815019ab62cfdb6d0da9b40 WatchSource:0}: Error finding container 682479beec788d618ef0a416c5d16308f3ecab61a815019ab62cfdb6d0da9b40: Status 404 returned error can't find the container with id 682479beec788d618ef0a416c5d16308f3ecab61a815019ab62cfdb6d0da9b40 Jul 10 21:22:23.219945 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.219915 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6qht"] Jul 10 21:22:23.220087 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.219959 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vb6l8"] Jul 10 21:22:23.220087 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.220041 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.223130 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.223090 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 21:22:23.223471 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.223446 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 21:22:23.223786 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.223757 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 21:22:23.224417 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.223971 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 21:22:23.224417 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.224173 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w7gmb\"" Jul 10 21:22:23.224648 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.224629 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 21:22:23.224924 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.224894 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rqxlb"] Jul 10 21:22:23.253673 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.253641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.253857 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.253696 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkm9d\" (UniqueName: \"kubernetes.io/projected/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-kube-api-access-fkm9d\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.253857 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.253803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.253857 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.253847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.355238 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.355148 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkm9d\" (UniqueName: \"kubernetes.io/projected/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-kube-api-access-fkm9d\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.355238 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.355202 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.355238 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.355231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.355620 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.355290 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.355987 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.355963 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.357778 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.357747 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.357778 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.357773 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.362956 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.362938 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkm9d\" (UniqueName: \"kubernetes.io/projected/2a5d30f4-e078-4e29-9501-cc5e0a4e851a-kube-api-access-fkm9d\") pod \"prometheus-operator-64785b6675-vb6l8\" (UID: \"2a5d30f4-e078-4e29-9501-cc5e0a4e851a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.373580 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:23.373558 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041c0aac_c728_43d5_972a_42029ab6f2fa.slice/crio-04ca0d79ac9113f1e223690a6d75d3ffc740bb62fa3043a737b26851f10471b0 WatchSource:0}: Error finding container 04ca0d79ac9113f1e223690a6d75d3ffc740bb62fa3043a737b26851f10471b0: Status 404 returned error can't find the container with id 04ca0d79ac9113f1e223690a6d75d3ffc740bb62fa3043a737b26851f10471b0 Jul 10 21:22:23.531925 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.531888 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" Jul 10 21:22:23.686820 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:23.686785 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vb6l8"] Jul 10 21:22:23.691989 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:23.691948 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5d30f4_e078_4e29_9501_cc5e0a4e851a.slice/crio-1ade3a82f2c3b0c68413311ca5e40d02768a17a4a2517f1822aedb1fce655703 WatchSource:0}: Error finding container 1ade3a82f2c3b0c68413311ca5e40d02768a17a4a2517f1822aedb1fce655703: Status 404 returned error can't find the container with id 1ade3a82f2c3b0c68413311ca5e40d02768a17a4a2517f1822aedb1fce655703 Jul 10 21:22:24.146397 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:24.146302 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqxlb" event={"ID":"041c0aac-c728-43d5-972a-42029ab6f2fa","Type":"ContainerStarted","Data":"04ca0d79ac9113f1e223690a6d75d3ffc740bb62fa3043a737b26851f10471b0"} Jul 10 21:22:24.148456 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:24.148351 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mltmx" event={"ID":"20856626-33b3-4eef-b34e-7130a49dc16f","Type":"ContainerStarted","Data":"ac5fec97849e7ac61348f9dae1d8397aa1f11e6bd659e68485b74a0fcafd1287"} Jul 10 21:22:24.150237 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:24.150160 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" event={"ID":"2a5d30f4-e078-4e29-9501-cc5e0a4e851a","Type":"ContainerStarted","Data":"1ade3a82f2c3b0c68413311ca5e40d02768a17a4a2517f1822aedb1fce655703"} Jul 10 21:22:24.152629 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:24.152601 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6qht" event={"ID":"09212ae0-8295-4ea0-9733-b1d3fce33035","Type":"ContainerStarted","Data":"682479beec788d618ef0a416c5d16308f3ecab61a815019ab62cfdb6d0da9b40"} Jul 10 21:22:24.157573 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:24.157495 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmmbn" event={"ID":"c8a9399d-334a-4414-8122-6174cb193b68","Type":"ContainerStarted","Data":"9d6273fb04f61df3e6bc97cbc8e32b93ad905e8c48e79120ec623e68b45d799a"} Jul 10 21:22:24.177380 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:24.176909 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mmmbn" podStartSLOduration=3.800006635 podStartE2EDuration="12.176885461s" totalImagesPullingTime="8.376878826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:22:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:24.175862708 +0000 UTC m=+67.929364584" watchObservedRunningTime="2026-07-10 21:22:24.176885461 +0000 UTC m=+67.930387340" Jul 10 21:22:25.109925 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:25.109015 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pw44w" Jul 10 21:22:25.165717 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:25.165632 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqxlb" event={"ID":"041c0aac-c728-43d5-972a-42029ab6f2fa","Type":"ContainerStarted","Data":"8e1010b2f4e069defbd3e0b9fd56f155715083bf02ce1b7ccbab93cc0d844784"} Jul 10 21:22:25.165717 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:25.165696 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqxlb" event={"ID":"041c0aac-c728-43d5-972a-42029ab6f2fa","Type":"ContainerStarted","Data":"44990a10e5d34dbf828713e4bd21b1b3574c2b943fc0afd109a61b92fe3a5bba"} Jul 10 21:22:25.183188 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:25.182935 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rqxlb" podStartSLOduration=66.943893122 podStartE2EDuration="1m8.182910516s" totalImagesPullingTime="1.239017394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:25.181794637 +0000 UTC m=+68.935296528" watchObservedRunningTime="2026-07-10 21:22:25.182910516 +0000 UTC m=+68.936412397" Jul 10 21:22:26.172560 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:26.172513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" event={"ID":"2a5d30f4-e078-4e29-9501-cc5e0a4e851a","Type":"ContainerStarted","Data":"ed6b839de2671d201f9a6e33e2784e09c21ddf355f1f46d531c8013e3b7f5382"} Jul 10 21:22:26.173029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:26.172589 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" event={"ID":"2a5d30f4-e078-4e29-9501-cc5e0a4e851a","Type":"ContainerStarted","Data":"565fd11812efcf2cd3bf1d7265e96b4b793a263f92a2ac644315cb3fbb0360c9"} Jul 10 21:22:26.189247 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:26.189101 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-vb6l8" podStartSLOduration=1.41511061 podStartE2EDuration="3.18907585s" totalImagesPullingTime="1.77396524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:26.188467596 +0000 UTC m=+69.941969475" watchObservedRunningTime="2026-07-10 21:22:26.18907585 +0000 UTC m=+69.942577731" Jul 10 21:22:28.637156 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.637116 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk"] Jul 10 21:22:28.639936 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.639882 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.643227 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.643196 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 21:22:28.643617 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.643196 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 21:22:28.643617 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.643421 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-llss7\"" Jul 10 21:22:28.660699 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.660495 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk"] Jul 10 21:22:28.661337 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.661311 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-prnhl"] Jul 10 21:22:28.663998 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.663977 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.666184 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.666154 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6b8f5dbf-stkkv"] Jul 10 21:22:28.668400 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.667943 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 21:22:28.668400 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.668210 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 21:22:28.668588 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.668561 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 21:22:28.668758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.668736 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.669229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.669207 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5pwrj\"" Jul 10 21:22:28.671352 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.671331 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 21:22:28.671473 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.671342 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 21:22:28.671628 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.671610 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 21:22:28.673548 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.673524 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 21:22:28.674462 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.673989 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 21:22:28.674537 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.674463 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9dmbn\"" Jul 10 21:22:28.692986 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.692241 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-6tqt4"] Jul 10 21:22:28.695295 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.695211 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6b8f5dbf-stkkv"] Jul 10 21:22:28.695467 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.695346 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.698107 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.698085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.698253 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.698125 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6fz\" (UniqueName: \"kubernetes.io/projected/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-kube-api-access-2f6fz\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.698331 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.698258 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.698415 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.698331 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.699247 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.699226 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 21:22:28.699578 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.699549 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4454c\"" Jul 10 21:22:28.700021 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.700006 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 21:22:28.700913 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.700895 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 21:22:28.709568 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.709545 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-6tqt4"] Jul 10 21:22:28.799674 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799635 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mk4z\" (UniqueName: \"kubernetes.io/projected/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-kube-api-access-4mk4z\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.799851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799686 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-tls\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.799851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799715 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-config\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.799851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799742 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.799851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799774 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.799851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799805 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-accelerators-collector-config\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.799851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799833 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-root\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799857 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-serving-cert\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799891 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-oauth-serving-cert\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799919 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.799979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800029 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9916eaa2-9992-4e2b-86e5-e3e34e40effd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.800166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800166 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vddcf\" (UniqueName: \"kubernetes.io/projected/9df38b93-73eb-41f0-8ea1-a5bace63d85e-kube-api-access-vddcf\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800193 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-wtmp\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:28.800246 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df38b93-73eb-41f0-8ea1-a5bace63d85e-metrics-client-ca\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:28.800319 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-tls podName:fcbcb077-d8e4-4b8c-8819-3e3c1605964a nodeName:}" failed. No retries permitted until 2026-07-10 21:22:29.30029525 +0000 UTC m=+73.053797107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-l9wfk" (UID: "fcbcb077-d8e4-4b8c-8819-3e3c1605964a") : secret "openshift-state-metrics-tls" not found Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800338 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800393 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-oauth-config\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800461 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-textfile\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.800529 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800518 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-service-ca\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.800984 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800563 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9916eaa2-9992-4e2b-86e5-e3e34e40effd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.800984 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800587 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmnh7\" (UniqueName: \"kubernetes.io/projected/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-api-access-nmnh7\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.800984 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800625 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6fz\" (UniqueName: \"kubernetes.io/projected/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-kube-api-access-2f6fz\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.800984 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800658 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-sys\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.800984 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.800948 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.803794 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.803770 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.822476 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.822435 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6fz\" (UniqueName: \"kubernetes.io/projected/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-kube-api-access-2f6fz\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:28.901610 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-sys\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.901610 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901594 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mk4z\" (UniqueName: \"kubernetes.io/projected/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-kube-api-access-4mk4z\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-tls\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901665 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-config\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901689 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-accelerators-collector-config\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-root\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.901821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901806 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-serving-cert\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901835 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-oauth-serving-cert\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901876 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901910 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9916eaa2-9992-4e2b-86e5-e3e34e40effd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vddcf\" (UniqueName: \"kubernetes.io/projected/9df38b93-73eb-41f0-8ea1-a5bace63d85e-kube-api-access-vddcf\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.901998 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-wtmp\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902022 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df38b93-73eb-41f0-8ea1-a5bace63d85e-metrics-client-ca\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902054 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902085 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-oauth-config\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902131 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-textfile\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.902154 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902155 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-service-ca\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.902602 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9916eaa2-9992-4e2b-86e5-e3e34e40effd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.902602 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmnh7\" (UniqueName: \"kubernetes.io/projected/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-api-access-nmnh7\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.902602 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902495 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-wtmp\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.903420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902191 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-root\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.903420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902826 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9916eaa2-9992-4e2b-86e5-e3e34e40effd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.903420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.902840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9df38b93-73eb-41f0-8ea1-a5bace63d85e-sys\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.903420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.903100 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.903420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.903140 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9df38b93-73eb-41f0-8ea1-a5bace63d85e-metrics-client-ca\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.903739 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.903656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-textfile\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.903792 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.903773 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-oauth-serving-cert\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.904387 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.904319 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-service-ca\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.904490 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.904402 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-config\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.905344 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.904631 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-accelerators-collector-config\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.905344 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.904721 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9916eaa2-9992-4e2b-86e5-e3e34e40effd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.906593 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.906171 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-tls\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.906687 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.906647 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.907533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.907050 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9df38b93-73eb-41f0-8ea1-a5bace63d85e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.907533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.907490 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-serving-cert\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.907675 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.907552 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-oauth-config\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.910564 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.908738 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.914634 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.914564 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mk4z\" (UniqueName: \"kubernetes.io/projected/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-kube-api-access-4mk4z\") pod \"console-d6b8f5dbf-stkkv\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.914634 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.914576 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmnh7\" (UniqueName: \"kubernetes.io/projected/9916eaa2-9992-4e2b-86e5-e3e34e40effd-kube-api-access-nmnh7\") pod \"kube-state-metrics-785778ff74-6tqt4\" (UID: \"9916eaa2-9992-4e2b-86e5-e3e34e40effd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:28.916287 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.916252 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vddcf\" (UniqueName: \"kubernetes.io/projected/9df38b93-73eb-41f0-8ea1-a5bace63d85e-kube-api-access-vddcf\") pod \"node-exporter-prnhl\" (UID: \"9df38b93-73eb-41f0-8ea1-a5bace63d85e\") " pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.979783 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.979748 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prnhl" Jul 10 21:22:28.986441 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:28.986398 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:28.997817 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:28.997782 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df38b93_73eb_41f0_8ea1_a5bace63d85e.slice/crio-6e89a7eb9c2337a5c7aa3fa2bc62386a1ea96d0523a0a6b05149cfba7d8042ee WatchSource:0}: Error finding container 6e89a7eb9c2337a5c7aa3fa2bc62386a1ea96d0523a0a6b05149cfba7d8042ee: Status 404 returned error can't find the container with id 6e89a7eb9c2337a5c7aa3fa2bc62386a1ea96d0523a0a6b05149cfba7d8042ee Jul 10 21:22:29.008610 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.008387 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" Jul 10 21:22:29.171047 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.170949 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6b8f5dbf-stkkv"] Jul 10 21:22:29.173536 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:29.173502 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5240fd8a_3e57_4426_9a53_3b53d6f6b6b3.slice/crio-1bdb4541ad4a44633ecbbdbfdfebd942bc5e6c7c4e23d45ea06bfa3c42247e83 WatchSource:0}: Error finding container 1bdb4541ad4a44633ecbbdbfdfebd942bc5e6c7c4e23d45ea06bfa3c42247e83: Status 404 returned error can't find the container with id 1bdb4541ad4a44633ecbbdbfdfebd942bc5e6c7c4e23d45ea06bfa3c42247e83 Jul 10 21:22:29.192623 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.192584 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mltmx" event={"ID":"20856626-33b3-4eef-b34e-7130a49dc16f","Type":"ContainerStarted","Data":"15545eddcf4c69192e75fe1d2ad359b52a76bd114d70ef52da6b3d5bca469d8a"} Jul 10 21:22:29.193267 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.193241 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:22:29.194714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.194689 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b8f5dbf-stkkv" event={"ID":"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3","Type":"ContainerStarted","Data":"1bdb4541ad4a44633ecbbdbfdfebd942bc5e6c7c4e23d45ea06bfa3c42247e83"} Jul 10 21:22:29.196465 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.196438 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6qht" event={"ID":"09212ae0-8295-4ea0-9733-b1d3fce33035","Type":"ContainerStarted","Data":"e832db9db09a117ce28e3352105b7221f5f6f01f831761433fd2d42efe5c6bad"} Jul 10 21:22:29.197986 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.197964 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prnhl" event={"ID":"9df38b93-73eb-41f0-8ea1-a5bace63d85e","Type":"ContainerStarted","Data":"6e89a7eb9c2337a5c7aa3fa2bc62386a1ea96d0523a0a6b05149cfba7d8042ee"} Jul 10 21:22:29.203016 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.202976 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-6tqt4"] Jul 10 21:22:29.207812 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:29.207783 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9916eaa2_9992_4e2b_86e5_e3e34e40effd.slice/crio-63a71ca6b5f754eebdc0b2f952e1fa097b82621df7b1d6a60a58ef37d678d63c WatchSource:0}: Error finding container 63a71ca6b5f754eebdc0b2f952e1fa097b82621df7b1d6a60a58ef37d678d63c: Status 404 returned error can't find the container with id 63a71ca6b5f754eebdc0b2f952e1fa097b82621df7b1d6a60a58ef37d678d63c Jul 10 21:22:29.236400 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.236321 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mltmx" podStartSLOduration=66.567965144 podStartE2EDuration="1m12.236303404s" totalImagesPullingTime="5.66833826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:29.235574357 +0000 UTC m=+72.989076236" watchObservedRunningTime="2026-07-10 21:22:29.236303404 +0000 UTC m=+72.989805281" Jul 10 21:22:29.273197 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.273138 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x6qht" podStartSLOduration=66.782129277 podStartE2EDuration="1m12.273118746s" totalImagesPullingTime="5.490989469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:29.265508043 +0000 UTC m=+73.019009966" watchObservedRunningTime="2026-07-10 21:22:29.273118746 +0000 UTC m=+73.026620623" Jul 10 21:22:29.306180 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.306129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:29.308930 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.308901 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcbcb077-d8e4-4b8c-8819-3e3c1605964a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l9wfk\" (UID: \"fcbcb077-d8e4-4b8c-8819-3e3c1605964a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:29.554126 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.554089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" Jul 10 21:22:29.682175 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.681286 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:22:29.686926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.686897 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.690716 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.690454 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 21:22:29.690716 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.690477 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 21:22:29.690716 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.690508 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 21:22:29.690716 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.690455 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 21:22:29.690716 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.690678 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 21:22:29.691018 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.690754 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 21:22:29.691077 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.691061 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 21:22:29.692861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.691198 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fpnns\"" Jul 10 21:22:29.692861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.691537 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 21:22:29.692861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.691740 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 21:22:29.708613 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.708541 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:22:29.730672 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.730585 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk"] Jul 10 21:22:29.734526 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:29.734489 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbcb077_d8e4_4b8c_8819_3e3c1605964a.slice/crio-f33550d81519a2cb6ab5c61923af8da74a2802eedd7dab2f83670ec23cfb6bb8 WatchSource:0}: Error finding container f33550d81519a2cb6ab5c61923af8da74a2802eedd7dab2f83670ec23cfb6bb8: Status 404 returned error can't find the container with id f33550d81519a2cb6ab5c61923af8da74a2802eedd7dab2f83670ec23cfb6bb8 Jul 10 21:22:29.813225 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813194 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-web-config\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813468 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813257 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813468 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813283 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813468 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813468 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813427 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813493 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813528 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813581 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813609 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813639 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm598\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-kube-api-access-jm598\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.813683 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813669 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.814077 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.813729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-config-out\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915231 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.914949 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915231 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-config-out\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915231 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915049 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-web-config\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915231 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915087 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915612 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915482 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915612 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915522 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915612 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915551 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915620 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915724 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915937 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915757 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.915937 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.915791 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm598\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-kube-api-access-jm598\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.916076 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:29.916050 2584 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 10 21:22:29.916157 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:22:29.916132 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls podName:9ea3a86f-036d-4644-9121-72b189de85cc nodeName:}" failed. No retries permitted until 2026-07-10 21:22:30.416108781 +0000 UTC m=+74.169610644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc") : secret "alertmanager-main-tls" not found Jul 10 21:22:29.917242 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.916868 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.917242 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.916928 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.917242 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.917180 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.918987 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.918940 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.920745 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.920719 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.921637 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.921590 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.922176 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.922115 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.922273 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.922232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-web-config\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.922929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.922699 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.922929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.922883 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-config-out\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.924778 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.924698 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:29.927951 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:29.927905 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm598\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-kube-api-access-jm598\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:30.206489 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:30.206406 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" event={"ID":"9916eaa2-9992-4e2b-86e5-e3e34e40effd","Type":"ContainerStarted","Data":"63a71ca6b5f754eebdc0b2f952e1fa097b82621df7b1d6a60a58ef37d678d63c"} Jul 10 21:22:30.209626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:30.209490 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" event={"ID":"fcbcb077-d8e4-4b8c-8819-3e3c1605964a","Type":"ContainerStarted","Data":"93d6a87c8d3d081ba9ece2b51ce06470dc159eccddf6f14c4059510a44d83bcd"} Jul 10 21:22:30.209626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:30.209560 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" event={"ID":"fcbcb077-d8e4-4b8c-8819-3e3c1605964a","Type":"ContainerStarted","Data":"f33550d81519a2cb6ab5c61923af8da74a2802eedd7dab2f83670ec23cfb6bb8"} Jul 10 21:22:30.421781 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:30.421687 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:30.424881 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:30.424810 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:30.601052 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:30.600919 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:22:31.148473 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.148355 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:22:31.151909 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:31.151851 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea3a86f_036d_4644_9121_72b189de85cc.slice/crio-9e5b0b30dc7d3dbe004f9aca67631c5a7c884685456236882d530e85d5075d73 WatchSource:0}: Error finding container 9e5b0b30dc7d3dbe004f9aca67631c5a7c884685456236882d530e85d5075d73: Status 404 returned error can't find the container with id 9e5b0b30dc7d3dbe004f9aca67631c5a7c884685456236882d530e85d5075d73 Jul 10 21:22:31.217746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.217220 2584 generic.go:356] "Generic (PLEG): container finished" podID="9df38b93-73eb-41f0-8ea1-a5bace63d85e" containerID="a082ee20f7cd3d5dc6b11f40684c67f12bd4eb39ee7ff511b27eb0c1ea1ee217" exitCode=0 Jul 10 21:22:31.217746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.217415 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prnhl" event={"ID":"9df38b93-73eb-41f0-8ea1-a5bace63d85e","Type":"ContainerDied","Data":"a082ee20f7cd3d5dc6b11f40684c67f12bd4eb39ee7ff511b27eb0c1ea1ee217"} Jul 10 21:22:31.223326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.223299 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" event={"ID":"9916eaa2-9992-4e2b-86e5-e3e34e40effd","Type":"ContainerStarted","Data":"612b0347a02c03c0fe2f3f180a70d1078e724e09ca8005252af0bfd4bfd30f51"} Jul 10 21:22:31.223486 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.223382 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" event={"ID":"9916eaa2-9992-4e2b-86e5-e3e34e40effd","Type":"ContainerStarted","Data":"9ed515ada18cbb6a0771c28988d1ff7191f1b71e95c8e6f210a7d35e4b63dd43"} Jul 10 21:22:31.226502 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.226402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"9e5b0b30dc7d3dbe004f9aca67631c5a7c884685456236882d530e85d5075d73"} Jul 10 21:22:31.238932 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.238843 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" event={"ID":"fcbcb077-d8e4-4b8c-8819-3e3c1605964a","Type":"ContainerStarted","Data":"1c947fb9165852e618f3d5e3e098b27eeb3822dd87b75cdd46137de9fac84b8a"} Jul 10 21:22:31.588966 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.588880 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f4896d686-2mv7v"] Jul 10 21:22:31.593345 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.593322 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.595953 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.595927 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 21:22:31.596174 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.596157 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 21:22:31.596601 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.596341 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 21:22:31.596601 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.596467 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 21:22:31.596766 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.596658 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b2src3cku5499\"" Jul 10 21:22:31.597229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.596876 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4ck5z\"" Jul 10 21:22:31.597229 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.597072 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 21:22:31.606347 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.606309 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f4896d686-2mv7v"] Jul 10 21:22:31.737802 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.737768 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738003 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.737835 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738003 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.737867 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3bf0172-aff4-4e1d-9781-68aa60eed430-metrics-client-ca\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738003 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.737898 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738003 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.737924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738165 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.737998 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-tls\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738165 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.738057 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-grpc-tls\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.738165 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.738114 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fssb6\" (UniqueName: \"kubernetes.io/projected/f3bf0172-aff4-4e1d-9781-68aa60eed430-kube-api-access-fssb6\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839428 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3bf0172-aff4-4e1d-9781-68aa60eed430-metrics-client-ca\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839428 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839405 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-tls\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839553 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-grpc-tls\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839583 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fssb6\" (UniqueName: \"kubernetes.io/projected/f3bf0172-aff4-4e1d-9781-68aa60eed430-kube-api-access-fssb6\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839615 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.839910 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.839698 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.840611 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.840556 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3bf0172-aff4-4e1d-9781-68aa60eed430-metrics-client-ca\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.842757 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.842722 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.842935 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.842909 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-tls\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.843056 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.843034 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.843131 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.843062 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-grpc-tls\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.843312 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.843269 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.843712 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.843694 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3bf0172-aff4-4e1d-9781-68aa60eed430-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.849573 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.849548 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fssb6\" (UniqueName: \"kubernetes.io/projected/f3bf0172-aff4-4e1d-9781-68aa60eed430-kube-api-access-fssb6\") pod \"thanos-querier-6f4896d686-2mv7v\" (UID: \"f3bf0172-aff4-4e1d-9781-68aa60eed430\") " pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:31.909271 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:31.909235 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:32.247103 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:32.247067 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prnhl" event={"ID":"9df38b93-73eb-41f0-8ea1-a5bace63d85e","Type":"ContainerStarted","Data":"79352e493e9f45b54a7244cf777b903ba584c1c795135088e13a3750cfaf2782"} Jul 10 21:22:32.247565 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:32.247133 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prnhl" event={"ID":"9df38b93-73eb-41f0-8ea1-a5bace63d85e","Type":"ContainerStarted","Data":"4cc7a3da7c2341da4efaaaa0ddb9e2719380d90b64f2a9a3fd7ddaea43367721"} Jul 10 21:22:32.250005 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:32.249979 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" event={"ID":"9916eaa2-9992-4e2b-86e5-e3e34e40effd","Type":"ContainerStarted","Data":"97839d2f35790f2f3ade40b84ef8a8fd21d995d6ff324ba9625e273783a7394f"} Jul 10 21:22:32.267815 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:32.267746 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-prnhl" podStartSLOduration=3.013421006 podStartE2EDuration="4.267727316s" totalImagesPullingTime="1.166920296s" totalInitContainerRuntime="87.386014ms" isStatefulPod=true podCreationTimestamp="2026-07-10 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:32.266830867 +0000 UTC m=+76.020332751" watchObservedRunningTime="2026-07-10 21:22:32.267727316 +0000 UTC m=+76.021229193" Jul 10 21:22:32.288414 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:32.288347 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-6tqt4" podStartSLOduration=2.478588339 podStartE2EDuration="4.288328657s" totalImagesPullingTime="1.809740318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:32.286202504 +0000 UTC m=+76.039704387" watchObservedRunningTime="2026-07-10 21:22:32.288328657 +0000 UTC m=+76.041830535" Jul 10 21:22:33.091876 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.091836 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7577f8dd9d-trbnb"] Jul 10 21:22:33.099446 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.097853 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.102429 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.102398 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 21:22:33.103203 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.103184 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2oetu9l399grb\"" Jul 10 21:22:33.103625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.103589 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q4fs8\"" Jul 10 21:22:33.104019 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.104001 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 21:22:33.106641 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.105911 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 21:22:33.107667 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.107414 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7577f8dd9d-trbnb"] Jul 10 21:22:33.107667 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.107490 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 21:22:33.181401 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.181352 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f4896d686-2mv7v"] Jul 10 21:22:33.252589 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/75800305-f851-4bbd-ab58-e8cd124b8d19-audit-log\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.253053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-secret-metrics-server-client-certs\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.253053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252676 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/75800305-f851-4bbd-ab58-e8cd124b8d19-metrics-server-audit-profiles\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.253053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252708 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-client-ca-bundle\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.253053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-secret-metrics-server-tls\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.253053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252763 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngtkt\" (UniqueName: \"kubernetes.io/projected/75800305-f851-4bbd-ab58-e8cd124b8d19-kube-api-access-ngtkt\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.253053 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.252797 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75800305-f851-4bbd-ab58-e8cd124b8d19-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.257025 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.256973 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" event={"ID":"fcbcb077-d8e4-4b8c-8819-3e3c1605964a","Type":"ContainerStarted","Data":"e6e7c330061b1fe5dfd06252e00f4e3ebd4e64a974a712ac117fa30d3e44d8ea"} Jul 10 21:22:33.259434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.259401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b8f5dbf-stkkv" event={"ID":"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3","Type":"ContainerStarted","Data":"5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad"} Jul 10 21:22:33.279107 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.278997 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l9wfk" podStartSLOduration=2.461526563 podStartE2EDuration="5.278979451s" totalImagesPullingTime="2.817452888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:33.276717456 +0000 UTC m=+77.030219335" watchObservedRunningTime="2026-07-10 21:22:33.278979451 +0000 UTC m=+77.032481326" Jul 10 21:22:33.353505 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.353461 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75800305-f851-4bbd-ab58-e8cd124b8d19-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.353669 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.353613 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/75800305-f851-4bbd-ab58-e8cd124b8d19-audit-log\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.353916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.353893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-secret-metrics-server-client-certs\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.354010 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.353977 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/75800305-f851-4bbd-ab58-e8cd124b8d19-metrics-server-audit-profiles\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.354065 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.354032 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-client-ca-bundle\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.354241 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.354221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-secret-metrics-server-tls\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.354316 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.354289 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngtkt\" (UniqueName: \"kubernetes.io/projected/75800305-f851-4bbd-ab58-e8cd124b8d19-kube-api-access-ngtkt\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.355213 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.354518 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75800305-f851-4bbd-ab58-e8cd124b8d19-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.355213 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.354640 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/75800305-f851-4bbd-ab58-e8cd124b8d19-audit-log\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.355458 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.355433 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/75800305-f851-4bbd-ab58-e8cd124b8d19-metrics-server-audit-profiles\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.358089 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.358048 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-client-ca-bundle\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.358089 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.358079 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-secret-metrics-server-tls\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.358251 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.358166 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/75800305-f851-4bbd-ab58-e8cd124b8d19-secret-metrics-server-client-certs\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.370453 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.370315 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6b8f5dbf-stkkv" podStartSLOduration=1.519090109 podStartE2EDuration="5.370290958s" totalImagesPullingTime="3.851200849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:33.30205347 +0000 UTC m=+77.055555345" watchObservedRunningTime="2026-07-10 21:22:33.370290958 +0000 UTC m=+77.123792836" Jul 10 21:22:33.371077 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.370938 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj"] Jul 10 21:22:33.376116 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.376096 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.379758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.379712 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rsprd\"" Jul 10 21:22:33.380157 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.380135 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 21:22:33.381144 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.381119 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngtkt\" (UniqueName: \"kubernetes.io/projected/75800305-f851-4bbd-ab58-e8cd124b8d19-kube-api-access-ngtkt\") pod \"metrics-server-7577f8dd9d-trbnb\" (UID: \"75800305-f851-4bbd-ab58-e8cd124b8d19\") " pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.396174 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.396139 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj"] Jul 10 21:22:33.434347 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.434314 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:33.455824 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.455771 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdpr\" (UniqueName: \"kubernetes.io/projected/9631bcff-d3b4-44bd-843a-c89abb132109-kube-api-access-qtdpr\") pod \"monitoring-plugin-5f68df7f58-dt4bj\" (UID: \"9631bcff-d3b4-44bd-843a-c89abb132109\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.456021 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.455851 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9631bcff-d3b4-44bd-843a-c89abb132109-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-dt4bj\" (UID: \"9631bcff-d3b4-44bd-843a-c89abb132109\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.557377 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.557278 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdpr\" (UniqueName: \"kubernetes.io/projected/9631bcff-d3b4-44bd-843a-c89abb132109-kube-api-access-qtdpr\") pod \"monitoring-plugin-5f68df7f58-dt4bj\" (UID: \"9631bcff-d3b4-44bd-843a-c89abb132109\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.557562 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.557358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9631bcff-d3b4-44bd-843a-c89abb132109-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-dt4bj\" (UID: \"9631bcff-d3b4-44bd-843a-c89abb132109\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.560079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.560056 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9631bcff-d3b4-44bd-843a-c89abb132109-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-dt4bj\" (UID: \"9631bcff-d3b4-44bd-843a-c89abb132109\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.567087 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.567062 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdpr\" (UniqueName: \"kubernetes.io/projected/9631bcff-d3b4-44bd-843a-c89abb132109-kube-api-access-qtdpr\") pod \"monitoring-plugin-5f68df7f58-dt4bj\" (UID: \"9631bcff-d3b4-44bd-843a-c89abb132109\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.688969 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.688933 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:33.945273 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.945192 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f474498f8-hq6z8"] Jul 10 21:22:33.949005 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.948980 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:33.951714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.951430 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 21:22:33.951714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.951482 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 21:22:33.951714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.951430 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 21:22:33.951714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.951430 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 21:22:33.952068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.951899 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rdpq4\"" Jul 10 21:22:33.952068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.951938 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 21:22:33.957635 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.957604 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 21:22:33.963659 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:33.963632 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f474498f8-hq6z8"] Jul 10 21:22:34.061838 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.061797 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-federate-client-tls\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062036 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.061876 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89sm9\" (UniqueName: \"kubernetes.io/projected/0be48946-23b8-420a-8c6d-bd69f1559e18-kube-api-access-89sm9\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062036 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.061920 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062036 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.061961 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062036 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.062026 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-secret-telemeter-client\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.062063 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-telemeter-client-tls\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.062133 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-serving-certs-ca-bundle\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.062218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.062171 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-metrics-client-ca\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163622 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163584 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89sm9\" (UniqueName: \"kubernetes.io/projected/0be48946-23b8-420a-8c6d-bd69f1559e18-kube-api-access-89sm9\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163636 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163707 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-secret-telemeter-client\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163750 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-telemeter-client-tls\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163783 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-serving-certs-ca-bundle\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.163810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163807 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-metrics-client-ca\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.164058 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.163844 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-federate-client-tls\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.164856 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.164707 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.164856 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.164813 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-serving-certs-ca-bundle\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.164856 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.164824 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be48946-23b8-420a-8c6d-bd69f1559e18-metrics-client-ca\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.166680 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.166656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.166981 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.166960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-telemeter-client-tls\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.167136 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.167113 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-federate-client-tls\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.167498 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.167480 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0be48946-23b8-420a-8c6d-bd69f1559e18-secret-telemeter-client\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.173567 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.173539 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89sm9\" (UniqueName: \"kubernetes.io/projected/0be48946-23b8-420a-8c6d-bd69f1559e18-kube-api-access-89sm9\") pod \"telemeter-client-7f474498f8-hq6z8\" (UID: \"0be48946-23b8-420a-8c6d-bd69f1559e18\") " pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.260537 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.260499 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" Jul 10 21:22:34.913354 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.913321 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:22:34.926981 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.926949 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:34.932204 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.932166 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 21:22:34.932516 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.932490 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 21:22:34.932904 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.932885 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 21:22:34.933428 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.932930 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 21:22:34.934034 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.933881 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 21:22:34.934034 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934016 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 21:22:34.934192 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934102 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 21:22:34.934251 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934211 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-27iilhsmmvb43\"" Jul 10 21:22:34.934251 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934246 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 21:22:34.934386 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934346 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 21:22:34.934676 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934657 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z2xvx\"" Jul 10 21:22:34.934922 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.934905 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 21:22:34.935302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.935285 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 21:22:34.940856 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.940835 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 21:22:34.944679 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.944653 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 21:22:34.945893 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.945865 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 21:22:34.948406 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:34.948303 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:22:35.072355 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072314 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-config-out\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072546 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072393 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072546 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072430 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072546 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072458 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072546 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072546 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072517 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrhff\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-kube-api-access-nrhff\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072752 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072593 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072752 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072630 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072752 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072671 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072752 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072690 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-web-config\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072752 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072718 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072766 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072813 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-config\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072841 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072867 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072892 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.072942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072922 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.073156 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072953 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.073156 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.072974 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.073156 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.073020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.110432 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.110387 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7549dc445d-sn8ts" Jul 10 21:22:35.174533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174451 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174533 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174506 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174540 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-web-config\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174576 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174637 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-config\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.174760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174742 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174785 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174810 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174840 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174877 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-config-out\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.174978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.175013 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.175042 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrhff\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-kube-api-access-nrhff\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.175093 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.175487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.175395 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.176023 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.175638 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.176023 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.175872 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.177409 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.176838 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.177409 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.176907 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.177879 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.177754 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.178607 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.178168 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.178607 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.178465 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.181626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.179105 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.181626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.179204 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.182905 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.182880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.183509 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.183449 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-config\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.183509 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.183459 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-web-config\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.183854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.183812 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.184449 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.184418 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.184901 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.184879 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.185391 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.185350 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.185493 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.185442 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-config-out\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.188233 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.188204 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.190293 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.190267 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrhff\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-kube-api-access-nrhff\") pod \"prometheus-k8s-0\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:35.242464 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:35.242417 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:38.987796 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:38.987537 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:38.987796 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:38.987622 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:38.993686 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:38.993650 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:39.291773 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:39.291689 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:22:40.735374 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:40.735337 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bf0172_aff4_4e1d_9781_68aa60eed430.slice/crio-982048139c8741fe8a917aadd164e19a1082343f8a426718f5b0219054efb12f WatchSource:0}: Error finding container 982048139c8741fe8a917aadd164e19a1082343f8a426718f5b0219054efb12f: Status 404 returned error can't find the container with id 982048139c8741fe8a917aadd164e19a1082343f8a426718f5b0219054efb12f Jul 10 21:22:41.293670 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:41.293631 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"982048139c8741fe8a917aadd164e19a1082343f8a426718f5b0219054efb12f"} Jul 10 21:22:41.615988 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:41.615929 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:22:41.628573 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:41.628539 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59995da3_a935_4a1a_9a16_17c86540fc8e.slice/crio-cb1e51566bccd6a32f7b509f0bc14dbf2ac0658ca8afff5bc24ac1f78f12dc3a WatchSource:0}: Error finding container cb1e51566bccd6a32f7b509f0bc14dbf2ac0658ca8afff5bc24ac1f78f12dc3a: Status 404 returned error can't find the container with id cb1e51566bccd6a32f7b509f0bc14dbf2ac0658ca8afff5bc24ac1f78f12dc3a Jul 10 21:22:41.837737 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:41.837606 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj"] Jul 10 21:22:41.841007 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:41.840636 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7577f8dd9d-trbnb"] Jul 10 21:22:41.843928 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:41.843672 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9631bcff_d3b4_44bd_843a_c89abb132109.slice/crio-ae0b2d12f93417c4a7a55e0355b64418c5b39f8219094bbe242a8a838357cf0e WatchSource:0}: Error finding container ae0b2d12f93417c4a7a55e0355b64418c5b39f8219094bbe242a8a838357cf0e: Status 404 returned error can't find the container with id ae0b2d12f93417c4a7a55e0355b64418c5b39f8219094bbe242a8a838357cf0e Jul 10 21:22:41.844832 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:41.844772 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75800305_f851_4bbd_ab58_e8cd124b8d19.slice/crio-11169ddb047b0753ddc65ebfe0383a0f9fb1d1b526632aa661301cac6d0d36d6 WatchSource:0}: Error finding container 11169ddb047b0753ddc65ebfe0383a0f9fb1d1b526632aa661301cac6d0d36d6: Status 404 returned error can't find the container with id 11169ddb047b0753ddc65ebfe0383a0f9fb1d1b526632aa661301cac6d0d36d6 Jul 10 21:22:41.849479 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:41.849452 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f474498f8-hq6z8"] Jul 10 21:22:41.858604 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:22:41.858573 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be48946_23b8_420a_8c6d_bd69f1559e18.slice/crio-bf4444fcaf4da0a8d081705167e696871ec74e3a9e69cd1d54cca43062cf5e1b WatchSource:0}: Error finding container bf4444fcaf4da0a8d081705167e696871ec74e3a9e69cd1d54cca43062cf5e1b: Status 404 returned error can't find the container with id bf4444fcaf4da0a8d081705167e696871ec74e3a9e69cd1d54cca43062cf5e1b Jul 10 21:22:42.301816 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.301765 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-k4r9x" event={"ID":"616fdfab-149d-4ff6-9869-61b75480ea6d","Type":"ContainerStarted","Data":"a88c884ddba76013ed4262c660b0882294850bdc74386b17246f3c77aebd2e1f"} Jul 10 21:22:42.302474 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.302447 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:42.304953 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.304924 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" event={"ID":"75800305-f851-4bbd-ab58-e8cd124b8d19","Type":"ContainerStarted","Data":"11169ddb047b0753ddc65ebfe0383a0f9fb1d1b526632aa661301cac6d0d36d6"} Jul 10 21:22:42.307068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.307034 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" exitCode=0 Jul 10 21:22:42.307181 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.307071 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} Jul 10 21:22:42.307181 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.307147 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"cb1e51566bccd6a32f7b509f0bc14dbf2ac0658ca8afff5bc24ac1f78f12dc3a"} Jul 10 21:22:42.309704 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.309275 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee" exitCode=0 Jul 10 21:22:42.309704 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.309573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee"} Jul 10 21:22:42.312120 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.312052 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" event={"ID":"0be48946-23b8-420a-8c6d-bd69f1559e18","Type":"ContainerStarted","Data":"bf4444fcaf4da0a8d081705167e696871ec74e3a9e69cd1d54cca43062cf5e1b"} Jul 10 21:22:42.314227 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.314196 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" event={"ID":"9631bcff-d3b4-44bd-843a-c89abb132109","Type":"ContainerStarted","Data":"ae0b2d12f93417c4a7a55e0355b64418c5b39f8219094bbe242a8a838357cf0e"} Jul 10 21:22:42.320660 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.320605 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-k4r9x" podStartSLOduration=3.667824378 podStartE2EDuration="25.320585487s" totalImagesPullingTime="21.652761109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:42.319608925 +0000 UTC m=+86.073110803" watchObservedRunningTime="2026-07-10 21:22:42.320585487 +0000 UTC m=+86.074087368" Jul 10 21:22:42.324809 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:42.324782 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-k4r9x" Jul 10 21:22:48.066505 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:48.066464 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6b8f5dbf-stkkv"] Jul 10 21:22:49.361597 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:49.361557 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" event={"ID":"0be48946-23b8-420a-8c6d-bd69f1559e18","Type":"ContainerStarted","Data":"d4dc9de0bc709545ba369a91e5a81fb4e16075ba59645b4a7d7cecb01600fa01"} Jul 10 21:22:49.372881 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:49.370100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" event={"ID":"9631bcff-d3b4-44bd-843a-c89abb132109","Type":"ContainerStarted","Data":"cfa65406498602c8737b760f908a3fcfa9fe9c9d91cb236a69ad5104cc103825"} Jul 10 21:22:49.374000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:49.373089 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:49.381416 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:49.381333 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" Jul 10 21:22:49.395515 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:49.395463 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-dt4bj" podStartSLOduration=9.088797422 podStartE2EDuration="16.395442818s" totalImagesPullingTime="7.306645396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:49.390203317 +0000 UTC m=+93.143705196" watchObservedRunningTime="2026-07-10 21:22:49.395442818 +0000 UTC m=+93.148944697" Jul 10 21:22:50.378155 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.378109 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" event={"ID":"75800305-f851-4bbd-ab58-e8cd124b8d19","Type":"ContainerStarted","Data":"49a593e81389fb8c9c5af0172b472f1aec9729b56fb18b207c5bb736cb44b55f"} Jul 10 21:22:50.382342 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.382311 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} Jul 10 21:22:50.382505 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.382402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} Jul 10 21:22:50.382505 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.382443 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} Jul 10 21:22:50.382505 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.382483 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} Jul 10 21:22:50.382666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.382525 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} Jul 10 21:22:50.382666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.382569 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerStarted","Data":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} Jul 10 21:22:50.396070 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.396036 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc"} Jul 10 21:22:50.396252 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.396146 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1"} Jul 10 21:22:50.396252 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.396193 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30"} Jul 10 21:22:50.396252 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.396231 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76"} Jul 10 21:22:50.396442 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.396268 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046"} Jul 10 21:22:50.399845 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.399811 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"1273419db86a81cf75d346403ae97d10378634585637100c2eed342d78f516df"} Jul 10 21:22:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.399887 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"7f2cd9a4ca3e11fd89346ec9cbb98518bc81c6adaac7d34c8f85802754d2d7c4"} Jul 10 21:22:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.399938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"d4e296eab61cf36613db0b0786449d3952ff888de60b9951252e56c8c9071b42"} Jul 10 21:22:50.400108 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.400024 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" podStartSLOduration=10.094956796 podStartE2EDuration="17.400005837s" totalImagesPullingTime="7.305049041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:50.397908468 +0000 UTC m=+94.151410340" watchObservedRunningTime="2026-07-10 21:22:50.400005837 +0000 UTC m=+94.153507715" Jul 10 21:22:50.402351 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.402323 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" event={"ID":"0be48946-23b8-420a-8c6d-bd69f1559e18","Type":"ContainerStarted","Data":"f63419a77d9f10bc48477e0e9b9cb1bc479667737a0d385fa67ff94e025376d2"} Jul 10 21:22:50.402507 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.402402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" event={"ID":"0be48946-23b8-420a-8c6d-bd69f1559e18","Type":"ContainerStarted","Data":"7786370e3e98f019456eb3089b3fd004a85df92bc3975c7fecbc6fd8d1eb4a67"} Jul 10 21:22:50.429011 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.428948 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.51064949 podStartE2EDuration="16.428926258s" totalImagesPullingTime="6.894785841s" totalInitContainerRuntime="23.490927ms" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:50.427983622 +0000 UTC m=+94.181485501" watchObservedRunningTime="2026-07-10 21:22:50.428926258 +0000 UTC m=+94.182428136" Jul 10 21:22:50.452693 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:50.452630 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f474498f8-hq6z8" podStartSLOduration=10.162379402 podStartE2EDuration="17.452608249s" totalImagesPullingTime="7.290228847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:50.45067973 +0000 UTC m=+94.204181607" watchObservedRunningTime="2026-07-10 21:22:50.452608249 +0000 UTC m=+94.206110128" Jul 10 21:22:52.414447 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.414407 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"c3d91fafb069b16abc3051e750cc232473cf5f16b5a8c5581e95aef7b4eb1dcc"} Jul 10 21:22:52.414935 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.414535 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"26e6994293c65d7e48c2dcbcd451698b4182e72814ea432d1917d43b39934ea6"} Jul 10 21:22:52.414935 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.414581 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" event={"ID":"f3bf0172-aff4-4e1d-9781-68aa60eed430","Type":"ContainerStarted","Data":"398ea88d4a1602ee3995f1cf2ca6c9450e36adf67e86367c3f7cb29e7620491a"} Jul 10 21:22:52.414935 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.414628 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:22:52.417582 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.417558 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerStarted","Data":"ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010"} Jul 10 21:22:52.440322 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.440243 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" podStartSLOduration=11.907740738 podStartE2EDuration="21.440221566s" totalImagesPullingTime="9.532480828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:52.439250878 +0000 UTC m=+96.192752760" watchObservedRunningTime="2026-07-10 21:22:52.440221566 +0000 UTC m=+96.193723454" Jul 10 21:22:52.470702 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:52.470618 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.041512278 podStartE2EDuration="23.470596922s" totalImagesPullingTime="18.413667759s" totalInitContainerRuntime="15.416885ms" isStatefulPod=false podCreationTimestamp="2026-07-10 21:22:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:22:52.470563355 +0000 UTC m=+96.224065236" watchObservedRunningTime="2026-07-10 21:22:52.470596922 +0000 UTC m=+96.224098807" Jul 10 21:22:53.435331 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:53.435290 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:53.435765 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:53.435349 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:22:55.243472 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:55.243436 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:22:58.427999 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:22:58.427969 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f4896d686-2mv7v" Jul 10 21:23:00.212931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:00.212900 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mltmx" Jul 10 21:23:13.095948 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.095901 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d6b8f5dbf-stkkv" podUID="5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" containerName="console" containerID="cri-o://5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad" gracePeriod=15 Jul 10 21:23:13.364188 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.364107 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:23:13.439689 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.439658 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:23:13.443553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.443529 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7577f8dd9d-trbnb" Jul 10 21:23:13.464690 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.464658 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-serving-cert\") pod \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " Jul 10 21:23:13.464690 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.464698 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-oauth-config\") pod \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " Jul 10 21:23:13.464892 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.464724 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-oauth-serving-cert\") pod \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " Jul 10 21:23:13.464892 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.464767 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-service-ca\") pod \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " Jul 10 21:23:13.464892 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.464829 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mk4z\" (UniqueName: \"kubernetes.io/projected/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-kube-api-access-4mk4z\") pod \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " Jul 10 21:23:13.464892 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.464860 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-config\") pod \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\" (UID: \"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3\") " Jul 10 21:23:13.465271 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.465237 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" (UID: "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:13.465421 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.465267 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-service-ca" (OuterVolumeSpecName: "service-ca") pod "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" (UID: "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:13.465421 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.465326 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-config" (OuterVolumeSpecName: "console-config") pod "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" (UID: "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:13.467184 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.467161 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" (UID: "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:13.467276 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.467227 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" (UID: "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:13.467276 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.467223 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-kube-api-access-4mk4z" (OuterVolumeSpecName: "kube-api-access-4mk4z") pod "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" (UID: "5240fd8a-3e57-4426-9a53-3b53d6f6b6b3"). InnerVolumeSpecName "kube-api-access-4mk4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:23:13.509665 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.509624 2584 generic.go:356] "Generic (PLEG): container finished" podID="5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" containerID="5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad" exitCode=0 Jul 10 21:23:13.509854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.509688 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6b8f5dbf-stkkv" Jul 10 21:23:13.509854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.509714 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b8f5dbf-stkkv" event={"ID":"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3","Type":"ContainerDied","Data":"5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad"} Jul 10 21:23:13.509854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.509773 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6b8f5dbf-stkkv" event={"ID":"5240fd8a-3e57-4426-9a53-3b53d6f6b6b3","Type":"ContainerDied","Data":"1bdb4541ad4a44633ecbbdbfdfebd942bc5e6c7c4e23d45ea06bfa3c42247e83"} Jul 10 21:23:13.509854 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.509818 2584 scope.go:117] "RemoveContainer" containerID="5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad" Jul 10 21:23:13.524585 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.524562 2584 scope.go:117] "RemoveContainer" containerID="5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad" Jul 10 21:23:13.524838 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:13.524817 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad\": container with ID starting with 5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad not found: ID does not exist" containerID="5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad" Jul 10 21:23:13.524890 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.524847 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad"} err="failed to get container status \"5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad\": rpc error: code = NotFound desc = could not find container \"5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad\": container with ID starting with 5eb6cac6e39b0e0dccbc2720d5c3b61008c227d8a815109987364ff4c7d799ad not found: ID does not exist" Jul 10 21:23:13.531124 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.531100 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6b8f5dbf-stkkv"] Jul 10 21:23:13.535073 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.535053 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d6b8f5dbf-stkkv"] Jul 10 21:23:13.566625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.566592 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mk4z\" (UniqueName: \"kubernetes.io/projected/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-kube-api-access-4mk4z\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:13.566625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.566624 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-config\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:13.566841 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.566640 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-serving-cert\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:13.566841 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.566653 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-console-oauth-config\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:13.566841 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.566667 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-oauth-serving-cert\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:13.566841 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:13.566680 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3-service-ca\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:14.852191 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:14.852154 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" path="/var/lib/kubelet/pods/5240fd8a-3e57-4426-9a53-3b53d6f6b6b3/volumes" Jul 10 21:23:35.242954 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:35.242914 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:35.295940 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:35.295913 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:35.617071 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:35.616982 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:49.070616 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.070575 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:23:49.071189 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.071061 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy" containerID="cri-o://9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1" gracePeriod=120 Jul 10 21:23:49.071189 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.071085 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="alertmanager" containerID="cri-o://aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046" gracePeriod=120 Jul 10 21:23:49.071189 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.071075 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="config-reloader" containerID="cri-o://5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76" gracePeriod=120 Jul 10 21:23:49.071189 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.071089 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="prom-label-proxy" containerID="cri-o://ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010" gracePeriod=120 Jul 10 21:23:49.071189 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.071044 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-metric" containerID="cri-o://7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc" gracePeriod=120 Jul 10 21:23:49.071457 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.071043 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-web" containerID="cri-o://a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30" gracePeriod=120 Jul 10 21:23:49.665700 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665660 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010" exitCode=0 Jul 10 21:23:49.665700 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665684 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc" exitCode=0 Jul 10 21:23:49.665700 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665693 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1" exitCode=0 Jul 10 21:23:49.665700 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665701 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76" exitCode=0 Jul 10 21:23:49.665970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665712 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046" exitCode=0 Jul 10 21:23:49.665970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665730 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010"} Jul 10 21:23:49.665970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665795 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc"} Jul 10 21:23:49.665970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665824 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1"} Jul 10 21:23:49.665970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665848 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76"} Jul 10 21:23:49.665970 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:49.665873 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046"} Jul 10 21:23:50.316558 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.316530 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.399724 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399636 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-web-config\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.399724 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399677 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.399724 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399708 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-web\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399738 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399792 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399815 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-config-out\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399844 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm598\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-kube-api-access-jm598\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399865 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-tls-assets\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399911 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-cluster-tls-config\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399941 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-trusted-ca-bundle\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.399967 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-config-volume\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.400007 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-main-db\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.400040 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-metrics-client-ca\") pod \"9ea3a86f-036d-4644-9121-72b189de85cc\" (UID: \"9ea3a86f-036d-4644-9121-72b189de85cc\") " Jul 10 21:23:50.400917 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.400696 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:50.401183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.401132 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:23:50.401183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.401133 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:50.402670 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.402641 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.403129 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.403085 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.403220 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.403172 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.403412 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.403350 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.403520 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.403499 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:23:50.403916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.403873 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-config-volume" (OuterVolumeSpecName: "config-volume") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.404005 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.403979 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-config-out" (OuterVolumeSpecName: "config-out") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:23:50.404306 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.404287 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-kube-api-access-jm598" (OuterVolumeSpecName: "kube-api-access-jm598") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "kube-api-access-jm598". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:23:50.407827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.407530 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.414394 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.414348 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-web-config" (OuterVolumeSpecName: "web-config") pod "9ea3a86f-036d-4644-9121-72b189de85cc" (UID: "9ea3a86f-036d-4644-9121-72b189de85cc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:50.501066 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501024 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-config-out\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501066 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501061 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm598\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-kube-api-access-jm598\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501077 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ea3a86f-036d-4644-9121-72b189de85cc-tls-assets\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501090 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-cluster-tls-config\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501103 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501116 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-config-volume\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501131 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ea3a86f-036d-4644-9121-72b189de85cc-alertmanager-main-db\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501143 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ea3a86f-036d-4644-9121-72b189de85cc-metrics-client-ca\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501159 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-web-config\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501171 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-main-tls\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501184 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501198 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.501302 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.501209 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ea3a86f-036d-4644-9121-72b189de85cc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:50.672637 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.672550 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ea3a86f-036d-4644-9121-72b189de85cc" containerID="a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30" exitCode=0 Jul 10 21:23:50.672637 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.672605 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30"} Jul 10 21:23:50.672637 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.672632 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.672861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.672664 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ea3a86f-036d-4644-9121-72b189de85cc","Type":"ContainerDied","Data":"9e5b0b30dc7d3dbe004f9aca67631c5a7c884685456236882d530e85d5075d73"} Jul 10 21:23:50.672861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.672703 2584 scope.go:117] "RemoveContainer" containerID="ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010" Jul 10 21:23:50.681724 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.681702 2584 scope.go:117] "RemoveContainer" containerID="7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc" Jul 10 21:23:50.689254 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.689230 2584 scope.go:117] "RemoveContainer" containerID="9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1" Jul 10 21:23:50.697587 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.697554 2584 scope.go:117] "RemoveContainer" containerID="a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30" Jul 10 21:23:50.698893 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.698875 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:23:50.706005 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.705983 2584 scope.go:117] "RemoveContainer" containerID="5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76" Jul 10 21:23:50.706096 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.706077 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:23:50.713357 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.713338 2584 scope.go:117] "RemoveContainer" containerID="aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046" Jul 10 21:23:50.720637 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.720618 2584 scope.go:117] "RemoveContainer" containerID="a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee" Jul 10 21:23:50.728068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728051 2584 scope.go:117] "RemoveContainer" containerID="ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010" Jul 10 21:23:50.728345 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.728325 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010\": container with ID starting with ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010 not found: ID does not exist" containerID="ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010" Jul 10 21:23:50.728410 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728356 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010"} err="failed to get container status \"ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010\": rpc error: code = NotFound desc = could not find container \"ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010\": container with ID starting with ed7f46dbcade9b77df1fd77d2bc08077b6f2ff494ce479d909d6d1c70c4b5010 not found: ID does not exist" Jul 10 21:23:50.728410 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728397 2584 scope.go:117] "RemoveContainer" containerID="7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc" Jul 10 21:23:50.728641 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.728624 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc\": container with ID starting with 7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc not found: ID does not exist" containerID="7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc" Jul 10 21:23:50.728678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728648 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc"} err="failed to get container status \"7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc\": rpc error: code = NotFound desc = could not find container \"7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc\": container with ID starting with 7dbb2755f7a696b418463626a22fe8abf7bce250f7910a0c05b5aa6e97432fbc not found: ID does not exist" Jul 10 21:23:50.728678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728665 2584 scope.go:117] "RemoveContainer" containerID="9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1" Jul 10 21:23:50.728889 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.728871 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1\": container with ID starting with 9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1 not found: ID does not exist" containerID="9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1" Jul 10 21:23:50.728931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728895 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1"} err="failed to get container status \"9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1\": rpc error: code = NotFound desc = could not find container \"9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1\": container with ID starting with 9de74c0dfa48c630425f299df982091df7a4a4358bf5cb238b573a77284ebce1 not found: ID does not exist" Jul 10 21:23:50.728931 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.728912 2584 scope.go:117] "RemoveContainer" containerID="a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30" Jul 10 21:23:50.729118 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.729102 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30\": container with ID starting with a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30 not found: ID does not exist" containerID="a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30" Jul 10 21:23:50.729153 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729122 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30"} err="failed to get container status \"a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30\": rpc error: code = NotFound desc = could not find container \"a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30\": container with ID starting with a948f717ccc2e643d2bdcaacd16bcfbb4f1eeaf91628ade1139d89fd04a8ab30 not found: ID does not exist" Jul 10 21:23:50.729153 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729135 2584 scope.go:117] "RemoveContainer" containerID="5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76" Jul 10 21:23:50.729382 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.729351 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76\": container with ID starting with 5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76 not found: ID does not exist" containerID="5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76" Jul 10 21:23:50.729434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729389 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76"} err="failed to get container status \"5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76\": rpc error: code = NotFound desc = could not find container \"5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76\": container with ID starting with 5e96a659063820b3c26fef2ec55e7bdf3b70c7b84d6a71cbba9fddf12a56ed76 not found: ID does not exist" Jul 10 21:23:50.729434 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729405 2584 scope.go:117] "RemoveContainer" containerID="aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046" Jul 10 21:23:50.729641 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.729624 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046\": container with ID starting with aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046 not found: ID does not exist" containerID="aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046" Jul 10 21:23:50.729720 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729645 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046"} err="failed to get container status \"aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046\": rpc error: code = NotFound desc = could not find container \"aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046\": container with ID starting with aedf6a4d3a3c74fa310d8c188f85f41a1d07ff40ff07859d8dc7f3b4dd1b8046 not found: ID does not exist" Jul 10 21:23:50.729720 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729660 2584 scope.go:117] "RemoveContainer" containerID="a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee" Jul 10 21:23:50.729872 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:50.729854 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee\": container with ID starting with a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee not found: ID does not exist" containerID="a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee" Jul 10 21:23:50.729911 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.729877 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee"} err="failed to get container status \"a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee\": rpc error: code = NotFound desc = could not find container \"a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee\": container with ID starting with a20a636b82eb140dbf0d4125b602ee379d725dae0be40c2d3f8ddc083896b9ee not found: ID does not exist" Jul 10 21:23:50.738799 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.738776 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:23:50.739098 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739085 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-metric" Jul 10 21:23:50.739138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739100 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-metric" Jul 10 21:23:50.739138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739111 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="config-reloader" Jul 10 21:23:50.739138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739117 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="config-reloader" Jul 10 21:23:50.739138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739125 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy" Jul 10 21:23:50.739138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739130 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy" Jul 10 21:23:50.739138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739138 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="prom-label-proxy" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739144 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="prom-label-proxy" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739152 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="alertmanager" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739157 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="alertmanager" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739169 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-web" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739175 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-web" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739184 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" containerName="console" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739189 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" containerName="console" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739196 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="init-config-reloader" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739201 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="init-config-reloader" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739245 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-web" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739252 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="prom-label-proxy" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739260 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy-metric" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739266 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5240fd8a-3e57-4426-9a53-3b53d6f6b6b3" containerName="console" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739271 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="alertmanager" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739279 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="config-reloader" Jul 10 21:23:50.739307 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.739284 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" containerName="kube-rbac-proxy" Jul 10 21:23:50.743018 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.743001 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.745623 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.745595 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 21:23:50.745623 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.745611 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 21:23:50.745804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.745661 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 21:23:50.745804 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.745668 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 21:23:50.745915 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.745869 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 21:23:50.746114 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.746095 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fpnns\"" Jul 10 21:23:50.746183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.746115 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 21:23:50.746183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.746147 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 21:23:50.746311 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.746209 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 21:23:50.756491 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.754947 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 21:23:50.763081 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.763053 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:23:50.851555 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.851523 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea3a86f-036d-4644-9121-72b189de85cc" path="/var/lib/kubelet/pods/9ea3a86f-036d-4644-9121-72b189de85cc/volumes" Jul 10 21:23:50.905600 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/213d2477-9d4e-422f-88d8-9ee78431e22d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905704 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905602 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905704 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905631 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905775 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905716 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/213d2477-9d4e-422f-88d8-9ee78431e22d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905811 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905775 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905811 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/213d2477-9d4e-422f-88d8-9ee78431e22d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905874 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905857 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6c6r\" (UniqueName: \"kubernetes.io/projected/213d2477-9d4e-422f-88d8-9ee78431e22d-kube-api-access-m6c6r\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905906 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.905942 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905926 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-config-volume\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.906003 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905952 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-web-config\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.906003 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.905976 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/213d2477-9d4e-422f-88d8-9ee78431e22d-config-out\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:50.906065 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:50.906001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/213d2477-9d4e-422f-88d8-9ee78431e22d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007472 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007472 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-config-volume\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007498 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-web-config\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007523 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/213d2477-9d4e-422f-88d8-9ee78431e22d-config-out\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/213d2477-9d4e-422f-88d8-9ee78431e22d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007580 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/213d2477-9d4e-422f-88d8-9ee78431e22d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007604 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007637 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.007725 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007695 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/213d2477-9d4e-422f-88d8-9ee78431e22d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.008079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.008079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007750 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/213d2477-9d4e-422f-88d8-9ee78431e22d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.008079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007806 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6c6r\" (UniqueName: \"kubernetes.io/projected/213d2477-9d4e-422f-88d8-9ee78431e22d-kube-api-access-m6c6r\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.008079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.007833 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.008079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.008007 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/213d2477-9d4e-422f-88d8-9ee78431e22d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.010929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010661 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.010929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010661 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-config-volume\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.010929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010666 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/213d2477-9d4e-422f-88d8-9ee78431e22d-config-out\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.010929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010736 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.010929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010749 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/213d2477-9d4e-422f-88d8-9ee78431e22d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.010929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010870 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.011259 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.010972 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.011259 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.011119 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-web-config\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.011259 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.011232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/213d2477-9d4e-422f-88d8-9ee78431e22d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.011436 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.011419 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/213d2477-9d4e-422f-88d8-9ee78431e22d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.012589 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.012571 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/213d2477-9d4e-422f-88d8-9ee78431e22d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.019505 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.019484 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6c6r\" (UniqueName: \"kubernetes.io/projected/213d2477-9d4e-422f-88d8-9ee78431e22d-kube-api-access-m6c6r\") pod \"alertmanager-main-0\" (UID: \"213d2477-9d4e-422f-88d8-9ee78431e22d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.059635 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.059602 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 21:23:51.201068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.201013 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 21:23:51.203667 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:23:51.203641 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213d2477_9d4e_422f_88d8_9ee78431e22d.slice/crio-34e2e9498aa982c164ad5fcb4e262e3438322a138bf13b42bae06aefe0c3fff6 WatchSource:0}: Error finding container 34e2e9498aa982c164ad5fcb4e262e3438322a138bf13b42bae06aefe0c3fff6: Status 404 returned error can't find the container with id 34e2e9498aa982c164ad5fcb4e262e3438322a138bf13b42bae06aefe0c3fff6 Jul 10 21:23:51.678825 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.678732 2584 generic.go:356] "Generic (PLEG): container finished" podID="213d2477-9d4e-422f-88d8-9ee78431e22d" containerID="0c9d2d470f8beceed4abf836b9ef8a4a7023e8d1fde1ad1599ee932186a52b52" exitCode=0 Jul 10 21:23:51.679254 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.678820 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerDied","Data":"0c9d2d470f8beceed4abf836b9ef8a4a7023e8d1fde1ad1599ee932186a52b52"} Jul 10 21:23:51.679254 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:51.678903 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"34e2e9498aa982c164ad5fcb4e262e3438322a138bf13b42bae06aefe0c3fff6"} Jul 10 21:23:52.687433 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.687398 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"b929d168a8aa58f6693b208cbd30ac748be28bfbd4b8b14f46f7ccbcbe8f64b7"} Jul 10 21:23:52.687830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.687468 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"127c28af7f55bbf0c91f13878af8ea2e60cbc2a4cccc980fa4c8feda61da2159"} Jul 10 21:23:52.687830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.687509 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"079985675f3afd4831a8a7a900a6bc3934254c4085b092f8bf5bb474bf26a56e"} Jul 10 21:23:52.687830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.687540 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"d22e2121438334c40c531bd4650dad673ad9b9e6241c9acc3a49e478bcc49734"} Jul 10 21:23:52.687830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.687580 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"40be2a40f41db8ef2806a45a688882d409d09f01caa2b81f24359d365e5d8c88"} Jul 10 21:23:52.687830 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.687605 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"213d2477-9d4e-422f-88d8-9ee78431e22d","Type":"ContainerStarted","Data":"172e720dc86f89c242c3599cc6808061a68dff62194cee43deeba1c0bfb2a825"} Jul 10 21:23:52.717089 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:52.717003 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.701092803 podStartE2EDuration="2.716979886s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.887083ms" isStatefulPod=false podCreationTimestamp="2026-07-10 21:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:23:52.714662864 +0000 UTC m=+156.468164741" watchObservedRunningTime="2026-07-10 21:23:52.716979886 +0000 UTC m=+156.470481765" Jul 10 21:23:53.313872 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.313831 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:23:53.314539 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.314500 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="prometheus" containerID="cri-o://dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" gracePeriod=600 Jul 10 21:23:53.314934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.314909 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" gracePeriod=600 Jul 10 21:23:53.315041 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.315021 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy" containerID="cri-o://9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" gracePeriod=600 Jul 10 21:23:53.315122 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.315106 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-web" containerID="cri-o://40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" gracePeriod=600 Jul 10 21:23:53.315190 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.315177 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="thanos-sidecar" containerID="cri-o://cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" gracePeriod=600 Jul 10 21:23:53.315264 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.315250 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="config-reloader" containerID="cri-o://4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" gracePeriod=600 Jul 10 21:23:53.572686 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.572618 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:53.695250 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695211 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" exitCode=0 Jul 10 21:23:53.695250 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695245 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" exitCode=0 Jul 10 21:23:53.695250 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695254 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" exitCode=0 Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695263 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" exitCode=0 Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695272 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" exitCode=0 Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695280 2584 generic.go:356] "Generic (PLEG): container finished" podID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" exitCode=0 Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695284 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695314 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695352 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695398 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695414 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695469 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695555 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} Jul 10 21:23:53.695741 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.695601 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59995da3-a935-4a1a-9a16-17c86540fc8e","Type":"ContainerDied","Data":"cb1e51566bccd6a32f7b509f0bc14dbf2ac0658ca8afff5bc24ac1f78f12dc3a"} Jul 10 21:23:53.705698 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.705415 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.713034 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.713015 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.720235 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.720214 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.727557 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.727535 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.735061 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.735041 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.737191 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737171 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-metrics-client-certs\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737350 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737220 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-db\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737350 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737254 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-thanos-prometheus-http-client-file\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737483 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737418 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-config\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737483 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737469 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrhff\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-kube-api-access-nrhff\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737577 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737510 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-kube-rbac-proxy\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737577 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737544 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-kubelet-serving-ca-bundle\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737577 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737575 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-config-out\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737732 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737624 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737732 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737668 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-tls-assets\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737732 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737694 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-0\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737871 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737732 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-2\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737871 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737758 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-1\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737871 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737827 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-grpc-tls\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.737871 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737854 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.738059 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737886 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-tls\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.738059 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737913 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-metrics-client-ca\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.738059 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737942 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-web-config\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.738059 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737966 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-trusted-ca-bundle\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.738059 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.737990 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-serving-certs-ca-bundle\") pod \"59995da3-a935-4a1a-9a16-17c86540fc8e\" (UID: \"59995da3-a935-4a1a-9a16-17c86540fc8e\") " Jul 10 21:23:53.739162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.738685 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:23:53.739162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.738722 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.739162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.738780 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.739162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.738795 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.739162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.739143 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.740074 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.740045 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.740203 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.740122 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.740616 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.740591 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.740696 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.740671 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.740818 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.740785 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 21:23:53.741671 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.741643 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-config" (OuterVolumeSpecName: "config") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.741926 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.741874 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.742193 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.742131 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-kube-api-access-nrhff" (OuterVolumeSpecName: "kube-api-access-nrhff") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "kube-api-access-nrhff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:23:53.742636 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.742582 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:23:53.742786 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.742744 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-config-out" (OuterVolumeSpecName: "config-out") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:23:53.742871 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.742847 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.743400 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.743351 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.743400 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.743386 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.745635 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.743772 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.747763 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.747744 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.753815 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.753790 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-web-config" (OuterVolumeSpecName: "web-config") pod "59995da3-a935-4a1a-9a16-17c86540fc8e" (UID: "59995da3-a935-4a1a-9a16-17c86540fc8e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:23:53.755406 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.755382 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.755697 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.755678 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.755754 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.755707 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} err="failed to get container status \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" Jul 10 21:23:53.755754 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.755726 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.755953 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.755938 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.755991 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.755957 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} err="failed to get container status \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" Jul 10 21:23:53.755991 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.755971 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.756191 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.756173 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.756226 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756197 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} err="failed to get container status \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" Jul 10 21:23:53.756226 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756213 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.756427 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.756410 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.756464 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756431 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} err="failed to get container status \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" Jul 10 21:23:53.756464 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756443 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.756684 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.756666 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.756746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756690 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} err="failed to get container status \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" Jul 10 21:23:53.756746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756714 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.756964 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.756948 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.757010 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756968 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} err="failed to get container status \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" Jul 10 21:23:53.757010 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.756988 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.757192 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:23:53.757178 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.757227 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757196 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} err="failed to get container status \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" Jul 10 21:23:53.757227 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757213 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.757455 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757437 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} err="failed to get container status \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" Jul 10 21:23:53.757508 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757456 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.757660 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757642 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} err="failed to get container status \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" Jul 10 21:23:53.757709 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757661 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.757852 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757830 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} err="failed to get container status \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" Jul 10 21:23:53.757852 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.757851 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.758073 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758055 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} err="failed to get container status \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" Jul 10 21:23:53.758127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758074 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.758264 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758244 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} err="failed to get container status \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" Jul 10 21:23:53.758318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758265 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.758440 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758425 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} err="failed to get container status \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" Jul 10 21:23:53.758495 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758441 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.758633 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758618 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} err="failed to get container status \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" Jul 10 21:23:53.758672 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758632 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.758852 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758831 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} err="failed to get container status \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" Jul 10 21:23:53.758922 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.758853 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.759101 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759082 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} err="failed to get container status \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" Jul 10 21:23:53.759153 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759103 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.759330 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759305 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} err="failed to get container status \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" Jul 10 21:23:53.759330 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759321 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.759564 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759549 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} err="failed to get container status \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" Jul 10 21:23:53.759607 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759565 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.759774 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759760 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} err="failed to get container status \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" Jul 10 21:23:53.759832 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759773 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.760000 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.759984 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} err="failed to get container status \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" Jul 10 21:23:53.760043 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760002 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.760243 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760219 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} err="failed to get container status \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" Jul 10 21:23:53.760313 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760247 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.760534 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760516 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} err="failed to get container status \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" Jul 10 21:23:53.760590 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760533 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.760749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760723 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} err="failed to get container status \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" Jul 10 21:23:53.760749 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760742 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.760974 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760956 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} err="failed to get container status \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" Jul 10 21:23:53.761035 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.760976 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.761194 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761178 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} err="failed to get container status \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" Jul 10 21:23:53.761236 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761195 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.761403 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761387 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} err="failed to get container status \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" Jul 10 21:23:53.761475 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761405 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.761679 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761663 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} err="failed to get container status \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" Jul 10 21:23:53.761679 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761680 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.761907 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761888 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} err="failed to get container status \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" Jul 10 21:23:53.761966 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.761909 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.762108 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762080 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} err="failed to get container status \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" Jul 10 21:23:53.762162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762108 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.762330 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762312 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} err="failed to get container status \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" Jul 10 21:23:53.762446 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762330 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.762584 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762566 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} err="failed to get container status \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" Jul 10 21:23:53.762625 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762585 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.762821 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762801 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} err="failed to get container status \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" Jul 10 21:23:53.762860 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.762823 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.763041 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763024 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} err="failed to get container status \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" Jul 10 21:23:53.763086 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763042 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.763237 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763220 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} err="failed to get container status \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" Jul 10 21:23:53.763276 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763237 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.763455 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763433 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} err="failed to get container status \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" Jul 10 21:23:53.763508 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763455 2584 scope.go:117] "RemoveContainer" containerID="f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0" Jul 10 21:23:53.763672 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763657 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0"} err="failed to get container status \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": rpc error: code = NotFound desc = could not find container \"f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0\": container with ID starting with f1e0b5db9d303c38eef13fb37b1af815efd37090193a8450f521d00dc46c1cb0 not found: ID does not exist" Jul 10 21:23:53.763720 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763672 2584 scope.go:117] "RemoveContainer" containerID="9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2" Jul 10 21:23:53.763886 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763869 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2"} err="failed to get container status \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": rpc error: code = NotFound desc = could not find container \"9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2\": container with ID starting with 9126069fc71d49e4b5939e30c43c0fece43839db33d968b1c0f3b1b6fed14da2 not found: ID does not exist" Jul 10 21:23:53.763936 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.763887 2584 scope.go:117] "RemoveContainer" containerID="40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54" Jul 10 21:23:53.764085 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764070 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54"} err="failed to get container status \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": rpc error: code = NotFound desc = could not find container \"40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54\": container with ID starting with 40db4c910f928397739c9110fe029c9cc321eb78517278fb9312e8d39ce58f54 not found: ID does not exist" Jul 10 21:23:53.764127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764085 2584 scope.go:117] "RemoveContainer" containerID="cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985" Jul 10 21:23:53.764271 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764256 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985"} err="failed to get container status \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": rpc error: code = NotFound desc = could not find container \"cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985\": container with ID starting with cae2bf42430ee56973ec364569e5cfa402167b421ac3ed7efdad8ceb27246985 not found: ID does not exist" Jul 10 21:23:53.764324 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764272 2584 scope.go:117] "RemoveContainer" containerID="4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f" Jul 10 21:23:53.764468 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764453 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f"} err="failed to get container status \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": rpc error: code = NotFound desc = could not find container \"4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f\": container with ID starting with 4b62f13d133582957c9a85b42ff22bffc4134e354c14b8148e2cb4588397af9f not found: ID does not exist" Jul 10 21:23:53.764519 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764469 2584 scope.go:117] "RemoveContainer" containerID="dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a" Jul 10 21:23:53.764708 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764690 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a"} err="failed to get container status \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": rpc error: code = NotFound desc = could not find container \"dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a\": container with ID starting with dff95819750ae75835951b79da92a51f62535128dccfbdb6cd1607400b837b8a not found: ID does not exist" Jul 10 21:23:53.764751 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764708 2584 scope.go:117] "RemoveContainer" containerID="dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f" Jul 10 21:23:53.764903 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.764888 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f"} err="failed to get container status \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": rpc error: code = NotFound desc = could not find container \"dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f\": container with ID starting with dac5d84f7374d2de2577a948762dbbb9ce1639395b3d30cc8c8ae316b91be70f not found: ID does not exist" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839299 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839325 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839340 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-config-out\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839355 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839396 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-tls-assets\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839404 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839413 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839413 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839421 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839430 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-grpc-tls\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839443 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839456 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839465 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-metrics-client-ca\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839474 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-web-config\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839483 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839492 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59995da3-a935-4a1a-9a16-17c86540fc8e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839500 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-secret-metrics-client-certs\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839508 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59995da3-a935-4a1a-9a16-17c86540fc8e-prometheus-k8s-db\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839516 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839525 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/59995da3-a935-4a1a-9a16-17c86540fc8e-config\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:53.839827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:53.839533 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrhff\" (UniqueName: \"kubernetes.io/projected/59995da3-a935-4a1a-9a16-17c86540fc8e-kube-api-access-nrhff\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:23:54.020415 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.020380 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:23:54.025645 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.025619 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:23:54.050844 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.050810 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:23:54.051136 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051124 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="config-reloader" Jul 10 21:23:54.051178 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051137 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="config-reloader" Jul 10 21:23:54.051178 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051147 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy" Jul 10 21:23:54.051178 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051154 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy" Jul 10 21:23:54.051178 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051169 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-web" Jul 10 21:23:54.051178 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051175 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-web" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051181 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-thanos" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051186 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-thanos" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051200 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="thanos-sidecar" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051205 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="thanos-sidecar" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051212 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="init-config-reloader" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051218 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="init-config-reloader" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051225 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="prometheus" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051230 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="prometheus" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051279 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-web" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051286 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy-thanos" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051292 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="config-reloader" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051298 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="kube-rbac-proxy" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051305 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="thanos-sidecar" Jul 10 21:23:54.051318 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.051311 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" containerName="prometheus" Jul 10 21:23:54.054174 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.054151 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.056565 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.056541 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 21:23:54.056754 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.056738 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 21:23:54.056907 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.056889 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 21:23:54.057142 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.057126 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 21:23:54.057219 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.057203 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 21:23:54.057274 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.057234 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 21:23:54.057566 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.057540 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 21:23:54.057687 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.057568 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 21:23:54.058013 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.057993 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 21:23:54.058148 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.058064 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 21:23:54.058148 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.058074 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z2xvx\"" Jul 10 21:23:54.058148 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.058107 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 21:23:54.058329 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.058184 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 21:23:54.058803 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.058783 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-27iilhsmmvb43\"" Jul 10 21:23:54.060687 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.060664 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 21:23:54.064885 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.064838 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 21:23:54.072469 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.072449 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:23:54.141341 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141247 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141341 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141284 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141341 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141309 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141341 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141333 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-web-config\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141401 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141454 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3acbb3ba-2954-490a-9239-85187d8b5ead-config-out\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141501 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141557 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnksr\" (UniqueName: \"kubernetes.io/projected/3acbb3ba-2954-490a-9239-85187d8b5ead-kube-api-access-dnksr\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141646 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141700 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141742 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141775 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3acbb3ba-2954-490a-9239-85187d8b5ead-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-config\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141825 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141881 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.141943 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.141915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.242827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.242790 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.242827 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.242830 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.242991 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.242855 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243060 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-web-config\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243108 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243157 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3acbb3ba-2954-490a-9239-85187d8b5ead-config-out\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243157 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243139 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243246 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243246 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243246 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnksr\" (UniqueName: \"kubernetes.io/projected/3acbb3ba-2954-490a-9239-85187d8b5ead-kube-api-access-dnksr\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243416 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243260 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243416 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243303 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243416 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243336 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243416 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243394 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243432 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3acbb3ba-2954-490a-9239-85187d8b5ead-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-config\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243584 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243626 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243611 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243910 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243693 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.243910 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243852 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.244014 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.243968 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.244642 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.244322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.244642 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.244621 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.246193 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.246024 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3acbb3ba-2954-490a-9239-85187d8b5ead-config-out\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.246710 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.246686 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.247190 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.247162 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.247281 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.247228 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.247456 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.247433 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.247524 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.247498 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.247592 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.246139 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-web-config\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.247688 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.247678 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.250445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.248181 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3acbb3ba-2954-490a-9239-85187d8b5ead-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.250445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.248315 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.250445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.249202 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.250445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.249747 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-config\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.250445 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.250040 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3acbb3ba-2954-490a-9239-85187d8b5ead-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.253306 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.250922 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3acbb3ba-2954-490a-9239-85187d8b5ead-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.256410 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.256390 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnksr\" (UniqueName: \"kubernetes.io/projected/3acbb3ba-2954-490a-9239-85187d8b5ead-kube-api-access-dnksr\") pod \"prometheus-k8s-0\" (UID: \"3acbb3ba-2954-490a-9239-85187d8b5ead\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.366736 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.366691 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:23:54.526399 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.526273 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 21:23:54.529021 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:23:54.528990 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acbb3ba_2954_490a_9239_85187d8b5ead.slice/crio-47423388fd15ca3e3a187fcc1dbb975ff85da14185b71cc667aaddfa0df671d0 WatchSource:0}: Error finding container 47423388fd15ca3e3a187fcc1dbb975ff85da14185b71cc667aaddfa0df671d0: Status 404 returned error can't find the container with id 47423388fd15ca3e3a187fcc1dbb975ff85da14185b71cc667aaddfa0df671d0 Jul 10 21:23:54.702079 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.701983 2584 generic.go:356] "Generic (PLEG): container finished" podID="3acbb3ba-2954-490a-9239-85187d8b5ead" containerID="8cfa3c3e025b59ce7335f0f5b610fceebe19620bf21157073cbf23ba3121b399" exitCode=0 Jul 10 21:23:54.702473 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.702069 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerDied","Data":"8cfa3c3e025b59ce7335f0f5b610fceebe19620bf21157073cbf23ba3121b399"} Jul 10 21:23:54.702473 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.702142 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"47423388fd15ca3e3a187fcc1dbb975ff85da14185b71cc667aaddfa0df671d0"} Jul 10 21:23:54.853513 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:54.853484 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59995da3-a935-4a1a-9a16-17c86540fc8e" path="/var/lib/kubelet/pods/59995da3-a935-4a1a-9a16-17c86540fc8e/volumes" Jul 10 21:23:55.709705 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.709609 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"8638bc78fd52df3ee87fb169a0f484a3d3b72d9b706d4579616fb3e2d3f3a5f6"} Jul 10 21:23:55.709705 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.709689 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"73408b4b12b51feb4ece5a40ef731eb3e1796c6e212d2e7fe063135a6b3d88ee"} Jul 10 21:23:55.710218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.709734 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"a939dd8c60593f9c226a1974ae21667b31b1509b95b9dc639d194c9ad4490212"} Jul 10 21:23:55.710218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.709769 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"ca02c77aea459147c201e886082125a3aeb845f21dc7342b7d2860eaf0093071"} Jul 10 21:23:55.710218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.709808 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"375d23b6323ed412aeef56fa903450c2aaf28443ef9d3902260ba2b563e3cad3"} Jul 10 21:23:55.710218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.709849 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3acbb3ba-2954-490a-9239-85187d8b5ead","Type":"ContainerStarted","Data":"08c987c8ff7241af3373449461e026eb38823e5bc6c6ce3075837ed6cf7fa087"} Jul 10 21:23:55.747758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:55.747705 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.7281013 podStartE2EDuration="1.747687593s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.586293ms" isStatefulPod=false podCreationTimestamp="2026-07-10 21:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:23:55.747086941 +0000 UTC m=+159.500588823" watchObservedRunningTime="2026-07-10 21:23:55.747687593 +0000 UTC m=+159.501189472" Jul 10 21:23:59.367500 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:23:59.367456 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:24:54.367032 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:24:54.366989 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:24:54.382918 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:24:54.382887 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:24:54.976682 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:24:54.976652 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 21:25:25.590523 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.590488 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v7vcb"] Jul 10 21:25:25.592909 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.592891 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.595281 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.595256 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 21:25:25.595281 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.595280 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 21:25:25.596020 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.596001 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x29cf\"" Jul 10 21:25:25.603615 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.603593 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v7vcb"] Jul 10 21:25:25.679632 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.679595 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nnz\" (UniqueName: \"kubernetes.io/projected/0580bcf7-0c4b-45ae-bac9-688883488683-kube-api-access-c7nnz\") pod \"cert-manager-55b4d954d5-v7vcb\" (UID: \"0580bcf7-0c4b-45ae-bac9-688883488683\") " pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.679632 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.679630 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0580bcf7-0c4b-45ae-bac9-688883488683-bound-sa-token\") pod \"cert-manager-55b4d954d5-v7vcb\" (UID: \"0580bcf7-0c4b-45ae-bac9-688883488683\") " pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.780228 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.780185 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nnz\" (UniqueName: \"kubernetes.io/projected/0580bcf7-0c4b-45ae-bac9-688883488683-kube-api-access-c7nnz\") pod \"cert-manager-55b4d954d5-v7vcb\" (UID: \"0580bcf7-0c4b-45ae-bac9-688883488683\") " pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.780228 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.780227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0580bcf7-0c4b-45ae-bac9-688883488683-bound-sa-token\") pod \"cert-manager-55b4d954d5-v7vcb\" (UID: \"0580bcf7-0c4b-45ae-bac9-688883488683\") " pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.789169 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.789134 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0580bcf7-0c4b-45ae-bac9-688883488683-bound-sa-token\") pod \"cert-manager-55b4d954d5-v7vcb\" (UID: \"0580bcf7-0c4b-45ae-bac9-688883488683\") " pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.789448 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.789428 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nnz\" (UniqueName: \"kubernetes.io/projected/0580bcf7-0c4b-45ae-bac9-688883488683-kube-api-access-c7nnz\") pod \"cert-manager-55b4d954d5-v7vcb\" (UID: \"0580bcf7-0c4b-45ae-bac9-688883488683\") " pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:25.920120 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:25.920021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v7vcb" Jul 10 21:25:26.056008 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:26.055963 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v7vcb"] Jul 10 21:25:26.058827 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:25:26.058794 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0580bcf7_0c4b_45ae_bac9_688883488683.slice/crio-ed88481056f9ac1111d35f0c9499bf99084d5811bcc4e8de3c378d75f2391c56 WatchSource:0}: Error finding container ed88481056f9ac1111d35f0c9499bf99084d5811bcc4e8de3c378d75f2391c56: Status 404 returned error can't find the container with id ed88481056f9ac1111d35f0c9499bf99084d5811bcc4e8de3c378d75f2391c56 Jul 10 21:25:26.084021 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:26.083977 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v7vcb" event={"ID":"0580bcf7-0c4b-45ae-bac9-688883488683","Type":"ContainerStarted","Data":"ed88481056f9ac1111d35f0c9499bf99084d5811bcc4e8de3c378d75f2391c56"} Jul 10 21:25:29.105208 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:29.105172 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v7vcb" event={"ID":"0580bcf7-0c4b-45ae-bac9-688883488683","Type":"ContainerStarted","Data":"83f54ec7c89b74da1a6d7029a4ac20101c738b4be2425245be04de4bb346aa77"} Jul 10 21:25:29.124520 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:29.124405 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v7vcb" podStartSLOduration=1.327533522 podStartE2EDuration="4.12438766s" totalImagesPullingTime="2.796854138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:29.122928924 +0000 UTC m=+252.876430802" watchObservedRunningTime="2026-07-10 21:25:29.12438766 +0000 UTC m=+252.877889529" Jul 10 21:25:48.148629 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.148548 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz"] Jul 10 21:25:48.151924 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.151906 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.154484 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.154463 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 21:25:48.154718 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.154703 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 21:25:48.154850 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.154833 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 21:25:48.155328 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.155312 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8jfkq\"" Jul 10 21:25:48.155405 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.155335 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 21:25:48.174878 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.174849 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz"] Jul 10 21:25:48.280353 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.280309 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42d71849-addd-469e-948f-7a572e6e112c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.280550 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.280392 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/42d71849-addd-469e-948f-7a572e6e112c-manifests\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.280550 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.280465 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42d71849-addd-469e-948f-7a572e6e112c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.280550 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.280493 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb6rl\" (UniqueName: \"kubernetes.io/projected/42d71849-addd-469e-948f-7a572e6e112c-kube-api-access-wb6rl\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.280550 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.280519 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42d71849-addd-469e-948f-7a572e6e112c-tmp\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.381504 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.381468 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42d71849-addd-469e-948f-7a572e6e112c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.381714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.381538 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/42d71849-addd-469e-948f-7a572e6e112c-manifests\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.381714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.381619 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42d71849-addd-469e-948f-7a572e6e112c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.381714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.381656 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6rl\" (UniqueName: \"kubernetes.io/projected/42d71849-addd-469e-948f-7a572e6e112c-kube-api-access-wb6rl\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.381714 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.381691 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42d71849-addd-469e-948f-7a572e6e112c-tmp\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.382076 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.382037 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/42d71849-addd-469e-948f-7a572e6e112c-manifests\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.383991 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.383958 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42d71849-addd-469e-948f-7a572e6e112c-tmp\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.384112 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.384068 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42d71849-addd-469e-948f-7a572e6e112c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.384175 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.384156 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42d71849-addd-469e-948f-7a572e6e112c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.392663 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.392632 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb6rl\" (UniqueName: \"kubernetes.io/projected/42d71849-addd-469e-948f-7a572e6e112c-kube-api-access-wb6rl\") pod \"opendatahub-operator-controller-manager-6d8977cb58-6gnmz\" (UID: \"42d71849-addd-469e-948f-7a572e6e112c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.462677 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.462569 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:48.479689 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.479652 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-546985876b-clhfb"] Jul 10 21:25:48.507938 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.507900 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546985876b-clhfb"] Jul 10 21:25:48.508160 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.508030 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.511484 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.511457 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 21:25:48.511484 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.511675 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 21:25:48.512006 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.511948 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 21:25:48.512314 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.512255 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 21:25:48.513021 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.512410 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rsfjz\"" Jul 10 21:25:48.513169 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.513149 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 21:25:48.589904 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.589862 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2l6m\" (UniqueName: \"kubernetes.io/projected/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-kube-api-access-x2l6m\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.590073 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.589923 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-manager-config\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.590073 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.589953 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-cert\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.590073 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.590030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-metrics-cert\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.678703 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.678672 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz"] Jul 10 21:25:48.682154 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:25:48.682125 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d71849_addd_469e_948f_7a572e6e112c.slice/crio-55228544e777fd62f797f0089435976d552190936f92d3baaab9f4f4f5343b49 WatchSource:0}: Error finding container 55228544e777fd62f797f0089435976d552190936f92d3baaab9f4f4f5343b49: Status 404 returned error can't find the container with id 55228544e777fd62f797f0089435976d552190936f92d3baaab9f4f4f5343b49 Jul 10 21:25:48.690917 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.690890 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2l6m\" (UniqueName: \"kubernetes.io/projected/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-kube-api-access-x2l6m\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.691074 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.690926 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-manager-config\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.691074 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.690953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-cert\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.691074 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.690978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-metrics-cert\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.691620 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.691595 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-manager-config\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.693964 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.693932 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-metrics-cert\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.694052 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.693971 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-cert\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.718313 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.718279 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2l6m\" (UniqueName: \"kubernetes.io/projected/d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0-kube-api-access-x2l6m\") pod \"lws-controller-manager-546985876b-clhfb\" (UID: \"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0\") " pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.821742 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.821702 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:48.967011 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:48.966986 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546985876b-clhfb"] Jul 10 21:25:48.968986 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:25:48.968922 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69385e4_288e_4bf8_9bdc_7fb6f2a77dd0.slice/crio-2a6e211cffde38de6f5e7763d24cda94e32833f9d34c345bfb90066cfb686493 WatchSource:0}: Error finding container 2a6e211cffde38de6f5e7763d24cda94e32833f9d34c345bfb90066cfb686493: Status 404 returned error can't find the container with id 2a6e211cffde38de6f5e7763d24cda94e32833f9d34c345bfb90066cfb686493 Jul 10 21:25:49.197820 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:49.197766 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" event={"ID":"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0","Type":"ContainerStarted","Data":"2a6e211cffde38de6f5e7763d24cda94e32833f9d34c345bfb90066cfb686493"} Jul 10 21:25:49.200080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:49.200029 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" event={"ID":"42d71849-addd-469e-948f-7a572e6e112c","Type":"ContainerStarted","Data":"55228544e777fd62f797f0089435976d552190936f92d3baaab9f4f4f5343b49"} Jul 10 21:25:53.222866 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:53.222829 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" event={"ID":"d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0","Type":"ContainerStarted","Data":"fb3b0c83690d71ead9cf7ac6cb44a5ecb9ef12554c17ccd0c3aec36595b9fe10"} Jul 10 21:25:53.223335 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:53.222896 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:25:53.224403 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:53.224379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" event={"ID":"42d71849-addd-469e-948f-7a572e6e112c","Type":"ContainerStarted","Data":"c056676bc1cc18dbea98e8c481b05b6dd7f20e297a10f9ab8e1e3c7d02e833b5"} Jul 10 21:25:53.240805 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:53.240718 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" podStartSLOduration=1.184917781 podStartE2EDuration="5.240703075s" totalImagesPullingTime="4.055785294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:53.239766263 +0000 UTC m=+276.993268140" watchObservedRunningTime="2026-07-10 21:25:53.240703075 +0000 UTC m=+276.994204952" Jul 10 21:25:55.234710 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:55.234671 2584 generic.go:356] "Generic (PLEG): container finished" podID="42d71849-addd-469e-948f-7a572e6e112c" containerID="c056676bc1cc18dbea98e8c481b05b6dd7f20e297a10f9ab8e1e3c7d02e833b5" exitCode=0 Jul 10 21:25:55.235125 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:55.234742 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" event={"ID":"42d71849-addd-469e-948f-7a572e6e112c","Type":"ContainerDied","Data":"c056676bc1cc18dbea98e8c481b05b6dd7f20e297a10f9ab8e1e3c7d02e833b5"} Jul 10 21:25:56.242600 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:56.242568 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" event={"ID":"42d71849-addd-469e-948f-7a572e6e112c","Type":"ContainerStarted","Data":"87b58f7816d30a92ee3efe14d3b205744d0ea3e2aec7760e446a291f26eed3b7"} Jul 10 21:25:56.243016 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:56.242786 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:25:56.270865 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:25:56.270807 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" podStartSLOduration=2.055109662 podStartE2EDuration="8.270789676s" totalImagesPullingTime="5.08092103s" totalInitContainerRuntime="1.134758984s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:25:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:25:56.269880502 +0000 UTC m=+280.023382393" watchObservedRunningTime="2026-07-10 21:25:56.270789676 +0000 UTC m=+280.024291553" Jul 10 21:26:04.230678 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:04.230644 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-546985876b-clhfb" Jul 10 21:26:07.249517 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:07.249481 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d8977cb58-6gnmz" Jul 10 21:26:09.682948 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.682904 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4"] Jul 10 21:26:09.686480 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.686451 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.689664 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.689644 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 21:26:09.690652 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.690632 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 21:26:09.691715 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.691696 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2hwlg\"" Jul 10 21:26:09.691826 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.691723 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 21:26:09.691826 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.691755 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 21:26:09.711220 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.711188 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4"] Jul 10 21:26:09.783712 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.783673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602576b1-b9a6-4879-9b8a-b913c246f802-tmp\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.783712 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.783716 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602576b1-b9a6-4879-9b8a-b913c246f802-tls-certs\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.783933 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.783785 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkckb\" (UniqueName: \"kubernetes.io/projected/602576b1-b9a6-4879-9b8a-b913c246f802-kube-api-access-wkckb\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.884576 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.884537 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602576b1-b9a6-4879-9b8a-b913c246f802-tmp\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.884576 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.884581 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602576b1-b9a6-4879-9b8a-b913c246f802-tls-certs\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.884793 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.884685 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkckb\" (UniqueName: \"kubernetes.io/projected/602576b1-b9a6-4879-9b8a-b913c246f802-kube-api-access-wkckb\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.886969 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.886933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602576b1-b9a6-4879-9b8a-b913c246f802-tmp\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.887180 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.887158 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602576b1-b9a6-4879-9b8a-b913c246f802-tls-certs\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.906487 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.906454 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkckb\" (UniqueName: \"kubernetes.io/projected/602576b1-b9a6-4879-9b8a-b913c246f802-kube-api-access-wkckb\") pod \"kube-auth-proxy-7c7cf6c8b8-cjjw4\" (UID: \"602576b1-b9a6-4879-9b8a-b913c246f802\") " pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:09.996508 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:09.996467 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" Jul 10 21:26:10.150459 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:10.150431 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4"] Jul 10 21:26:10.153153 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:26:10.153128 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602576b1_b9a6_4879_9b8a_b913c246f802.slice/crio-91da6731ec276be3bac4bb5e62a59078806db5a29c34bd6edb0f01bc186069f2 WatchSource:0}: Error finding container 91da6731ec276be3bac4bb5e62a59078806db5a29c34bd6edb0f01bc186069f2: Status 404 returned error can't find the container with id 91da6731ec276be3bac4bb5e62a59078806db5a29c34bd6edb0f01bc186069f2 Jul 10 21:26:10.311325 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:10.311236 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" event={"ID":"602576b1-b9a6-4879-9b8a-b913c246f802","Type":"ContainerStarted","Data":"91da6731ec276be3bac4bb5e62a59078806db5a29c34bd6edb0f01bc186069f2"} Jul 10 21:26:13.326004 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:13.325964 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" event={"ID":"602576b1-b9a6-4879-9b8a-b913c246f802","Type":"ContainerStarted","Data":"e9ee4064049ec92dbcc431825f3210c8a87ac828e54e8ba5a112a5d6455c4e65"} Jul 10 21:26:13.343540 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:13.343483 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c7cf6c8b8-cjjw4" podStartSLOduration=1.3407538620000001 podStartE2EDuration="4.343466353s" totalImagesPullingTime="3.002712491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:26:13.341974292 +0000 UTC m=+297.095476170" watchObservedRunningTime="2026-07-10 21:26:13.343466353 +0000 UTC m=+297.096968231" Jul 10 21:26:16.642313 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:16.642280 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:26:16.645152 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:16.645132 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:26:16.649882 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:26:16.649863 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 21:27:51.665924 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.665891 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh"] Jul 10 21:27:51.669288 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.669269 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:27:51.671789 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.671758 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6fstd\"" Jul 10 21:27:51.672032 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.672016 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 10 21:27:51.672611 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.672597 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 21:27:51.672663 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.672642 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 21:27:51.681928 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.681903 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh"] Jul 10 21:27:51.704760 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.704721 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srvzp\" (UniqueName: \"kubernetes.io/projected/0806fe04-989a-420f-914d-62c9655bf218-kube-api-access-srvzp\") pod \"dns-operator-controller-manager-864dd78c4c-6cjfh\" (UID: \"0806fe04-989a-420f-914d-62c9655bf218\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:27:51.805834 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.805799 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srvzp\" (UniqueName: \"kubernetes.io/projected/0806fe04-989a-420f-914d-62c9655bf218-kube-api-access-srvzp\") pod \"dns-operator-controller-manager-864dd78c4c-6cjfh\" (UID: \"0806fe04-989a-420f-914d-62c9655bf218\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:27:51.818118 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.818080 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srvzp\" (UniqueName: \"kubernetes.io/projected/0806fe04-989a-420f-914d-62c9655bf218-kube-api-access-srvzp\") pod \"dns-operator-controller-manager-864dd78c4c-6cjfh\" (UID: \"0806fe04-989a-420f-914d-62c9655bf218\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:27:51.980386 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:51.980329 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:27:52.126143 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:52.126111 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh"] Jul 10 21:27:52.128405 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:27:52.128353 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0806fe04_989a_420f_914d_62c9655bf218.slice/crio-38338d6e61b4158d692b800c06d8b80c9667f883f196555491a5c6c4f34697ff WatchSource:0}: Error finding container 38338d6e61b4158d692b800c06d8b80c9667f883f196555491a5c6c4f34697ff: Status 404 returned error can't find the container with id 38338d6e61b4158d692b800c06d8b80c9667f883f196555491a5c6c4f34697ff Jul 10 21:27:52.130521 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:52.130501 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 21:27:52.784074 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:52.784042 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" event={"ID":"0806fe04-989a-420f-914d-62c9655bf218","Type":"ContainerStarted","Data":"38338d6e61b4158d692b800c06d8b80c9667f883f196555491a5c6c4f34697ff"} Jul 10 21:27:53.990934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:53.990895 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7"] Jul 10 21:27:53.995106 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:53.995084 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:53.997576 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:53.997547 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 10 21:27:53.997722 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:53.997666 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 10 21:27:53.997722 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:53.997677 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4k5w9\"" Jul 10 21:27:54.002593 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.002570 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7"] Jul 10 21:27:54.027918 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.027886 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.028105 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.027932 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.028105 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.028028 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrw8\" (UniqueName: \"kubernetes.io/projected/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-kube-api-access-7wrw8\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.129224 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.129189 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrw8\" (UniqueName: \"kubernetes.io/projected/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-kube-api-access-7wrw8\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.129441 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.129294 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.129441 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.129327 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.129572 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:27:54.129471 2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 10 21:27:54.129572 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:27:54.129566 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-plugin-serving-cert podName:dc8ae150-7c8b-4973-b6c3-9acf71aad3f7 nodeName:}" failed. No retries permitted until 2026-07-10 21:27:54.629543092 +0000 UTC m=+398.383044968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-bdft7" (UID: "dc8ae150-7c8b-4973-b6c3-9acf71aad3f7") : secret "plugin-serving-cert" not found Jul 10 21:27:54.130080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.130061 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.138439 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.138414 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrw8\" (UniqueName: \"kubernetes.io/projected/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-kube-api-access-7wrw8\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.634671 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.634579 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.637054 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.637031 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc8ae150-7c8b-4973-b6c3-9acf71aad3f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bdft7\" (UID: \"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:54.797663 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.797628 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" event={"ID":"0806fe04-989a-420f-914d-62c9655bf218","Type":"ContainerStarted","Data":"1719f3d3fef9aee92a9b71e9c66b908c84bd957bae005ff96b49efec2ad290b0"} Jul 10 21:27:54.797851 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.797752 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:27:54.820856 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.820805 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" podStartSLOduration=1.694704883 podStartE2EDuration="3.82078904s" totalImagesPullingTime="2.126084157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:27:54.8190183 +0000 UTC m=+398.572520189" watchObservedRunningTime="2026-07-10 21:27:54.82078904 +0000 UTC m=+398.574290919" Jul 10 21:27:54.907535 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:54.907439 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" Jul 10 21:27:55.045810 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:55.045777 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7"] Jul 10 21:27:55.048746 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:27:55.048717 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc8ae150_7c8b_4973_b6c3_9acf71aad3f7.slice/crio-d3a75326482ec40b6d0e0ff3341dd586840cba3b679a8c9157f7ee9280d85ffe WatchSource:0}: Error finding container d3a75326482ec40b6d0e0ff3341dd586840cba3b679a8c9157f7ee9280d85ffe: Status 404 returned error can't find the container with id d3a75326482ec40b6d0e0ff3341dd586840cba3b679a8c9157f7ee9280d85ffe Jul 10 21:27:55.803237 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:27:55.803205 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" event={"ID":"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7","Type":"ContainerStarted","Data":"d3a75326482ec40b6d0e0ff3341dd586840cba3b679a8c9157f7ee9280d85ffe"} Jul 10 21:28:05.386379 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.386316 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx"] Jul 10 21:28:05.410050 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.410016 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx"] Jul 10 21:28:05.410220 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.410167 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.414470 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.414403 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gqz6\"" Jul 10 21:28:05.551507 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.551455 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4sz5\" (UniqueName: \"kubernetes.io/projected/a473a993-1121-4098-9d56-4eac5c03b97c-kube-api-access-s4sz5\") pod \"kuadrant-operator-controller-manager-86878c769f-zgjkx\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.551692 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.551524 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a473a993-1121-4098-9d56-4eac5c03b97c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zgjkx\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.653110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.653024 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4sz5\" (UniqueName: \"kubernetes.io/projected/a473a993-1121-4098-9d56-4eac5c03b97c-kube-api-access-s4sz5\") pod \"kuadrant-operator-controller-manager-86878c769f-zgjkx\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.653110 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.653090 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a473a993-1121-4098-9d56-4eac5c03b97c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zgjkx\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.653526 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.653500 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a473a993-1121-4098-9d56-4eac5c03b97c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zgjkx\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.662629 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.662596 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4sz5\" (UniqueName: \"kubernetes.io/projected/a473a993-1121-4098-9d56-4eac5c03b97c-kube-api-access-s4sz5\") pod \"kuadrant-operator-controller-manager-86878c769f-zgjkx\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.725553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.725506 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:05.805429 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:05.805399 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6cjfh" Jul 10 21:28:17.397111 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:17.397087 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx"] Jul 10 21:28:17.399021 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:28:17.398996 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda473a993_1121_4098_9d56_4eac5c03b97c.slice/crio-5343d59262a9ca79e529e57bbcc085cf5386f5d1e75548be2313f23ac95900a5 WatchSource:0}: Error finding container 5343d59262a9ca79e529e57bbcc085cf5386f5d1e75548be2313f23ac95900a5: Status 404 returned error can't find the container with id 5343d59262a9ca79e529e57bbcc085cf5386f5d1e75548be2313f23ac95900a5 Jul 10 21:28:17.922978 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:17.922944 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" event={"ID":"dc8ae150-7c8b-4973-b6c3-9acf71aad3f7","Type":"ContainerStarted","Data":"fe229d7a903bc64a8995cc66627c52423c70646043c75ac5ba5c82d542fe4ca3"} Jul 10 21:28:17.924221 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:17.924197 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" event={"ID":"a473a993-1121-4098-9d56-4eac5c03b97c","Type":"ContainerStarted","Data":"5343d59262a9ca79e529e57bbcc085cf5386f5d1e75548be2313f23ac95900a5"} Jul 10 21:28:17.960990 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:17.960925 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bdft7" podStartSLOduration=2.673158349 podStartE2EDuration="24.960898953s" totalImagesPullingTime="22.287740604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:17.960251189 +0000 UTC m=+421.713753068" watchObservedRunningTime="2026-07-10 21:28:17.960898953 +0000 UTC m=+421.714401067" Jul 10 21:28:22.954045 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:22.954007 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" event={"ID":"a473a993-1121-4098-9d56-4eac5c03b97c","Type":"ContainerStarted","Data":"4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7"} Jul 10 21:28:22.954579 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:22.954150 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:22.975723 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:22.975668 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" podStartSLOduration=13.038742011 podStartE2EDuration="17.9756516s" totalImagesPullingTime="4.936909589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:28:22.972964618 +0000 UTC m=+426.726466496" watchObservedRunningTime="2026-07-10 21:28:22.9756516 +0000 UTC m=+426.729153478" Jul 10 21:28:33.961746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:33.961712 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:28:55.754496 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:55.754457 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-84886"] Jul 10 21:28:55.782075 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:55.782040 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-84886"] Jul 10 21:28:55.782240 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:55.782163 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:28:55.784988 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:55.784961 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ljm7t\"" Jul 10 21:28:55.943708 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:55.943668 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgl6\" (UniqueName: \"kubernetes.io/projected/853ba513-1dd7-4900-a177-1057e459eeb4-kube-api-access-ncgl6\") pod \"authorino-75d556bd77-84886\" (UID: \"853ba513-1dd7-4900-a177-1057e459eeb4\") " pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:28:56.044908 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:56.044821 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgl6\" (UniqueName: \"kubernetes.io/projected/853ba513-1dd7-4900-a177-1057e459eeb4-kube-api-access-ncgl6\") pod \"authorino-75d556bd77-84886\" (UID: \"853ba513-1dd7-4900-a177-1057e459eeb4\") " pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:28:56.054496 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:56.054475 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgl6\" (UniqueName: \"kubernetes.io/projected/853ba513-1dd7-4900-a177-1057e459eeb4-kube-api-access-ncgl6\") pod \"authorino-75d556bd77-84886\" (UID: \"853ba513-1dd7-4900-a177-1057e459eeb4\") " pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:28:56.091478 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:56.091445 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:28:56.227268 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:56.225614 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-84886"] Jul 10 21:28:56.233928 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:28:56.233894 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod853ba513_1dd7_4900_a177_1057e459eeb4.slice/crio-1e116f2768c4d0ca8eb08c27e757770f2ddf3948123a6e0963edf463e5f98b03 WatchSource:0}: Error finding container 1e116f2768c4d0ca8eb08c27e757770f2ddf3948123a6e0963edf463e5f98b03: Status 404 returned error can't find the container with id 1e116f2768c4d0ca8eb08c27e757770f2ddf3948123a6e0963edf463e5f98b03 Jul 10 21:28:57.121122 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:28:57.121081 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-84886" event={"ID":"853ba513-1dd7-4900-a177-1057e459eeb4","Type":"ContainerStarted","Data":"1e116f2768c4d0ca8eb08c27e757770f2ddf3948123a6e0963edf463e5f98b03"} Jul 10 21:29:00.137565 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:00.137526 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-84886" event={"ID":"853ba513-1dd7-4900-a177-1057e459eeb4","Type":"ContainerStarted","Data":"c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3"} Jul 10 21:29:00.154456 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:00.154403 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-84886" podStartSLOduration=2.289120816 podStartE2EDuration="5.154387251s" totalImagesPullingTime="2.865266435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:29:00.152943433 +0000 UTC m=+463.906445311" watchObservedRunningTime="2026-07-10 21:29:00.154387251 +0000 UTC m=+463.907889119" Jul 10 21:29:25.619397 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:25.619338 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-84886"] Jul 10 21:29:25.619946 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:25.619592 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-84886" podUID="853ba513-1dd7-4900-a177-1057e459eeb4" containerName="authorino" containerID="cri-o://c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3" gracePeriod=30 Jul 10 21:29:25.875127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:25.875059 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:29:26.028837 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.028806 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncgl6\" (UniqueName: \"kubernetes.io/projected/853ba513-1dd7-4900-a177-1057e459eeb4-kube-api-access-ncgl6\") pod \"853ba513-1dd7-4900-a177-1057e459eeb4\" (UID: \"853ba513-1dd7-4900-a177-1057e459eeb4\") " Jul 10 21:29:26.031067 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.031031 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853ba513-1dd7-4900-a177-1057e459eeb4-kube-api-access-ncgl6" (OuterVolumeSpecName: "kube-api-access-ncgl6") pod "853ba513-1dd7-4900-a177-1057e459eeb4" (UID: "853ba513-1dd7-4900-a177-1057e459eeb4"). InnerVolumeSpecName "kube-api-access-ncgl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:26.130094 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.130004 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncgl6\" (UniqueName: \"kubernetes.io/projected/853ba513-1dd7-4900-a177-1057e459eeb4-kube-api-access-ncgl6\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:29:26.270353 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.270318 2584 generic.go:356] "Generic (PLEG): container finished" podID="853ba513-1dd7-4900-a177-1057e459eeb4" containerID="c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3" exitCode=0 Jul 10 21:29:26.270545 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.270385 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-84886" Jul 10 21:29:26.270545 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.270392 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-84886" event={"ID":"853ba513-1dd7-4900-a177-1057e459eeb4","Type":"ContainerDied","Data":"c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3"} Jul 10 21:29:26.270545 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.270431 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-84886" event={"ID":"853ba513-1dd7-4900-a177-1057e459eeb4","Type":"ContainerDied","Data":"1e116f2768c4d0ca8eb08c27e757770f2ddf3948123a6e0963edf463e5f98b03"} Jul 10 21:29:26.270545 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.270449 2584 scope.go:117] "RemoveContainer" containerID="c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3" Jul 10 21:29:26.279218 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.279199 2584 scope.go:117] "RemoveContainer" containerID="c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3" Jul 10 21:29:26.279520 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:29:26.279500 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3\": container with ID starting with c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3 not found: ID does not exist" containerID="c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3" Jul 10 21:29:26.279594 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.279527 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3"} err="failed to get container status \"c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3\": rpc error: code = NotFound desc = could not find container \"c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3\": container with ID starting with c9b563630f5b1e963e4b6bbada454b10c5b3b381d5213cf8920b3898912ebdb3 not found: ID does not exist" Jul 10 21:29:26.292216 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.292177 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-84886"] Jul 10 21:29:26.299247 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.299219 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-84886"] Jul 10 21:29:26.851561 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:26.851526 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853ba513-1dd7-4900-a177-1057e459eeb4" path="/var/lib/kubelet/pods/853ba513-1dd7-4900-a177-1057e459eeb4/volumes" Jul 10 21:29:30.167130 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.167091 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-878c968bb-znqz5"] Jul 10 21:29:30.167549 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.167494 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853ba513-1dd7-4900-a177-1057e459eeb4" containerName="authorino" Jul 10 21:29:30.167549 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.167507 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="853ba513-1dd7-4900-a177-1057e459eeb4" containerName="authorino" Jul 10 21:29:30.167622 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.167583 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="853ba513-1dd7-4900-a177-1057e459eeb4" containerName="authorino" Jul 10 21:29:30.172462 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.172441 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.175170 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.175136 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 21:29:30.175575 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.175560 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-trxx4\"" Jul 10 21:29:30.176112 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.176095 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 21:29:30.184686 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.184662 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-878c968bb-znqz5"] Jul 10 21:29:30.272784 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.272752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.272784 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.272786 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5txf\" (UniqueName: \"kubernetes.io/projected/9ee53b8d-6afb-45e7-9cad-17779899d918-kube-api-access-t5txf\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.374289 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.374258 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.374476 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.374296 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5txf\" (UniqueName: \"kubernetes.io/projected/9ee53b8d-6afb-45e7-9cad-17779899d918-kube-api-access-t5txf\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.374476 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:29:30.374414 2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 10 21:29:30.374558 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:29:30.374491 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert podName:9ee53b8d-6afb-45e7-9cad-17779899d918 nodeName:}" failed. No retries permitted until 2026-07-10 21:29:30.874470358 +0000 UTC m=+494.627972214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert") pod "maas-controller-878c968bb-znqz5" (UID: "9ee53b8d-6afb-45e7-9cad-17779899d918") : secret "maas-controller-webhook-cert" not found Jul 10 21:29:30.385443 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.385410 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5txf\" (UniqueName: \"kubernetes.io/projected/9ee53b8d-6afb-45e7-9cad-17779899d918-kube-api-access-t5txf\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.879874 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.879830 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:30.882391 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:30.882347 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert\") pod \"maas-controller-878c968bb-znqz5\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:31.083733 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:31.083685 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:31.222996 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:31.222973 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-878c968bb-znqz5"] Jul 10 21:29:31.224982 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:29:31.224955 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee53b8d_6afb_45e7_9cad_17779899d918.slice/crio-a8ee2b8bbfbcf02942936fd1a7e9628625f698571dd83cb56a34d0380e3cad92 WatchSource:0}: Error finding container a8ee2b8bbfbcf02942936fd1a7e9628625f698571dd83cb56a34d0380e3cad92: Status 404 returned error can't find the container with id a8ee2b8bbfbcf02942936fd1a7e9628625f698571dd83cb56a34d0380e3cad92 Jul 10 21:29:31.296663 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:31.296625 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-878c968bb-znqz5" event={"ID":"9ee53b8d-6afb-45e7-9cad-17779899d918","Type":"ContainerStarted","Data":"a8ee2b8bbfbcf02942936fd1a7e9628625f698571dd83cb56a34d0380e3cad92"} Jul 10 21:29:33.310961 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:33.310904 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-878c968bb-znqz5" event={"ID":"9ee53b8d-6afb-45e7-9cad-17779899d918","Type":"ContainerStarted","Data":"4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868"} Jul 10 21:29:33.311710 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:33.311445 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:33.341246 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:33.341181 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-878c968bb-znqz5" podStartSLOduration=1.618467522 podStartE2EDuration="3.341164375s" totalImagesPullingTime="1.722696853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:29:33.339542173 +0000 UTC m=+497.093044039" watchObservedRunningTime="2026-07-10 21:29:33.341164375 +0000 UTC m=+497.094666252" Jul 10 21:29:44.317485 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:44.317450 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:44.939873 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:44.939839 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-878c968bb-znqz5"] Jul 10 21:29:44.940109 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:44.940056 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-878c968bb-znqz5" podUID="9ee53b8d-6afb-45e7-9cad-17779899d918" containerName="manager" containerID="cri-o://4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868" gracePeriod=30 Jul 10 21:29:45.188909 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.188881 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:45.313225 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.313192 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert\") pod \"9ee53b8d-6afb-45e7-9cad-17779899d918\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " Jul 10 21:29:45.313427 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.313243 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5txf\" (UniqueName: \"kubernetes.io/projected/9ee53b8d-6afb-45e7-9cad-17779899d918-kube-api-access-t5txf\") pod \"9ee53b8d-6afb-45e7-9cad-17779899d918\" (UID: \"9ee53b8d-6afb-45e7-9cad-17779899d918\") " Jul 10 21:29:45.315524 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.315489 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9ee53b8d-6afb-45e7-9cad-17779899d918" (UID: "9ee53b8d-6afb-45e7-9cad-17779899d918"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:29:45.315524 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.315487 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee53b8d-6afb-45e7-9cad-17779899d918-kube-api-access-t5txf" (OuterVolumeSpecName: "kube-api-access-t5txf") pod "9ee53b8d-6afb-45e7-9cad-17779899d918" (UID: "9ee53b8d-6afb-45e7-9cad-17779899d918"). InnerVolumeSpecName "kube-api-access-t5txf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:29:45.370706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.370665 2584 generic.go:356] "Generic (PLEG): container finished" podID="9ee53b8d-6afb-45e7-9cad-17779899d918" containerID="4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868" exitCode=0 Jul 10 21:29:45.370706 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.370706 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-878c968bb-znqz5" Jul 10 21:29:45.371183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.370752 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-878c968bb-znqz5" event={"ID":"9ee53b8d-6afb-45e7-9cad-17779899d918","Type":"ContainerDied","Data":"4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868"} Jul 10 21:29:45.371183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.370805 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-878c968bb-znqz5" event={"ID":"9ee53b8d-6afb-45e7-9cad-17779899d918","Type":"ContainerDied","Data":"a8ee2b8bbfbcf02942936fd1a7e9628625f698571dd83cb56a34d0380e3cad92"} Jul 10 21:29:45.371183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.370831 2584 scope.go:117] "RemoveContainer" containerID="4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868" Jul 10 21:29:45.382201 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.382177 2584 scope.go:117] "RemoveContainer" containerID="4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868" Jul 10 21:29:45.382516 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:29:45.382499 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868\": container with ID starting with 4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868 not found: ID does not exist" containerID="4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868" Jul 10 21:29:45.382568 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.382524 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868"} err="failed to get container status \"4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868\": rpc error: code = NotFound desc = could not find container \"4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868\": container with ID starting with 4285dbc3c46d19ca5a60522535441fc40f4730702609937d0ff65cdf0e1a7868 not found: ID does not exist" Jul 10 21:29:45.396855 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.396822 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-878c968bb-znqz5"] Jul 10 21:29:45.398574 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.398552 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-878c968bb-znqz5"] Jul 10 21:29:45.414013 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.413980 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5txf\" (UniqueName: \"kubernetes.io/projected/9ee53b8d-6afb-45e7-9cad-17779899d918-kube-api-access-t5txf\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:29:45.414013 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:45.414009 2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ee53b8d-6afb-45e7-9cad-17779899d918-webhook-cert\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:29:46.853034 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:29:46.853005 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee53b8d-6afb-45e7-9cad-17779899d918" path="/var/lib/kubelet/pods/9ee53b8d-6afb-45e7-9cad-17779899d918/volumes" Jul 10 21:30:08.853948 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.853868 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs"] Jul 10 21:30:08.854408 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.854233 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee53b8d-6afb-45e7-9cad-17779899d918" containerName="manager" Jul 10 21:30:08.854408 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.854245 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee53b8d-6afb-45e7-9cad-17779899d918" containerName="manager" Jul 10 21:30:08.854408 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.854314 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee53b8d-6afb-45e7-9cad-17779899d918" containerName="manager" Jul 10 21:30:08.860657 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.860626 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:08.866639 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.866614 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7d47m\"" Jul 10 21:30:08.866800 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.866616 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 21:30:08.867748 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:08.867724 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs"] Jul 10 21:30:09.042534 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.042491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/735e0f33-a8b3-4e00-9e51-4a3821d223ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-9gqvs\" (UID: \"735e0f33-a8b3-4e00-9e51-4a3821d223ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.042697 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.042551 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8qg7\" (UniqueName: \"kubernetes.io/projected/735e0f33-a8b3-4e00-9e51-4a3821d223ed-kube-api-access-s8qg7\") pod \"payload-pre-processing-74584bb9f8-9gqvs\" (UID: \"735e0f33-a8b3-4e00-9e51-4a3821d223ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.143918 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.143832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/735e0f33-a8b3-4e00-9e51-4a3821d223ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-9gqvs\" (UID: \"735e0f33-a8b3-4e00-9e51-4a3821d223ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.143918 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.143880 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8qg7\" (UniqueName: \"kubernetes.io/projected/735e0f33-a8b3-4e00-9e51-4a3821d223ed-kube-api-access-s8qg7\") pod \"payload-pre-processing-74584bb9f8-9gqvs\" (UID: \"735e0f33-a8b3-4e00-9e51-4a3821d223ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.144604 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.144583 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/735e0f33-a8b3-4e00-9e51-4a3821d223ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-9gqvs\" (UID: \"735e0f33-a8b3-4e00-9e51-4a3821d223ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.157806 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.157775 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8qg7\" (UniqueName: \"kubernetes.io/projected/735e0f33-a8b3-4e00-9e51-4a3821d223ed-kube-api-access-s8qg7\") pod \"payload-pre-processing-74584bb9f8-9gqvs\" (UID: \"735e0f33-a8b3-4e00-9e51-4a3821d223ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.172775 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.172733 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:09.317536 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.317506 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs"] Jul 10 21:30:09.319750 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:30:09.319726 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735e0f33_a8b3_4e00_9e51_4a3821d223ed.slice/crio-81a8ad2bfb5409340b7cec1a342619db4b99004e6c8b334424f0d3bcf7222bce WatchSource:0}: Error finding container 81a8ad2bfb5409340b7cec1a342619db4b99004e6c8b334424f0d3bcf7222bce: Status 404 returned error can't find the container with id 81a8ad2bfb5409340b7cec1a342619db4b99004e6c8b334424f0d3bcf7222bce Jul 10 21:30:09.489744 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:09.489702 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" event={"ID":"735e0f33-a8b3-4e00-9e51-4a3821d223ed","Type":"ContainerStarted","Data":"81a8ad2bfb5409340b7cec1a342619db4b99004e6c8b334424f0d3bcf7222bce"} Jul 10 21:30:11.501643 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:11.501608 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" event={"ID":"735e0f33-a8b3-4e00-9e51-4a3821d223ed","Type":"ContainerStarted","Data":"fd59c4f75ade2acab4313c09acd86f98db985c0a3c6d5cb2fde9012eba30bf5f"} Jul 10 21:30:11.502044 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:11.501704 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:11.524225 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:11.524172 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" podStartSLOduration=1.984463074 podStartE2EDuration="3.524154883s" totalImagesPullingTime="1.539691809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:30:11.523493587 +0000 UTC m=+535.276995465" watchObservedRunningTime="2026-07-10 21:30:11.524154883 +0000 UTC m=+535.277656760" Jul 10 21:30:22.509007 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:22.508976 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-9gqvs" Jul 10 21:30:28.895498 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.895465 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4"] Jul 10 21:30:28.900221 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.900204 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:28.902929 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.902888 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 21:30:28.903754 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.903735 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 21:30:28.903879 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.903827 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-crb2j\"" Jul 10 21:30:28.903879 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.903828 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 21:30:28.911822 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.911796 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4"] Jul 10 21:30:28.932316 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.932279 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqbm\" (UniqueName: \"kubernetes.io/projected/6bde9178-aa35-401f-97c0-d10526f61b62-kube-api-access-dzqbm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:28.932493 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.932454 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9178-aa35-401f-97c0-d10526f61b62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:28.932552 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.932532 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:28.932599 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.932567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:28.932636 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.932613 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:28.932675 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:28.932650 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.033846 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.033806 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9178-aa35-401f-97c0-d10526f61b62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.033861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.033881 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034029 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.033995 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.034046 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.034104 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqbm\" (UniqueName: \"kubernetes.io/projected/6bde9178-aa35-401f-97c0-d10526f61b62-kube-api-access-dzqbm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034296 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.034277 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034385 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.034324 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.034447 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.034430 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.036812 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.036780 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9178-aa35-401f-97c0-d10526f61b62-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.036934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.036918 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9178-aa35-401f-97c0-d10526f61b62-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.056536 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.056507 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqbm\" (UniqueName: \"kubernetes.io/projected/6bde9178-aa35-401f-97c0-d10526f61b62-kube-api-access-dzqbm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4\" (UID: \"6bde9178-aa35-401f-97c0-d10526f61b62\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.211138 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.211035 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:29.352265 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.352231 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4"] Jul 10 21:30:29.356196 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:30:29.356159 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bde9178_aa35_401f_97c0_d10526f61b62.slice/crio-7ed1c8400b2903e274dd112cb726d1347845c5d6c500c6ebb097dc4e930168e4 WatchSource:0}: Error finding container 7ed1c8400b2903e274dd112cb726d1347845c5d6c500c6ebb097dc4e930168e4: Status 404 returned error can't find the container with id 7ed1c8400b2903e274dd112cb726d1347845c5d6c500c6ebb097dc4e930168e4 Jul 10 21:30:29.587430 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:29.587391 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" event={"ID":"6bde9178-aa35-401f-97c0-d10526f61b62","Type":"ContainerStarted","Data":"7ed1c8400b2903e274dd112cb726d1347845c5d6c500c6ebb097dc4e930168e4"} Jul 10 21:30:30.595166 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:30.595135 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" event={"ID":"6bde9178-aa35-401f-97c0-d10526f61b62","Type":"ContainerStarted","Data":"49cd86fae2edd3b53e3303a156627da40bfc9207d7554c5370f732a4873ad523"} Jul 10 21:30:30.616419 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:30.616352 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" podStartSLOduration=1.447418287 podStartE2EDuration="2.616331945s" totalImagesPullingTime="1.168913658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:30:30.614909018 +0000 UTC m=+554.368410899" watchObservedRunningTime="2026-07-10 21:30:30.616331945 +0000 UTC m=+554.369833823" Jul 10 21:30:39.211662 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:39.211616 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:39.212092 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:39.211695 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:39.224454 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:39.224421 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:30:39.649661 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:30:39.649627 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4" Jul 10 21:31:01.815338 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.815305 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5"] Jul 10 21:31:01.818836 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.818817 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.821308 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.821285 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 21:31:01.832022 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.831944 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5"] Jul 10 21:31:01.846665 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.846627 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.846665 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.846678 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.846920 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.846848 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.846981 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.846921 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.846981 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.846968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.847065 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.847015 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jp8\" (UniqueName: \"kubernetes.io/projected/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-kube-api-access-h5jp8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948336 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948300 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948561 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948561 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jp8\" (UniqueName: \"kubernetes.io/projected/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-kube-api-access-h5jp8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948561 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948455 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948561 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948494 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948561 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948551 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.948890 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948852 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.949062 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.949038 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.949162 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.948946 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.950662 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.950643 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.951046 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.951028 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:01.959902 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:01.959879 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jp8\" (UniqueName: \"kubernetes.io/projected/78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274-kube-api-access-h5jp8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-579z5\" (UID: \"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:02.129861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:02.129765 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:02.275731 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:02.275660 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5"] Jul 10 21:31:02.278166 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:31:02.278137 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ea75ce_4e76_4ca2_8c0a_c66d2c6ba274.slice/crio-77b663996d07081e8e65c38d3d05bf910e9735d481eb80ebc988b28e2909c97f WatchSource:0}: Error finding container 77b663996d07081e8e65c38d3d05bf910e9735d481eb80ebc988b28e2909c97f: Status 404 returned error can't find the container with id 77b663996d07081e8e65c38d3d05bf910e9735d481eb80ebc988b28e2909c97f Jul 10 21:31:02.755038 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:02.755005 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" event={"ID":"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274","Type":"ContainerStarted","Data":"1f7d13bf218b1cd7f56b3fe55e877f825d31f4b62730d2b974d748276521d0b6"} Jul 10 21:31:02.755221 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:02.755057 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" event={"ID":"78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274","Type":"ContainerStarted","Data":"77b663996d07081e8e65c38d3d05bf910e9735d481eb80ebc988b28e2909c97f"} Jul 10 21:31:02.776463 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:02.776405 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" podStartSLOduration=1.60345725 podStartE2EDuration="1.776384724s" totalImagesPullingTime="172.927474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:31:02.774659311 +0000 UTC m=+586.528161191" watchObservedRunningTime="2026-07-10 21:31:02.776384724 +0000 UTC m=+586.529886602" Jul 10 21:31:12.130644 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:12.130599 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:12.131068 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:12.130678 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:12.147326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:12.147296 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:12.821774 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:12.821742 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-579z5" Jul 10 21:31:16.676025 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:16.675994 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:31:16.676469 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:16.676454 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:31:36.182562 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.182529 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-576dff6fb6-z4f5p"] Jul 10 21:31:36.186524 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.186501 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.190081 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.190052 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ljm7t\"" Jul 10 21:31:36.190228 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.190052 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 10 21:31:36.197386 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.197346 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-576dff6fb6-z4f5p"] Jul 10 21:31:36.279756 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.279717 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4-tls-cert\") pod \"authorino-576dff6fb6-z4f5p\" (UID: \"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4\") " pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.279937 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.279861 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6sq4\" (UniqueName: \"kubernetes.io/projected/9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4-kube-api-access-c6sq4\") pod \"authorino-576dff6fb6-z4f5p\" (UID: \"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4\") " pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.381176 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.381138 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6sq4\" (UniqueName: \"kubernetes.io/projected/9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4-kube-api-access-c6sq4\") pod \"authorino-576dff6fb6-z4f5p\" (UID: \"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4\") " pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.381397 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.381204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4-tls-cert\") pod \"authorino-576dff6fb6-z4f5p\" (UID: \"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4\") " pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.383672 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.383647 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4-tls-cert\") pod \"authorino-576dff6fb6-z4f5p\" (UID: \"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4\") " pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.389793 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.389764 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6sq4\" (UniqueName: \"kubernetes.io/projected/9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4-kube-api-access-c6sq4\") pod \"authorino-576dff6fb6-z4f5p\" (UID: \"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4\") " pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.498161 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.498119 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576dff6fb6-z4f5p" Jul 10 21:31:36.650696 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.650668 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-576dff6fb6-z4f5p"] Jul 10 21:31:36.653063 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:31:36.653030 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dc384dd_220d_45e5_b4ff_5dc9c60a1fb4.slice/crio-e73a124d517fb335a154886c23cf55bf01246a19c930ad6c13315667377d7770 WatchSource:0}: Error finding container e73a124d517fb335a154886c23cf55bf01246a19c930ad6c13315667377d7770: Status 404 returned error can't find the container with id e73a124d517fb335a154886c23cf55bf01246a19c930ad6c13315667377d7770 Jul 10 21:31:36.928050 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:36.927961 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576dff6fb6-z4f5p" event={"ID":"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4","Type":"ContainerStarted","Data":"e73a124d517fb335a154886c23cf55bf01246a19c930ad6c13315667377d7770"} Jul 10 21:31:37.934757 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:31:37.934716 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576dff6fb6-z4f5p" event={"ID":"9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4","Type":"ContainerStarted","Data":"68e743070f1fde9e958dfcbee91452583c9e84bfac26127ffe2fcc6265469028"} Jul 10 21:36:16.710356 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:36:16.710331 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:36:16.710829 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:36:16.710334 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:37:40.904259 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:40.904153 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-576dff6fb6-z4f5p" podStartSLOduration=364.46222649 podStartE2EDuration="6m4.904136184s" totalImagesPullingTime="441.909694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:31:37.98842184 +0000 UTC m=+621.741923720" watchObservedRunningTime="2026-07-10 21:37:40.904136184 +0000 UTC m=+984.657638089" Jul 10 21:37:40.904776 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:40.904628 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx"] Jul 10 21:37:40.904862 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:40.904837 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" podUID="a473a993-1121-4098-9d56-4eac5c03b97c" containerName="manager" containerID="cri-o://4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7" gracePeriod=10 Jul 10 21:37:45.561423 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.561393 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:37:45.708915 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.708822 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4sz5\" (UniqueName: \"kubernetes.io/projected/a473a993-1121-4098-9d56-4eac5c03b97c-kube-api-access-s4sz5\") pod \"a473a993-1121-4098-9d56-4eac5c03b97c\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " Jul 10 21:37:45.709085 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.708938 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a473a993-1121-4098-9d56-4eac5c03b97c-extensions-socket-volume\") pod \"a473a993-1121-4098-9d56-4eac5c03b97c\" (UID: \"a473a993-1121-4098-9d56-4eac5c03b97c\") " Jul 10 21:37:45.709388 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.709333 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a473a993-1121-4098-9d56-4eac5c03b97c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a473a993-1121-4098-9d56-4eac5c03b97c" (UID: "a473a993-1121-4098-9d56-4eac5c03b97c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:37:45.711011 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.710989 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a473a993-1121-4098-9d56-4eac5c03b97c-kube-api-access-s4sz5" (OuterVolumeSpecName: "kube-api-access-s4sz5") pod "a473a993-1121-4098-9d56-4eac5c03b97c" (UID: "a473a993-1121-4098-9d56-4eac5c03b97c"). InnerVolumeSpecName "kube-api-access-s4sz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:37:45.810292 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.810256 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4sz5\" (UniqueName: \"kubernetes.io/projected/a473a993-1121-4098-9d56-4eac5c03b97c-kube-api-access-s4sz5\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:37:45.810292 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.810284 2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a473a993-1121-4098-9d56-4eac5c03b97c-extensions-socket-volume\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:37:45.818606 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.818569 2584 generic.go:356] "Generic (PLEG): container finished" podID="a473a993-1121-4098-9d56-4eac5c03b97c" containerID="4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7" exitCode=0 Jul 10 21:37:45.818751 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.818613 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" Jul 10 21:37:45.818751 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.818616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" event={"ID":"a473a993-1121-4098-9d56-4eac5c03b97c","Type":"ContainerDied","Data":"4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7"} Jul 10 21:37:45.818751 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.818745 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx" event={"ID":"a473a993-1121-4098-9d56-4eac5c03b97c","Type":"ContainerDied","Data":"5343d59262a9ca79e529e57bbcc085cf5386f5d1e75548be2313f23ac95900a5"} Jul 10 21:37:45.818857 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.818773 2584 scope.go:117] "RemoveContainer" containerID="4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7" Jul 10 21:37:45.828917 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.828896 2584 scope.go:117] "RemoveContainer" containerID="4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7" Jul 10 21:37:45.829230 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:37:45.829210 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7\": container with ID starting with 4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7 not found: ID does not exist" containerID="4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7" Jul 10 21:37:45.829292 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.829240 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7"} err="failed to get container status \"4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7\": rpc error: code = NotFound desc = could not find container \"4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7\": container with ID starting with 4ddd091e6d315b78822c2443342d37fa259b1892cadd606fab33bb8ede5a5bf7 not found: ID does not exist" Jul 10 21:37:45.841147 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.841117 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx"] Jul 10 21:37:45.845884 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:45.845857 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgjkx"] Jul 10 21:37:46.854018 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:37:46.853987 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a473a993-1121-4098-9d56-4eac5c03b97c" path="/var/lib/kubelet/pods/a473a993-1121-4098-9d56-4eac5c03b97c/volumes" Jul 10 21:38:42.033109 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.033072 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx"] Jul 10 21:38:42.033680 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.033525 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a473a993-1121-4098-9d56-4eac5c03b97c" containerName="manager" Jul 10 21:38:42.033680 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.033538 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a473a993-1121-4098-9d56-4eac5c03b97c" containerName="manager" Jul 10 21:38:42.033680 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.033639 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a473a993-1121-4098-9d56-4eac5c03b97c" containerName="manager" Jul 10 21:38:42.038080 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.038060 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.040326 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.040302 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gqz6\"" Jul 10 21:38:42.051975 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.051935 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx"] Jul 10 21:38:42.157905 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.157862 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76nlh\" (UniqueName: \"kubernetes.io/projected/17bbc6eb-d421-43f6-83c2-ddd706bc1715-kube-api-access-76nlh\") pod \"kuadrant-operator-controller-manager-86878c769f-rthgx\" (UID: \"17bbc6eb-d421-43f6-83c2-ddd706bc1715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.158096 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.157945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17bbc6eb-d421-43f6-83c2-ddd706bc1715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rthgx\" (UID: \"17bbc6eb-d421-43f6-83c2-ddd706bc1715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.258639 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.258578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76nlh\" (UniqueName: \"kubernetes.io/projected/17bbc6eb-d421-43f6-83c2-ddd706bc1715-kube-api-access-76nlh\") pod \"kuadrant-operator-controller-manager-86878c769f-rthgx\" (UID: \"17bbc6eb-d421-43f6-83c2-ddd706bc1715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.258846 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.258678 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17bbc6eb-d421-43f6-83c2-ddd706bc1715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rthgx\" (UID: \"17bbc6eb-d421-43f6-83c2-ddd706bc1715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.259062 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.259043 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17bbc6eb-d421-43f6-83c2-ddd706bc1715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rthgx\" (UID: \"17bbc6eb-d421-43f6-83c2-ddd706bc1715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.270018 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.269993 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76nlh\" (UniqueName: \"kubernetes.io/projected/17bbc6eb-d421-43f6-83c2-ddd706bc1715-kube-api-access-76nlh\") pod \"kuadrant-operator-controller-manager-86878c769f-rthgx\" (UID: \"17bbc6eb-d421-43f6-83c2-ddd706bc1715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.353621 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.353532 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:42.501386 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:42.501346 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx"] Jul 10 21:38:42.503703 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:38:42.503664 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bbc6eb_d421_43f6_83c2_ddd706bc1715.slice/crio-e777667c967ff9d9fc5f9f3be1ad556f2dd0f1e6a8529cfa9559aa92825c4d31 WatchSource:0}: Error finding container e777667c967ff9d9fc5f9f3be1ad556f2dd0f1e6a8529cfa9559aa92825c4d31: Status 404 returned error can't find the container with id e777667c967ff9d9fc5f9f3be1ad556f2dd0f1e6a8529cfa9559aa92825c4d31 Jul 10 21:38:43.102113 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:43.102074 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" event={"ID":"17bbc6eb-d421-43f6-83c2-ddd706bc1715","Type":"ContainerStarted","Data":"835664f832bc6f38f9ef35ecbb12bcd12a08e8a67d10878f6c22602579ef8c37"} Jul 10 21:38:43.102519 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:43.102130 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" event={"ID":"17bbc6eb-d421-43f6-83c2-ddd706bc1715","Type":"ContainerStarted","Data":"e777667c967ff9d9fc5f9f3be1ad556f2dd0f1e6a8529cfa9559aa92825c4d31"} Jul 10 21:38:43.102519 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:43.102155 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:38:43.121796 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:43.121747 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" podStartSLOduration=1.121729129 podStartE2EDuration="1.121729129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:38:43.119455606 +0000 UTC m=+1046.872957485" watchObservedRunningTime="2026-07-10 21:38:43.121729129 +0000 UTC m=+1046.875231007" Jul 10 21:38:54.109150 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:38:54.109120 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rthgx" Jul 10 21:41:16.744046 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:41:16.743959 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:41:16.745906 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:41:16.745884 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:46:16.779454 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:46:16.779422 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:46:16.781916 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:46:16.781881 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:51:16.810985 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:51:16.810950 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:51:16.814103 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:51:16.814078 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:54:36.694144 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.694110 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz"] Jul 10 21:54:36.698126 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.698103 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.701209 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.701190 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0b0348\"/\"test-model-0b0348-kserve-self-signed-certs\"" Jul 10 21:54:36.701322 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.701188 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0b0348\"/\"kube-root-ca.crt\"" Jul 10 21:54:36.701322 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.701263 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0b0348\"/\"openshift-service-ca.crt\"" Jul 10 21:54:36.701322 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.701292 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0b0348\"/\"default-dockercfg-8shj7\"" Jul 10 21:54:36.707308 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.707283 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz"] Jul 10 21:54:36.842809 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.842767 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-model-cache\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.843026 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.842836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-home\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.843026 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.842902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-dshm\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.843026 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.842924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60174ffa-41b7-45a7-ba69-054bb5aac448-tls-certs\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.843026 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.842954 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzf6b\" (UniqueName: \"kubernetes.io/projected/60174ffa-41b7-45a7-ba69-054bb5aac448-kube-api-access-rzf6b\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.843212 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.843058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-tmp-dir\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.944705 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.944614 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-model-cache\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.944705 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.944672 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-home\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.944934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.944735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-dshm\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.944934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.944758 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60174ffa-41b7-45a7-ba69-054bb5aac448-tls-certs\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.944934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.944787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzf6b\" (UniqueName: \"kubernetes.io/projected/60174ffa-41b7-45a7-ba69-054bb5aac448-kube-api-access-rzf6b\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.944934 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.944891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-tmp-dir\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.945146 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.945074 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-model-cache\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.945146 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.945121 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-home\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.945225 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.945193 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-tmp-dir\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.947352 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.947326 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-dshm\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.947527 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.947509 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60174ffa-41b7-45a7-ba69-054bb5aac448-tls-certs\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:36.953491 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:36.953461 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzf6b\" (UniqueName: \"kubernetes.io/projected/60174ffa-41b7-45a7-ba69-054bb5aac448-kube-api-access-rzf6b\") pod \"test-model-0b0348-kserve-79885f8ff9-njtcz\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:37.008607 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:37.008564 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:37.146230 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:37.146199 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz"] Jul 10 21:54:37.148094 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:54:37.148064 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60174ffa_41b7_45a7_ba69_054bb5aac448.slice/crio-dd925c6a13a72085288d2288334c19e40e60c389750f6fa8dd31f4dd66c3e177 WatchSource:0}: Error finding container dd925c6a13a72085288d2288334c19e40e60c389750f6fa8dd31f4dd66c3e177: Status 404 returned error can't find the container with id dd925c6a13a72085288d2288334c19e40e60c389750f6fa8dd31f4dd66c3e177 Jul 10 21:54:37.920577 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:37.920538 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" event={"ID":"60174ffa-41b7-45a7-ba69-054bb5aac448","Type":"ContainerStarted","Data":"b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d"} Jul 10 21:54:37.920577 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:37.920578 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" event={"ID":"60174ffa-41b7-45a7-ba69-054bb5aac448","Type":"ContainerStarted","Data":"dd925c6a13a72085288d2288334c19e40e60c389750f6fa8dd31f4dd66c3e177"} Jul 10 21:54:47.008746 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:47.008706 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:47.009151 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:47.008766 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:47.021337 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:47.021309 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:54:47.040581 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:47.040514 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" podStartSLOduration=11.040491976 podStartE2EDuration="11.040491976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:54:37.939552056 +0000 UTC m=+2001.693053934" watchObservedRunningTime="2026-07-10 21:54:47.040491976 +0000 UTC m=+2010.793993855" Jul 10 21:54:47.992509 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:54:47.992478 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:55:53.603549 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:55:53.603460 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz"] Jul 10 21:56:08.624328 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.624282 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" podUID="60174ffa-41b7-45a7-ba69-054bb5aac448" containerName="main" containerID="cri-o://b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d" gracePeriod=45 Jul 10 21:56:08.879978 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.879913 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:56:08.955552 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955513 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-home\") pod \"60174ffa-41b7-45a7-ba69-054bb5aac448\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " Jul 10 21:56:08.955758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955565 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60174ffa-41b7-45a7-ba69-054bb5aac448-tls-certs\") pod \"60174ffa-41b7-45a7-ba69-054bb5aac448\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " Jul 10 21:56:08.955758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955687 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-tmp-dir\") pod \"60174ffa-41b7-45a7-ba69-054bb5aac448\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " Jul 10 21:56:08.955758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955721 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-dshm\") pod \"60174ffa-41b7-45a7-ba69-054bb5aac448\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " Jul 10 21:56:08.955758 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955755 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzf6b\" (UniqueName: \"kubernetes.io/projected/60174ffa-41b7-45a7-ba69-054bb5aac448-kube-api-access-rzf6b\") pod \"60174ffa-41b7-45a7-ba69-054bb5aac448\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " Jul 10 21:56:08.956278 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955794 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-model-cache\") pod \"60174ffa-41b7-45a7-ba69-054bb5aac448\" (UID: \"60174ffa-41b7-45a7-ba69-054bb5aac448\") " Jul 10 21:56:08.956278 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955810 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-home" (OuterVolumeSpecName: "home") pod "60174ffa-41b7-45a7-ba69-054bb5aac448" (UID: "60174ffa-41b7-45a7-ba69-054bb5aac448"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:56:08.956278 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.955955 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60174ffa-41b7-45a7-ba69-054bb5aac448" (UID: "60174ffa-41b7-45a7-ba69-054bb5aac448"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:56:08.956278 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.956117 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-model-cache" (OuterVolumeSpecName: "model-cache") pod "60174ffa-41b7-45a7-ba69-054bb5aac448" (UID: "60174ffa-41b7-45a7-ba69-054bb5aac448"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:56:08.956278 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.956126 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-tmp-dir\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:56:08.956278 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.956165 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-home\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:56:08.958062 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.958038 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-dshm" (OuterVolumeSpecName: "dshm") pod "60174ffa-41b7-45a7-ba69-054bb5aac448" (UID: "60174ffa-41b7-45a7-ba69-054bb5aac448"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 21:56:08.958167 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.958150 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60174ffa-41b7-45a7-ba69-054bb5aac448-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60174ffa-41b7-45a7-ba69-054bb5aac448" (UID: "60174ffa-41b7-45a7-ba69-054bb5aac448"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 21:56:08.958217 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:08.958198 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60174ffa-41b7-45a7-ba69-054bb5aac448-kube-api-access-rzf6b" (OuterVolumeSpecName: "kube-api-access-rzf6b") pod "60174ffa-41b7-45a7-ba69-054bb5aac448" (UID: "60174ffa-41b7-45a7-ba69-054bb5aac448"). InnerVolumeSpecName "kube-api-access-rzf6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:56:09.057238 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.057201 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60174ffa-41b7-45a7-ba69-054bb5aac448-tls-certs\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:56:09.057238 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.057231 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-dshm\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:56:09.057238 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.057240 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzf6b\" (UniqueName: \"kubernetes.io/projected/60174ffa-41b7-45a7-ba69-054bb5aac448-kube-api-access-rzf6b\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:56:09.057535 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.057250 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60174ffa-41b7-45a7-ba69-054bb5aac448-model-cache\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 21:56:09.397443 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.397408 2584 generic.go:356] "Generic (PLEG): container finished" podID="60174ffa-41b7-45a7-ba69-054bb5aac448" containerID="b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d" exitCode=0 Jul 10 21:56:09.397443 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.397446 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" Jul 10 21:56:09.397657 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.397450 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" event={"ID":"60174ffa-41b7-45a7-ba69-054bb5aac448","Type":"ContainerDied","Data":"b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d"} Jul 10 21:56:09.397657 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.397481 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz" event={"ID":"60174ffa-41b7-45a7-ba69-054bb5aac448","Type":"ContainerDied","Data":"dd925c6a13a72085288d2288334c19e40e60c389750f6fa8dd31f4dd66c3e177"} Jul 10 21:56:09.397657 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.397500 2584 scope.go:117] "RemoveContainer" containerID="b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d" Jul 10 21:56:09.406689 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.406672 2584 scope.go:117] "RemoveContainer" containerID="b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d" Jul 10 21:56:09.406978 ip-10-0-133-215 kubenswrapper[2584]: E0710 21:56:09.406961 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d\": container with ID starting with b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d not found: ID does not exist" containerID="b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d" Jul 10 21:56:09.407040 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.406990 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d"} err="failed to get container status \"b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d\": rpc error: code = NotFound desc = could not find container \"b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d\": container with ID starting with b43cc02f8bedd6798dc7a3d4aee8742193d97228039a2ab16e9769765fda658d not found: ID does not exist" Jul 10 21:56:09.418121 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.418084 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz"] Jul 10 21:56:09.421949 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:09.421924 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0b0348/test-model-0b0348-kserve-79885f8ff9-njtcz"] Jul 10 21:56:10.860127 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:10.860093 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60174ffa-41b7-45a7-ba69-054bb5aac448" path="/var/lib/kubelet/pods/60174ffa-41b7-45a7-ba69-054bb5aac448/volumes" Jul 10 21:56:16.843928 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:16.843891 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:56:16.849139 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:56:16.848334 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 21:59:00.896083 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.896007 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687"] Jul 10 21:59:00.896566 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.896411 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60174ffa-41b7-45a7-ba69-054bb5aac448" containerName="main" Jul 10 21:59:00.896566 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.896424 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="60174ffa-41b7-45a7-ba69-054bb5aac448" containerName="main" Jul 10 21:59:00.896566 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.896519 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="60174ffa-41b7-45a7-ba69-054bb5aac448" containerName="main" Jul 10 21:59:00.899666 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.899646 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:00.902895 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.902871 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"kube-root-ca.crt\"" Jul 10 21:59:00.903022 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.902894 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"default-dockercfg-bfhrv\"" Jul 10 21:59:00.903022 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.902871 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"auth-test-model-f937a7-kserve-self-signed-certs\"" Jul 10 21:59:00.903022 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.902870 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"openshift-service-ca.crt\"" Jul 10 21:59:00.908176 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.908146 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687"] Jul 10 21:59:00.961375 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.961332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-dshm\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:00.961553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.961401 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-tmp-dir\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:00.961553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.961425 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb6b078-0ac9-4812-afea-1688be6078bd-tls-certs\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:00.961553 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.961482 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-home\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:00.961679 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.961550 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-model-cache\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:00.961679 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:00.961658 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klw2c\" (UniqueName: \"kubernetes.io/projected/fbb6b078-0ac9-4812-afea-1688be6078bd-kube-api-access-klw2c\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-dshm\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062457 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062197 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-tmp-dir\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062457 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb6b078-0ac9-4812-afea-1688be6078bd-tls-certs\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062457 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-home\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062457 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062311 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-model-cache\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062457 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062354 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klw2c\" (UniqueName: \"kubernetes.io/projected/fbb6b078-0ac9-4812-afea-1688be6078bd-kube-api-access-klw2c\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062705 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-tmp-dir\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062759 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062728 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-model-cache\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.062811 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.062742 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-home\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.064530 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.064508 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-dshm\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.064704 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.064687 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb6b078-0ac9-4812-afea-1688be6078bd-tls-certs\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.070636 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.070612 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klw2c\" (UniqueName: \"kubernetes.io/projected/fbb6b078-0ac9-4812-afea-1688be6078bd-kube-api-access-klw2c\") pod \"auth-test-model-f937a7-kserve-7b6b47b87f-9r687\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.209861 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.209757 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:01.353418 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:01.353385 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687"] Jul 10 21:59:01.353720 ip-10-0-133-215 kubenswrapper[2584]: W0710 21:59:01.353678 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbb6b078_0ac9_4812_afea_1688be6078bd.slice/crio-06bd27adb276efb73ba14c315d884e600aa4f6f41bb1b24c76cd802f1bb96287 WatchSource:0}: Error finding container 06bd27adb276efb73ba14c315d884e600aa4f6f41bb1b24c76cd802f1bb96287: Status 404 returned error can't find the container with id 06bd27adb276efb73ba14c315d884e600aa4f6f41bb1b24c76cd802f1bb96287 Jul 10 21:59:02.266895 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:02.266857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" event={"ID":"fbb6b078-0ac9-4812-afea-1688be6078bd","Type":"ContainerStarted","Data":"3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7"} Jul 10 21:59:02.267405 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:02.266904 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" event={"ID":"fbb6b078-0ac9-4812-afea-1688be6078bd","Type":"ContainerStarted","Data":"06bd27adb276efb73ba14c315d884e600aa4f6f41bb1b24c76cd802f1bb96287"} Jul 10 21:59:02.284275 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:02.284219 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" podStartSLOduration=2.284201611 podStartE2EDuration="2.284201611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:59:02.282715135 +0000 UTC m=+2266.036217013" watchObservedRunningTime="2026-07-10 21:59:02.284201611 +0000 UTC m=+2266.037703521" Jul 10 21:59:11.210420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:11.210340 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:11.210420 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:11.210436 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:11.223183 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:11.223148 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 21:59:11.324391 ip-10-0-133-215 kubenswrapper[2584]: I0710 21:59:11.324332 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 22:01:08.326413 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:08.326376 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687"] Jul 10 22:01:16.875152 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:16.875118 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 22:01:16.881959 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:16.881937 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-984zm_63ae0429-5bf0-491c-bff1-7b7957d3d956/ovn-acl-logging/0.log" Jul 10 22:01:23.355245 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.355187 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" podUID="fbb6b078-0ac9-4812-afea-1688be6078bd" containerName="main" containerID="cri-o://3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7" gracePeriod=45 Jul 10 22:01:23.616211 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.616149 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 22:01:23.779822 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.779779 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb6b078-0ac9-4812-afea-1688be6078bd-tls-certs\") pod \"fbb6b078-0ac9-4812-afea-1688be6078bd\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " Jul 10 22:01:23.779822 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.779831 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-home\") pod \"fbb6b078-0ac9-4812-afea-1688be6078bd\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " Jul 10 22:01:23.780107 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.779925 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-model-cache\") pod \"fbb6b078-0ac9-4812-afea-1688be6078bd\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " Jul 10 22:01:23.780107 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.779965 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-tmp-dir\") pod \"fbb6b078-0ac9-4812-afea-1688be6078bd\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " Jul 10 22:01:23.780107 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.779991 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-dshm\") pod \"fbb6b078-0ac9-4812-afea-1688be6078bd\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " Jul 10 22:01:23.780107 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780036 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klw2c\" (UniqueName: \"kubernetes.io/projected/fbb6b078-0ac9-4812-afea-1688be6078bd-kube-api-access-klw2c\") pod \"fbb6b078-0ac9-4812-afea-1688be6078bd\" (UID: \"fbb6b078-0ac9-4812-afea-1688be6078bd\") " Jul 10 22:01:23.780303 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780148 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-home" (OuterVolumeSpecName: "home") pod "fbb6b078-0ac9-4812-afea-1688be6078bd" (UID: "fbb6b078-0ac9-4812-afea-1688be6078bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:01:23.780303 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780167 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbb6b078-0ac9-4812-afea-1688be6078bd" (UID: "fbb6b078-0ac9-4812-afea-1688be6078bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:01:23.780303 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780183 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbb6b078-0ac9-4812-afea-1688be6078bd" (UID: "fbb6b078-0ac9-4812-afea-1688be6078bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:01:23.780487 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780350 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-home\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:01:23.780487 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780408 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-model-cache\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:01:23.780487 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.780424 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-tmp-dir\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:01:23.782202 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.782167 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-dshm" (OuterVolumeSpecName: "dshm") pod "fbb6b078-0ac9-4812-afea-1688be6078bd" (UID: "fbb6b078-0ac9-4812-afea-1688be6078bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:01:23.782202 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.782177 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbb6b078-0ac9-4812-afea-1688be6078bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbb6b078-0ac9-4812-afea-1688be6078bd" (UID: "fbb6b078-0ac9-4812-afea-1688be6078bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:01:23.782344 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.782219 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb6b078-0ac9-4812-afea-1688be6078bd-kube-api-access-klw2c" (OuterVolumeSpecName: "kube-api-access-klw2c") pod "fbb6b078-0ac9-4812-afea-1688be6078bd" (UID: "fbb6b078-0ac9-4812-afea-1688be6078bd"). InnerVolumeSpecName "kube-api-access-klw2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:01:23.881527 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.881427 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb6b078-0ac9-4812-afea-1688be6078bd-dshm\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:01:23.881527 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.881464 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klw2c\" (UniqueName: \"kubernetes.io/projected/fbb6b078-0ac9-4812-afea-1688be6078bd-kube-api-access-klw2c\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:01:23.881527 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.881478 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb6b078-0ac9-4812-afea-1688be6078bd-tls-certs\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:01:23.990089 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.990058 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbb6b078-0ac9-4812-afea-1688be6078bd" containerID="3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7" exitCode=0 Jul 10 22:01:23.990270 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.990101 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" Jul 10 22:01:23.990270 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.990132 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" event={"ID":"fbb6b078-0ac9-4812-afea-1688be6078bd","Type":"ContainerDied","Data":"3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7"} Jul 10 22:01:23.990270 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.990163 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687" event={"ID":"fbb6b078-0ac9-4812-afea-1688be6078bd","Type":"ContainerDied","Data":"06bd27adb276efb73ba14c315d884e600aa4f6f41bb1b24c76cd802f1bb96287"} Jul 10 22:01:23.990270 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.990179 2584 scope.go:117] "RemoveContainer" containerID="3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7" Jul 10 22:01:23.999718 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:23.999697 2584 scope.go:117] "RemoveContainer" containerID="3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7" Jul 10 22:01:24.000011 ip-10-0-133-215 kubenswrapper[2584]: E0710 22:01:23.999992 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7\": container with ID starting with 3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7 not found: ID does not exist" containerID="3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7" Jul 10 22:01:24.000054 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:24.000021 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7"} err="failed to get container status \"3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7\": rpc error: code = NotFound desc = could not find container \"3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7\": container with ID starting with 3cfbecd0ba50d3676f36fa7ad0100e75cea24e2c4d5734585ec611f350bfe6e7 not found: ID does not exist" Jul 10 22:01:24.025658 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:24.025620 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687"] Jul 10 22:01:24.030110 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:24.030082 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/auth-test-model-f937a7-kserve-7b6b47b87f-9r687"] Jul 10 22:01:24.859350 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:24.859309 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb6b078-0ac9-4812-afea-1688be6078bd" path="/var/lib/kubelet/pods/fbb6b078-0ac9-4812-afea-1688be6078bd/volumes" Jul 10 22:01:40.513659 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.513571 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6"] Jul 10 22:01:40.514239 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.514209 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb6b078-0ac9-4812-afea-1688be6078bd" containerName="main" Jul 10 22:01:40.514239 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.514229 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb6b078-0ac9-4812-afea-1688be6078bd" containerName="main" Jul 10 22:01:40.514378 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.514323 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb6b078-0ac9-4812-afea-1688be6078bd" containerName="main" Jul 10 22:01:40.518610 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.518586 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.521909 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.521886 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"sub-test-model-f937a7-kserve-self-signed-certs\"" Jul 10 22:01:40.522606 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.522577 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"openshift-service-ca.crt\"" Jul 10 22:01:40.522778 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.522763 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"kube-root-ca.crt\"" Jul 10 22:01:40.522907 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.522888 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"default-dockercfg-bfhrv\"" Jul 10 22:01:40.533641 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.533610 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6"] Jul 10 22:01:40.534126 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.534107 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tls-certs\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.534223 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.534136 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-model-cache\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.534223 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.534214 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tmp-dir\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.534341 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.534241 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq8xr\" (UniqueName: \"kubernetes.io/projected/06a16fe4-e37f-4d90-826c-601b36dfb7a3-kube-api-access-nq8xr\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.534341 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.534301 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-home\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.534472 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.534341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-dshm\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.634833 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.634795 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tmp-dir\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635049 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.634844 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq8xr\" (UniqueName: \"kubernetes.io/projected/06a16fe4-e37f-4d90-826c-601b36dfb7a3-kube-api-access-nq8xr\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635049 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.634894 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-home\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635049 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.634930 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-dshm\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635049 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.634986 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tls-certs\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635049 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.635014 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-model-cache\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635320 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.635293 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tmp-dir\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635428 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.635308 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-home\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.635492 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.635440 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-model-cache\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.637272 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.637247 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-dshm\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.637644 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.637623 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tls-certs\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.647971 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.647944 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq8xr\" (UniqueName: \"kubernetes.io/projected/06a16fe4-e37f-4d90-826c-601b36dfb7a3-kube-api-access-nq8xr\") pod \"sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.828907 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.828811 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:40.974244 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:40.974217 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6"] Jul 10 22:01:40.976518 ip-10-0-133-215 kubenswrapper[2584]: W0710 22:01:40.976489 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06a16fe4_e37f_4d90_826c_601b36dfb7a3.slice/crio-12fa4322c3b3128c5e70352a59e1f635e9ea3ca042d6b632c4eb46e32c4bba1a WatchSource:0}: Error finding container 12fa4322c3b3128c5e70352a59e1f635e9ea3ca042d6b632c4eb46e32c4bba1a: Status 404 returned error can't find the container with id 12fa4322c3b3128c5e70352a59e1f635e9ea3ca042d6b632c4eb46e32c4bba1a Jul 10 22:01:41.078440 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:41.078402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" event={"ID":"06a16fe4-e37f-4d90-826c-601b36dfb7a3","Type":"ContainerStarted","Data":"6cbdf905b56b82ccd0a1d553c3fdf08e904558ccbc54e63c79cb979a97a7511b"} Jul 10 22:01:41.078440 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:41.078454 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" event={"ID":"06a16fe4-e37f-4d90-826c-601b36dfb7a3","Type":"ContainerStarted","Data":"12fa4322c3b3128c5e70352a59e1f635e9ea3ca042d6b632c4eb46e32c4bba1a"} Jul 10 22:01:41.107801 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:41.107695 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" podStartSLOduration=1.107679163 podStartE2EDuration="1.107679163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:01:41.106021047 +0000 UTC m=+2424.859522927" watchObservedRunningTime="2026-07-10 22:01:41.107679163 +0000 UTC m=+2424.861181041" Jul 10 22:01:50.828954 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:50.828915 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:50.829434 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:50.828984 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:50.842037 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:50.842008 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:01:51.141475 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:01:51.141395 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:02:20.187975 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:20.187941 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6"] Jul 10 22:02:35.208929 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.208881 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" podUID="06a16fe4-e37f-4d90-826c-601b36dfb7a3" containerName="main" containerID="cri-o://6cbdf905b56b82ccd0a1d553c3fdf08e904558ccbc54e63c79cb979a97a7511b" gracePeriod=45 Jul 10 22:02:35.366866 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.366832 2584 generic.go:356] "Generic (PLEG): container finished" podID="06a16fe4-e37f-4d90-826c-601b36dfb7a3" containerID="6cbdf905b56b82ccd0a1d553c3fdf08e904558ccbc54e63c79cb979a97a7511b" exitCode=0 Jul 10 22:02:35.367037 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.366911 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" event={"ID":"06a16fe4-e37f-4d90-826c-601b36dfb7a3","Type":"ContainerDied","Data":"6cbdf905b56b82ccd0a1d553c3fdf08e904558ccbc54e63c79cb979a97a7511b"} Jul 10 22:02:35.468256 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.468233 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:02:35.573389 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573321 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-dshm\") pod \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " Jul 10 22:02:35.573571 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573468 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tls-certs\") pod \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " Jul 10 22:02:35.573571 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573501 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tmp-dir\") pod \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " Jul 10 22:02:35.573571 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573522 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-home\") pod \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " Jul 10 22:02:35.573571 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573550 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq8xr\" (UniqueName: \"kubernetes.io/projected/06a16fe4-e37f-4d90-826c-601b36dfb7a3-kube-api-access-nq8xr\") pod \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " Jul 10 22:02:35.573571 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573570 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-model-cache\") pod \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\" (UID: \"06a16fe4-e37f-4d90-826c-601b36dfb7a3\") " Jul 10 22:02:35.573865 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573812 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-home" (OuterVolumeSpecName: "home") pod "06a16fe4-e37f-4d90-826c-601b36dfb7a3" (UID: "06a16fe4-e37f-4d90-826c-601b36dfb7a3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:02:35.573865 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573827 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "06a16fe4-e37f-4d90-826c-601b36dfb7a3" (UID: "06a16fe4-e37f-4d90-826c-601b36dfb7a3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:02:35.574039 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573892 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-model-cache" (OuterVolumeSpecName: "model-cache") pod "06a16fe4-e37f-4d90-826c-601b36dfb7a3" (UID: "06a16fe4-e37f-4d90-826c-601b36dfb7a3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:02:35.574039 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573962 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tmp-dir\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:02:35.574039 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.573982 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-home\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:02:35.575603 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.575583 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-dshm" (OuterVolumeSpecName: "dshm") pod "06a16fe4-e37f-4d90-826c-601b36dfb7a3" (UID: "06a16fe4-e37f-4d90-826c-601b36dfb7a3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:02:35.575694 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.575670 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a16fe4-e37f-4d90-826c-601b36dfb7a3-kube-api-access-nq8xr" (OuterVolumeSpecName: "kube-api-access-nq8xr") pod "06a16fe4-e37f-4d90-826c-601b36dfb7a3" (UID: "06a16fe4-e37f-4d90-826c-601b36dfb7a3"). InnerVolumeSpecName "kube-api-access-nq8xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:02:35.575732 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.575696 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "06a16fe4-e37f-4d90-826c-601b36dfb7a3" (UID: "06a16fe4-e37f-4d90-826c-601b36dfb7a3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:02:35.675250 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.675210 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq8xr\" (UniqueName: \"kubernetes.io/projected/06a16fe4-e37f-4d90-826c-601b36dfb7a3-kube-api-access-nq8xr\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:02:35.675250 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.675243 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-model-cache\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:02:35.675250 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.675254 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06a16fe4-e37f-4d90-826c-601b36dfb7a3-dshm\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:02:35.675525 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:35.675261 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06a16fe4-e37f-4d90-826c-601b36dfb7a3-tls-certs\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:02:36.373577 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:36.373539 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" event={"ID":"06a16fe4-e37f-4d90-826c-601b36dfb7a3","Type":"ContainerDied","Data":"12fa4322c3b3128c5e70352a59e1f635e9ea3ca042d6b632c4eb46e32c4bba1a"} Jul 10 22:02:36.373577 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:36.373566 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6" Jul 10 22:02:36.374105 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:36.373595 2584 scope.go:117] "RemoveContainer" containerID="6cbdf905b56b82ccd0a1d553c3fdf08e904558ccbc54e63c79cb979a97a7511b" Jul 10 22:02:36.395423 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:36.395395 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6"] Jul 10 22:02:36.400766 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:36.400739 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/sub-test-model-f937a7-kserve-5b7f4f6765-bnzk6"] Jul 10 22:02:36.854466 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:02:36.854431 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a16fe4-e37f-4d90-826c-601b36dfb7a3" path="/var/lib/kubelet/pods/06a16fe4-e37f-4d90-826c-601b36dfb7a3/volumes" Jul 10 22:03:15.709498 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.709410 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2"] Jul 10 22:03:15.710083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.709868 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a16fe4-e37f-4d90-826c-601b36dfb7a3" containerName="main" Jul 10 22:03:15.710083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.709881 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a16fe4-e37f-4d90-826c-601b36dfb7a3" containerName="main" Jul 10 22:03:15.710083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.709950 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a16fe4-e37f-4d90-826c-601b36dfb7a3" containerName="main" Jul 10 22:03:15.713053 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.713032 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.716560 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.716527 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"default-dockercfg-bfhrv\"" Jul 10 22:03:15.716560 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.716527 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"openshift-service-ca.crt\"" Jul 10 22:03:15.716784 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.716527 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"rate-test-model-f937a7-kserve-self-signed-certs\"" Jul 10 22:03:15.716784 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.716586 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f937a7\"/\"kube-root-ca.crt\"" Jul 10 22:03:15.726781 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.726753 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2"] Jul 10 22:03:15.761605 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.761568 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-home\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.761784 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.761614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzn85\" (UniqueName: \"kubernetes.io/projected/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-kube-api-access-qzn85\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.761784 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.761674 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-model-cache\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.761784 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.761691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tls-certs\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.761784 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.761754 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-dshm\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.761931 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.761811 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tmp-dir\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863303 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863257 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-home\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863540 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863311 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzn85\" (UniqueName: \"kubernetes.io/projected/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-kube-api-access-qzn85\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863540 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863355 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-model-cache\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863540 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tls-certs\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863540 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863493 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-dshm\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863778 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tmp-dir\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863778 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863748 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-home\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863778 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863764 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-model-cache\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.863962 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.863919 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tmp-dir\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.865876 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.865853 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-dshm\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.865978 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.865950 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tls-certs\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:15.878011 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:15.877981 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzn85\" (UniqueName: \"kubernetes.io/projected/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-kube-api-access-qzn85\") pod \"rate-test-model-f937a7-kserve-9fb54455-66sn2\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:16.023265 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:16.023237 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:16.162853 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:16.162829 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2"] Jul 10 22:03:16.165291 ip-10-0-133-215 kubenswrapper[2584]: W0710 22:03:16.165265 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2252b7d7_1ddd_4582_aae7_4d0c802b0f57.slice/crio-0a621913342ad77d91640507daa1aa363bcfc2847727bbe7b4cb4e120d4eafdd WatchSource:0}: Error finding container 0a621913342ad77d91640507daa1aa363bcfc2847727bbe7b4cb4e120d4eafdd: Status 404 returned error can't find the container with id 0a621913342ad77d91640507daa1aa363bcfc2847727bbe7b4cb4e120d4eafdd Jul 10 22:03:16.582556 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:16.582520 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" event={"ID":"2252b7d7-1ddd-4582-aae7-4d0c802b0f57","Type":"ContainerStarted","Data":"a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb"} Jul 10 22:03:16.582747 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:16.582564 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" event={"ID":"2252b7d7-1ddd-4582-aae7-4d0c802b0f57","Type":"ContainerStarted","Data":"0a621913342ad77d91640507daa1aa363bcfc2847727bbe7b4cb4e120d4eafdd"} Jul 10 22:03:16.602667 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:16.602615 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" podStartSLOduration=1.6026000790000001 podStartE2EDuration="1.602600079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:03:16.601546525 +0000 UTC m=+2520.355048403" watchObservedRunningTime="2026-07-10 22:03:16.602600079 +0000 UTC m=+2520.356101994" Jul 10 22:03:26.023731 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:26.023698 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:26.026019 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:26.023746 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:26.037534 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:26.037509 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:03:26.646481 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:03:26.646453 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:04:13.883568 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:13.883531 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2"] Jul 10 22:04:28.905029 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:28.904981 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" podUID="2252b7d7-1ddd-4582-aae7-4d0c802b0f57" containerName="main" containerID="cri-o://a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb" gracePeriod=45 Jul 10 22:04:29.167994 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.167920 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:04:29.285627 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285589 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tmp-dir\") pod \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " Jul 10 22:04:29.285826 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285638 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-dshm\") pod \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " Jul 10 22:04:29.285826 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285691 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-home\") pod \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " Jul 10 22:04:29.285826 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285741 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzn85\" (UniqueName: \"kubernetes.io/projected/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-kube-api-access-qzn85\") pod \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " Jul 10 22:04:29.285826 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285791 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-model-cache\") pod \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " Jul 10 22:04:29.285826 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285816 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tls-certs\") pod \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\" (UID: \"2252b7d7-1ddd-4582-aae7-4d0c802b0f57\") " Jul 10 22:04:29.286094 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285907 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2252b7d7-1ddd-4582-aae7-4d0c802b0f57" (UID: "2252b7d7-1ddd-4582-aae7-4d0c802b0f57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:04:29.286094 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.285943 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-home" (OuterVolumeSpecName: "home") pod "2252b7d7-1ddd-4582-aae7-4d0c802b0f57" (UID: "2252b7d7-1ddd-4582-aae7-4d0c802b0f57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:04:29.286094 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.286081 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-model-cache" (OuterVolumeSpecName: "model-cache") pod "2252b7d7-1ddd-4582-aae7-4d0c802b0f57" (UID: "2252b7d7-1ddd-4582-aae7-4d0c802b0f57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:04:29.286211 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.286195 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tmp-dir\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:04:29.286248 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.286213 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-home\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:04:29.286248 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.286222 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-model-cache\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:04:29.287903 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.287880 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2252b7d7-1ddd-4582-aae7-4d0c802b0f57" (UID: "2252b7d7-1ddd-4582-aae7-4d0c802b0f57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:04:29.288307 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.288287 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-dshm" (OuterVolumeSpecName: "dshm") pod "2252b7d7-1ddd-4582-aae7-4d0c802b0f57" (UID: "2252b7d7-1ddd-4582-aae7-4d0c802b0f57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:04:29.288393 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.288290 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-kube-api-access-qzn85" (OuterVolumeSpecName: "kube-api-access-qzn85") pod "2252b7d7-1ddd-4582-aae7-4d0c802b0f57" (UID: "2252b7d7-1ddd-4582-aae7-4d0c802b0f57"). InnerVolumeSpecName "kube-api-access-qzn85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:04:29.387276 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.387249 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzn85\" (UniqueName: \"kubernetes.io/projected/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-kube-api-access-qzn85\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:04:29.387276 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.387275 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-tls-certs\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:04:29.387276 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.387286 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2252b7d7-1ddd-4582-aae7-4d0c802b0f57-dshm\") on node \"ip-10-0-133-215.ec2.internal\" DevicePath \"\"" Jul 10 22:04:29.950896 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.950865 2584 generic.go:356] "Generic (PLEG): container finished" podID="2252b7d7-1ddd-4582-aae7-4d0c802b0f57" containerID="a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb" exitCode=0 Jul 10 22:04:29.951406 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.950905 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" event={"ID":"2252b7d7-1ddd-4582-aae7-4d0c802b0f57","Type":"ContainerDied","Data":"a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb"} Jul 10 22:04:29.951406 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.950907 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" Jul 10 22:04:29.951406 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.950945 2584 scope.go:117] "RemoveContainer" containerID="a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb" Jul 10 22:04:29.951406 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.950934 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2" event={"ID":"2252b7d7-1ddd-4582-aae7-4d0c802b0f57","Type":"ContainerDied","Data":"0a621913342ad77d91640507daa1aa363bcfc2847727bbe7b4cb4e120d4eafdd"} Jul 10 22:04:29.960163 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.960146 2584 scope.go:117] "RemoveContainer" containerID="a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb" Jul 10 22:04:29.960618 ip-10-0-133-215 kubenswrapper[2584]: E0710 22:04:29.960598 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb\": container with ID starting with a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb not found: ID does not exist" containerID="a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb" Jul 10 22:04:29.960700 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.960624 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb"} err="failed to get container status \"a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb\": rpc error: code = NotFound desc = could not find container \"a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb\": container with ID starting with a017547f528bd4a4cdb795ec0561d321e8c1eb9abf5b8b97261121b6dbb67acb not found: ID does not exist" Jul 10 22:04:29.973131 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.973091 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2"] Jul 10 22:04:29.978563 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:29.978523 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f937a7/rate-test-model-f937a7-kserve-9fb54455-66sn2"] Jul 10 22:04:30.852755 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:04:30.852722 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2252b7d7-1ddd-4582-aae7-4d0c802b0f57" path="/var/lib/kubelet/pods/2252b7d7-1ddd-4582-aae7-4d0c802b0f57/volumes" Jul 10 22:05:25.338661 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:25.338626 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-576dff6fb6-z4f5p_9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4/authorino/0.log" Jul 10 22:05:31.153356 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:31.153324 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-6gnmz_42d71849-addd-469e-948f-7a572e6e112c/copy-manifests/0.log" Jul 10 22:05:31.161817 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:31.161785 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-6gnmz_42d71849-addd-469e-948f-7a572e6e112c/manager/0.log" Jul 10 22:05:34.360517 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:34.360485 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-576dff6fb6-z4f5p_9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4/authorino/0.log" Jul 10 22:05:34.601894 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:34.601861 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6cjfh_0806fe04-989a-420f-914d-62c9655bf218/manager/0.log" Jul 10 22:05:34.714602 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:34.714515 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bdft7_dc8ae150-7c8b-4973-b6c3-9acf71aad3f7/kuadrant-console-plugin/0.log" Jul 10 22:05:34.970224 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:34.970192 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rthgx_17bbc6eb-d421-43f6-83c2-ddd706bc1715/manager/0.log" Jul 10 22:05:35.822408 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:35.822354 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-cjjw4_602576b1-b9a6-4879-9b8a-b913c246f802/kube-auth-proxy/0.log" Jul 10 22:05:36.166277 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:36.166200 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-9gqvs_735e0f33-a8b3-4e00-9e51-4a3821d223ed/payload-pre-processing/0.log" Jul 10 22:05:36.764988 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:36.764957 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ks6s4_6bde9178-aa35-401f-97c0-d10526f61b62/main/0.log" Jul 10 22:05:37.235868 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:37.235839 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-579z5_78ea75ce-4e76-4ca2-8c0a-c66d2c6ba274/main/0.log" Jul 10 22:05:45.471128 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:45.471096 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x6qht_09212ae0-8295-4ea0-9733-b1d3fce33035/global-pull-secret-syncer/0.log" Jul 10 22:05:45.575846 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:45.575809 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-phllf_259b83cc-695a-4aa7-abf1-2a80b02ec3f6/konnectivity-agent/0.log" Jul 10 22:05:45.664061 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:45.664031 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-215.ec2.internal_031319088d640a8fab42271de4675103/haproxy/0.log" Jul 10 22:05:51.048188 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:51.048152 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-576dff6fb6-z4f5p_9dc384dd-220d-45e5-b4ff-5dc9c60a1fb4/authorino/0.log" Jul 10 22:05:51.115380 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:51.115342 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6cjfh_0806fe04-989a-420f-914d-62c9655bf218/manager/0.log" Jul 10 22:05:51.144311 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:51.144285 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bdft7_dc8ae150-7c8b-4973-b6c3-9acf71aad3f7/kuadrant-console-plugin/0.log" Jul 10 22:05:51.386226 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:51.386134 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rthgx_17bbc6eb-d421-43f6-83c2-ddd706bc1715/manager/0.log" Jul 10 22:05:53.147100 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.147071 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/alertmanager/0.log" Jul 10 22:05:53.170813 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.170786 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/config-reloader/0.log" Jul 10 22:05:53.205843 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.205811 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/kube-rbac-proxy-web/0.log" Jul 10 22:05:53.265637 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.265608 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/kube-rbac-proxy/0.log" Jul 10 22:05:53.330837 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.330802 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/kube-rbac-proxy-metric/0.log" Jul 10 22:05:53.387427 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.387332 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/prom-label-proxy/0.log" Jul 10 22:05:53.423465 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.423430 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_213d2477-9d4e-422f-88d8-9ee78431e22d/init-config-reloader/0.log" Jul 10 22:05:53.509774 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.509739 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-6tqt4_9916eaa2-9992-4e2b-86e5-e3e34e40effd/kube-state-metrics/0.log" Jul 10 22:05:53.529289 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.529256 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-6tqt4_9916eaa2-9992-4e2b-86e5-e3e34e40effd/kube-rbac-proxy-main/0.log" Jul 10 22:05:53.553398 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.553349 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-6tqt4_9916eaa2-9992-4e2b-86e5-e3e34e40effd/kube-rbac-proxy-self/0.log" Jul 10 22:05:53.586683 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.586656 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7577f8dd9d-trbnb_75800305-f851-4bbd-ab58-e8cd124b8d19/metrics-server/0.log" Jul 10 22:05:53.616867 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.616837 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-dt4bj_9631bcff-d3b4-44bd-843a-c89abb132109/monitoring-plugin/0.log" Jul 10 22:05:53.726833 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.726805 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prnhl_9df38b93-73eb-41f0-8ea1-a5bace63d85e/node-exporter/0.log" Jul 10 22:05:53.752087 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.752056 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prnhl_9df38b93-73eb-41f0-8ea1-a5bace63d85e/kube-rbac-proxy/0.log" Jul 10 22:05:53.778915 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.778886 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prnhl_9df38b93-73eb-41f0-8ea1-a5bace63d85e/init-textfile/0.log" Jul 10 22:05:53.899007 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.898973 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-l9wfk_fcbcb077-d8e4-4b8c-8819-3e3c1605964a/kube-rbac-proxy-main/0.log" Jul 10 22:05:53.922220 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.922184 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-l9wfk_fcbcb077-d8e4-4b8c-8819-3e3c1605964a/kube-rbac-proxy-self/0.log" Jul 10 22:05:53.951258 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.951231 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-l9wfk_fcbcb077-d8e4-4b8c-8819-3e3c1605964a/openshift-state-metrics/0.log" Jul 10 22:05:53.992827 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:53.992729 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/prometheus/0.log" Jul 10 22:05:54.025820 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.025790 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/config-reloader/0.log" Jul 10 22:05:54.052353 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.052323 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/thanos-sidecar/0.log" Jul 10 22:05:54.078514 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.078486 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/kube-rbac-proxy-web/0.log" Jul 10 22:05:54.104769 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.104735 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/kube-rbac-proxy/0.log" Jul 10 22:05:54.129173 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.129147 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/kube-rbac-proxy-thanos/0.log" Jul 10 22:05:54.172134 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.172105 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3acbb3ba-2954-490a-9239-85187d8b5ead/init-config-reloader/0.log" Jul 10 22:05:54.202813 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.202784 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vb6l8_2a5d30f4-e078-4e29-9501-cc5e0a4e851a/prometheus-operator/0.log" Jul 10 22:05:54.225681 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.225647 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vb6l8_2a5d30f4-e078-4e29-9501-cc5e0a4e851a/kube-rbac-proxy/0.log" Jul 10 22:05:54.260987 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.260903 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-ps5m5_e9e58a9a-4a0b-4006-b19d-6a6618caf1c8/prometheus-operator-admission-webhook/0.log" Jul 10 22:05:54.302573 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.302535 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f474498f8-hq6z8_0be48946-23b8-420a-8c6d-bd69f1559e18/telemeter-client/0.log" Jul 10 22:05:54.336570 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.336542 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f474498f8-hq6z8_0be48946-23b8-420a-8c6d-bd69f1559e18/reload/0.log" Jul 10 22:05:54.373293 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.373267 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f474498f8-hq6z8_0be48946-23b8-420a-8c6d-bd69f1559e18/kube-rbac-proxy/0.log" Jul 10 22:05:54.418581 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.418554 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4896d686-2mv7v_f3bf0172-aff4-4e1d-9781-68aa60eed430/thanos-query/0.log" Jul 10 22:05:54.446326 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.446302 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4896d686-2mv7v_f3bf0172-aff4-4e1d-9781-68aa60eed430/kube-rbac-proxy-web/0.log" Jul 10 22:05:54.485150 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.485126 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4896d686-2mv7v_f3bf0172-aff4-4e1d-9781-68aa60eed430/kube-rbac-proxy/0.log" Jul 10 22:05:54.513056 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.512976 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4896d686-2mv7v_f3bf0172-aff4-4e1d-9781-68aa60eed430/prom-label-proxy/0.log" Jul 10 22:05:54.537850 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.537824 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4896d686-2mv7v_f3bf0172-aff4-4e1d-9781-68aa60eed430/kube-rbac-proxy-rules/0.log" Jul 10 22:05:54.566225 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:54.566198 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4896d686-2mv7v_f3bf0172-aff4-4e1d-9781-68aa60eed430/kube-rbac-proxy-metrics/0.log" Jul 10 22:05:55.601578 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.601545 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq"] Jul 10 22:05:55.601963 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.601937 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2252b7d7-1ddd-4582-aae7-4d0c802b0f57" containerName="main" Jul 10 22:05:55.601963 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.601948 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2252b7d7-1ddd-4582-aae7-4d0c802b0f57" containerName="main" Jul 10 22:05:55.602045 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.602033 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2252b7d7-1ddd-4582-aae7-4d0c802b0f57" containerName="main" Jul 10 22:05:55.605109 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.605087 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.607589 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.607567 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jk69p\"/\"kube-root-ca.crt\"" Jul 10 22:05:55.608386 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.608355 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jk69p\"/\"openshift-service-ca.crt\"" Jul 10 22:05:55.608464 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.608419 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jk69p\"/\"default-dockercfg-gpq7z\"" Jul 10 22:05:55.617698 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.617672 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq"] Jul 10 22:05:55.713300 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.713259 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-sys\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.713300 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.713298 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-lib-modules\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.713543 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.713345 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-proc\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.713543 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.713460 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b7zq\" (UniqueName: \"kubernetes.io/projected/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-kube-api-access-8b7zq\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.713543 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.713496 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-podres\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.814902 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.814861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-proc\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.814922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b7zq\" (UniqueName: \"kubernetes.io/projected/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-kube-api-access-8b7zq\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.814950 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-podres\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.815001 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-sys\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.814999 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-proc\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815083 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.815016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-lib-modules\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815275 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.815085 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-sys\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815275 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.815130 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-lib-modules\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.815275 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.815128 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-podres\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.823761 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.823729 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b7zq\" (UniqueName: \"kubernetes.io/projected/3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9-kube-api-access-8b7zq\") pod \"perf-node-gather-daemonset-n4zwq\" (UID: \"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9\") " pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:55.915591 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:55.915492 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:56.054173 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:56.054148 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq"] Jul 10 22:05:56.056604 ip-10-0-133-215 kubenswrapper[2584]: W0710 22:05:56.056576 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d7ef9cd_57a1_4e0c_8bb5_f00f14b9cda9.slice/crio-0f7594ff67323bf9fb4661ced398216ce0d37d652106521e85dcce482360942b WatchSource:0}: Error finding container 0f7594ff67323bf9fb4661ced398216ce0d37d652106521e85dcce482360942b: Status 404 returned error can't find the container with id 0f7594ff67323bf9fb4661ced398216ce0d37d652106521e85dcce482360942b Jul 10 22:05:56.404434 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:56.404395 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" event={"ID":"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9","Type":"ContainerStarted","Data":"e6fb02e27376d6a3d2459286d95f7afe5c8b6ca978006fdeedf9d4b9a0bc0e86"} Jul 10 22:05:56.404648 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:56.404451 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" event={"ID":"3d7ef9cd-57a1-4e0c-8bb5-f00f14b9cda9","Type":"ContainerStarted","Data":"0f7594ff67323bf9fb4661ced398216ce0d37d652106521e85dcce482360942b"} Jul 10 22:05:56.404648 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:56.404481 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:05:56.427261 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:56.427200 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" podStartSLOduration=1.427180202 podStartE2EDuration="1.427180202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:05:56.426534373 +0000 UTC m=+2680.180036254" watchObservedRunningTime="2026-07-10 22:05:56.427180202 +0000 UTC m=+2680.180682081" Jul 10 22:05:56.974534 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:56.974490 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-k4r9x_616fdfab-149d-4ff6-9869-61b75480ea6d/download-server/0.log" Jul 10 22:05:58.889781 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:58.889752 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pw44w_b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f/dns/0.log" Jul 10 22:05:58.913060 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:58.913034 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pw44w_b2ac2e3d-ac12-43cb-b2f2-915c5a24f63f/kube-rbac-proxy/0.log" Jul 10 22:05:58.965412 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:58.965357 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lpmxw_61f0b2cb-6f47-4dd1-9e7c-72b6f209ac6c/dns-node-resolver/0.log" Jul 10 22:05:59.632303 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:59.632271 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7549dc445d-sn8ts_2c041912-2698-45c2-844a-7662622a2685/registry/0.log" Jul 10 22:05:59.686107 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:05:59.686075 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ml6k_a526c132-4aa9-4d61-9200-2837910d5036/node-ca/0.log" Jul 10 22:06:00.966077 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:00.966049 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-cjjw4_602576b1-b9a6-4879-9b8a-b913c246f802/kube-auth-proxy/0.log" Jul 10 22:06:01.132095 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:01.132057 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-9gqvs_735e0f33-a8b3-4e00-9e51-4a3821d223ed/payload-pre-processing/0.log" Jul 10 22:06:01.993160 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:01.993129 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n748z_585b4b7e-839f-488e-b12c-587c0cbe4227/serve-healthcheck-canary/0.log" Jul 10 22:06:02.420213 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:02.420146 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jk69p/perf-node-gather-daemonset-n4zwq" Jul 10 22:06:02.683767 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:02.683678 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mmmbn_c8a9399d-334a-4414-8122-6174cb193b68/kube-rbac-proxy/0.log" Jul 10 22:06:02.705831 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:02.705804 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mmmbn_c8a9399d-334a-4414-8122-6174cb193b68/exporter/0.log" Jul 10 22:06:02.730295 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:02.730262 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mmmbn_c8a9399d-334a-4414-8122-6174cb193b68/extractor/0.log" Jul 10 22:06:05.760374 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:05.760312 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-6gnmz_42d71849-addd-469e-948f-7a572e6e112c/manager/0.log" Jul 10 22:06:05.788321 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:05.788297 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d8977cb58-6gnmz_42d71849-addd-469e-948f-7a572e6e112c/copy-manifests/0.log" Jul 10 22:06:05.969141 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:05.969098 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-cjjw4_602576b1-b9a6-4879-9b8a-b913c246f802/kube-auth-proxy/0.log" Jul 10 22:06:06.100586 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:06.100556 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-9gqvs_735e0f33-a8b3-4e00-9e51-4a3821d223ed/payload-pre-processing/0.log" Jul 10 22:06:07.254352 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:07.254324 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-546985876b-clhfb_d69385e4-288e-4bf8-9bdc-7fb6f2a77dd0/manager/0.log" Jul 10 22:06:07.718332 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:07.718301 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf6c8b8-cjjw4_602576b1-b9a6-4879-9b8a-b913c246f802/kube-auth-proxy/0.log" Jul 10 22:06:07.842848 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:07.842816 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-9gqvs_735e0f33-a8b3-4e00-9e51-4a3821d223ed/payload-pre-processing/0.log" Jul 10 22:06:13.810924 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:13.810889 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2cwrg_5cabc80a-2151-4a91-a311-497a9de223e5/kube-multus/0.log" Jul 10 22:06:14.012979 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:14.012951 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbgrd_6c85aef8-05f9-4817-9616-9283952dd98d/kube-multus-additional-cni-plugins/0.log" Jul 10 22:06:14.036563 ip-10-0-133-215 kubenswrapper[2584]: I0710 22:06:14.036526 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kbgrd_6c85aef8-05f9-4817-9616-9283952dd98d/egress-router-binary-copy/0.log"