Jul 28 13:46:32.928959 ip-10-0-138-18 systemd[1]: Starting Kubernetes Kubelet... Jul 28 13:46:33.446518 ip-10-0-138-18 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:46:33.446518 ip-10-0-138-18 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 13:46:33.446518 ip-10-0-138-18 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:46:33.446518 ip-10-0-138-18 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 13:46:33.446518 ip-10-0-138-18 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:46:33.447650 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.447483 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 13:46:33.451405 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451384 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:33.451405 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451404 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:33.451405 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451408 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451412 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451415 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451418 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451421 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451424 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451427 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451429 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451432 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451434 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451437 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451439 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451442 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451446 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451448 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451451 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451454 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451456 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451459 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451461 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:33.451504 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451463 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451466 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451468 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451472 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451476 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451480 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451482 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451484 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451487 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451489 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451492 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451494 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451497 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451499 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451503 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451506 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451510 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451513 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451516 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:33.451998 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451519 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451521 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451524 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451526 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451529 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451531 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451534 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451538 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451541 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451545 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451548 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451550 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451554 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451557 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451559 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451562 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451564 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451567 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451569 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:33.452440 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451571 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451575 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451578 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451581 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451597 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451600 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451602 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451605 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451608 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451611 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451613 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451617 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451619 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451622 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451624 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451626 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451629 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451632 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451635 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:33.452938 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451638 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451640 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451642 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451645 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451647 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451650 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451653 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451656 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451659 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451662 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451664 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451667 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451669 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451672 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451674 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451677 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451679 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451682 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451684 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.451687 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:33.453393 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452401 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452409 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452413 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452415 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452418 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452421 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452423 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452426 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452429 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452431 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452434 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452437 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452439 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452441 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452444 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452447 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452449 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452452 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452455 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452457 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:33.453922 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452460 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452462 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452465 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452468 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452470 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452472 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452475 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452478 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452480 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452483 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452485 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452489 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452493 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452497 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452500 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452503 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452506 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452510 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452513 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:33.454408 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452515 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452518 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452520 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452523 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452526 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452528 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452531 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452533 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452536 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452539 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452542 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452544 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452546 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452549 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452551 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452553 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452556 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452558 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452560 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452563 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:33.454915 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452565 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452569 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452572 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452575 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452578 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452581 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452598 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452601 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452604 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452611 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452614 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452617 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452620 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452622 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452625 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452628 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452630 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452633 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452635 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:33.455400 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452638 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452641 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452644 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452646 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452649 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452651 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452654 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452656 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452659 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452661 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452664 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452667 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452669 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452672 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452674 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452676 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452679 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452681 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452684 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452687 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:33.455876 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.452689 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453087 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453092 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453095 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453097 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453100 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453104 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453107 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453115 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453118 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453122 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453124 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453127 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453130 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453132 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453134 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453137 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453139 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453142 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:33.456339 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453144 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453147 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453149 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453154 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453157 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453160 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453163 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453166 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453169 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453171 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453173 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453176 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453180 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453183 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453185 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453189 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453192 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453195 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453198 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:33.456810 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453201 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453203 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453208 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453210 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453213 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453215 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453218 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453220 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453223 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453225 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453228 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453230 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453232 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453234 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453237 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453239 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453242 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453244 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453246 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453249 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:33.457256 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453251 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453253 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453256 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453258 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453260 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453263 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453266 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453268 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453271 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453273 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453276 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453278 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453281 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453284 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453288 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453290 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453293 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453295 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453297 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453300 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:33.457760 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453302 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453304 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453307 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453309 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453312 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453314 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453317 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453319 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453321 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453324 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453326 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453329 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453332 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453334 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453337 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453339 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453342 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453344 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453346 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453349 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:33.458223 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453351 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.453353 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453442 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453460 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453469 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453475 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453492 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453495 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453500 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453504 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453507 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453510 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453513 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453516 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453519 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453522 2584 flags.go:64] FLAG: --cgroup-root="" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453525 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453544 2584 flags.go:64] FLAG: --client-ca-file="" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453548 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453551 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453556 2584 flags.go:64] FLAG: --cluster-domain="" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453559 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453562 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453565 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 13:46:33.458702 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453568 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453572 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453575 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453578 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453581 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453597 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453600 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453602 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453605 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453608 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453612 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453615 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453618 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453621 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453625 2584 flags.go:64] FLAG: --enable-server="true" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453628 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453633 2584 flags.go:64] FLAG: --event-burst="100" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453636 2584 flags.go:64] FLAG: --event-qps="50" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453639 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453642 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453645 2584 flags.go:64] FLAG: --eviction-hard="" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453649 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453651 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453654 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453657 2584 flags.go:64] FLAG: --eviction-soft="" Jul 28 13:46:33.459268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453660 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453663 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453665 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453668 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453671 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453674 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453680 2584 flags.go:64] FLAG: --feature-gates="" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453684 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453687 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453690 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453693 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453696 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453700 2584 flags.go:64] FLAG: --help="false" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453702 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453705 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453708 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453711 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453714 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453717 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453720 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453723 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453725 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453728 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 13:46:33.459853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453731 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453734 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453737 2584 flags.go:64] FLAG: --kube-reserved="" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453740 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453743 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453746 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453748 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453752 2584 flags.go:64] FLAG: --lock-file="" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453754 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453757 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453760 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453766 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453769 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453771 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453774 2584 flags.go:64] FLAG: --logging-format="text" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453778 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453782 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453784 2584 flags.go:64] FLAG: --manifest-url="" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453787 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453796 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453799 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453803 2584 flags.go:64] FLAG: --max-pods="110" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453806 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453809 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453812 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 13:46:33.460413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453815 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453818 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453820 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453823 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453832 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453834 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453837 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453840 2584 flags.go:64] FLAG: --pod-cidr="" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453844 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453849 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453851 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453854 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453857 2584 flags.go:64] FLAG: --port="10250" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453860 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453864 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024ae87cd142a1a3e" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453868 2584 flags.go:64] FLAG: --qos-reserved="" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453870 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453874 2584 flags.go:64] FLAG: --register-node="true" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453877 2584 flags.go:64] FLAG: --register-with-taints="" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453881 2584 flags.go:64] FLAG: --registry-burst="10" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453883 2584 flags.go:64] FLAG: --registry-qps="5" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453886 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453889 2584 flags.go:64] FLAG: --reserved-memory="" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453894 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453897 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 13:46:33.461029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453900 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453903 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453905 2584 flags.go:64] FLAG: --runonce="false" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453908 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453911 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453914 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453917 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453919 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453922 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453926 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453929 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453932 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453935 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453938 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453941 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453944 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453947 2584 flags.go:64] FLAG: --system-cgroups="" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453950 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453955 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453958 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453961 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453967 2584 flags.go:64] FLAG: --tls-min-version="" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453969 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453972 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453975 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 13:46:33.461659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453978 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453981 2584 flags.go:64] FLAG: --v="2" Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453984 2584 flags.go:64] FLAG: --version="false" Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453988 2584 flags.go:64] FLAG: --vmodule="" Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453992 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.453996 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454132 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454136 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454139 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454142 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454145 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454147 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454150 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454152 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454155 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454157 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454160 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454162 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454165 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454168 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454170 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:33.462389 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454172 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454175 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454178 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454182 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454186 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454189 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454192 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454195 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454199 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454203 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454207 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454210 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454213 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454216 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454218 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454221 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454225 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454227 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454230 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:33.462983 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454233 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454235 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454238 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454240 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454243 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454246 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454248 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454251 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454253 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454256 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454259 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454261 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454264 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454266 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454269 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454271 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454274 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454277 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454279 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:33.463435 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454282 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454286 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454288 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454291 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454293 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454296 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454298 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454301 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454303 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454306 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454309 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454312 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454314 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454317 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454319 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454322 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454324 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454327 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454329 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454332 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:33.464237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454334 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454336 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454339 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454341 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454343 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454346 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454348 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454351 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454353 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454355 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454358 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454360 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454363 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454367 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454369 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454372 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454374 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454376 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454379 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454381 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:33.464905 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454384 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454386 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454390 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454393 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454395 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.454398 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.454403 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.462403 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.462429 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.462453 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.462458 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462552 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462558 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462563 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:33.465647 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462567 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462570 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462572 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462575 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462578 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462580 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462606 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462609 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462612 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462614 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462617 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462620 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462623 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462626 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462628 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462631 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462633 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462636 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462638 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462641 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:33.466237 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462645 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462648 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462652 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462655 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462658 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462662 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462672 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462675 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462678 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462680 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462683 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462686 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462688 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462692 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462696 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462698 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462701 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462704 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462706 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462709 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:33.466897 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462711 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462714 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462716 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462719 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462721 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462724 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462726 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462729 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462731 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462734 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462736 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462738 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462741 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462743 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462746 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462748 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462750 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462753 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462756 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462764 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:33.467481 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462767 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462770 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462772 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462778 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462781 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462788 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462791 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462793 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462796 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462798 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462800 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462803 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462805 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462807 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462810 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462812 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462814 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462817 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462819 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462822 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:33.468187 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462824 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462827 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462829 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462832 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462834 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462837 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462839 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462841 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462844 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462847 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462851 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462853 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462863 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462866 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462868 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:33.468712 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.462871 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.462876 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463065 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463070 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463073 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463076 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463079 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463082 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463085 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463088 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463090 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463093 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463095 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463098 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463100 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:33.469147 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463103 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463105 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463107 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463110 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463112 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463115 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463118 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463120 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463122 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463125 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463127 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463130 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463133 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463136 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463139 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463147 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463150 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463152 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463155 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463158 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:33.469534 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463163 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463165 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463169 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463173 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463177 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463180 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463183 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463186 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463188 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463191 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463193 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463196 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463198 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463200 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463203 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463205 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463208 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463210 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:33.470072 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463212 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463215 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463217 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463220 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463222 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463225 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463227 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463230 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463233 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463235 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463243 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463246 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463249 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463251 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463253 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463256 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463258 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463260 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463263 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463265 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:33.470525 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463268 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463270 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463273 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463275 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463277 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463280 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463282 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463285 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463287 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463290 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463292 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463295 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463297 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463300 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463302 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463305 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463307 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463310 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463312 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463315 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:33.471034 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463317 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463320 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463322 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463330 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463333 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463335 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463338 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:33.463340 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.463345 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.464380 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.467354 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.468770 2584 server.go:1019] "Starting client certificate rotation" Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.468878 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.468922 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:46:33.471850 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.471759 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:46:33.475057 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.475030 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:46:33.486016 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.485994 2584 log.go:25] "Validated CRI v1 runtime API" Jul 28 13:46:33.488493 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.488475 2584 log.go:25] "Validated CRI v1 image API" Jul 28 13:46:33.489397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.489381 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 13:46:33.493392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.493364 2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7f6f1e6a-eca8-4525-a381-bf319e66cf75:/dev/nvme0n1p3 bc102470-8022-447b-8b5d-4b0cfef93b8d:/dev/nvme0n1p4] Jul 28 13:46:33.493492 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.493390 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 13:46:33.499210 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.499185 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:46:33.499936 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.499822 2584 manager.go:216] Machine: {Timestamp:2026-07-28 13:46:33.49921344 +0000 UTC m=+0.430073790 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201655 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e8c06fceab3a895c221677e74a42f SystemUUID:ec2e8c06-fcea-b3a8-95c2-21677e74a42f BootID:bc2eb495-098d-4416-ad6c-b122c4685cbd Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:99:c0:87:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:99:c0:87:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:e2:f5:7d:2a:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 13:46:33.499936 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.499931 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 13:46:33.500057 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.500028 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 13:46:33.501115 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.501088 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 13:46:33.501267 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.501118 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-18.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 13:46:33.501872 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.501861 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 13:46:33.501911 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.501875 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 13:46:33.501911 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.501883 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:46:33.502811 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.502800 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:46:33.503678 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.503665 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 13:46:33.506563 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506546 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:46:33.506730 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506719 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 13:46:33.506770 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506754 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 28 13:46:33.506770 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506765 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 13:46:33.506831 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506781 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 13:46:33.506831 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506791 2584 kubelet.go:398] "Adding apiserver pod source" Jul 28 13:46:33.506831 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.506800 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 13:46:33.507229 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.507202 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:46:33.507229 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.507228 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:46:33.510267 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.510242 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 13:46:33.512620 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.512578 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 13:46:33.512697 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.512635 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514143 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514163 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514170 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514178 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514188 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514194 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514203 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514209 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514217 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514223 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514233 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514239 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514902 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 13:46:33.517822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.514910 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 13:46:33.518384 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.518371 2584 server.go:1268] "Started kubelet" Jul 28 13:46:33.518700 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.518481 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 13:46:33.518700 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.518547 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 13:46:33.518700 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.518621 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 13:46:33.519351 ip-10-0-138-18 systemd[1]: Started Kubernetes Kubelet. Jul 28 13:46:33.520635 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.520615 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 13:46:33.520731 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.520706 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 13:46:33.520780 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.520724 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 13:46:33.520780 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.520764 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-18.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 13:46:33.521268 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.521254 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 28 13:46:33.524495 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.524474 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 13:46:33.524816 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.523874 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-18.ec2.internal.18c67822e2352772 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-18.ec2.internal,UID:ip-10-0-138-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-18.ec2.internal,},FirstTimestamp:2026-07-28 13:46:33.518335858 +0000 UTC m=+0.449196265,LastTimestamp:2026-07-28 13:46:33.518335858 +0000 UTC m=+0.449196265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-18.ec2.internal,}" Jul 28 13:46:33.527345 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.527323 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 13:46:33.527442 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.527407 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 13:46:33.527508 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.527488 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:33.527926 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.527910 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 13:46:33.528140 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528096 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 13:46:33.528227 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528147 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 13:46:33.528317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528302 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 28 13:46:33.528362 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528318 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 28 13:46:33.528504 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528488 2584 factory.go:55] Registering systemd factory Jul 28 13:46:33.528568 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528532 2584 factory.go:223] Registration of the systemd container factory successfully Jul 28 13:46:33.528864 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528852 2584 factory.go:153] Registering CRI-O factory Jul 28 13:46:33.528905 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528869 2584 factory.go:223] Registration of the crio container factory successfully Jul 28 13:46:33.528943 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528926 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 13:46:33.528980 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528946 2584 factory.go:103] Registering Raw factory Jul 28 13:46:33.528980 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.528957 2584 manager.go:1196] Started watching for new ooms in manager Jul 28 13:46:33.529690 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.529667 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 13:46:33.529755 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.529738 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 13:46:33.530226 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.530210 2584 manager.go:349] Starting recovery of all containers Jul 28 13:46:33.535188 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.535159 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jmtqm" Jul 28 13:46:33.543827 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.543800 2584 manager.go:354] Recovery completed Jul 28 13:46:33.549162 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.549022 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.549826 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.549808 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jmtqm" Jul 28 13:46:33.551269 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551251 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.551357 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551288 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.551357 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551303 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.551952 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551937 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 13:46:33.551997 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551952 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 13:46:33.551997 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551954 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.551997 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.551967 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:46:33.552782 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.552766 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.552838 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.552795 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.552838 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.552807 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.553967 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.553955 2584 policy_none.go:49] "None policy: Start" Jul 28 13:46:33.554024 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.553974 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 13:46:33.554024 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.553986 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 13:46:33.554559 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.554480 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-18.ec2.internal.18c67822e42bac2e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-18.ec2.internal,UID:ip-10-0-138-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-18.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-18.ec2.internal,},FirstTimestamp:2026-07-28 13:46:33.55126891 +0000 UTC m=+0.482129267,LastTimestamp:2026-07-28 13:46:33.55126891 +0000 UTC m=+0.482129267,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-18.ec2.internal,}" Jul 28 13:46:33.555551 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.555540 2584 policy_none.go:47] "Start" Jul 28 13:46:33.593329 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.593294 2584 manager.go:337] "Starting Device Plugin manager" Jul 28 13:46:33.593479 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.593340 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 13:46:33.593479 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.593353 2584 server.go:87] "Starting device plugin registration server" Jul 28 13:46:33.593864 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.593849 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 13:46:33.593951 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.593864 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 13:46:33.594006 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.593962 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 13:46:33.594069 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.594056 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 13:46:33.594069 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.594070 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 13:46:33.594651 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.594633 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 13:46:33.594747 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.594675 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:33.694391 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.694349 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.696261 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.696244 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.696332 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.696281 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.696332 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.696301 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.696332 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.696328 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.700359 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.700275 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 13:46:33.701755 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.701735 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 13:46:33.701849 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.701784 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 13:46:33.701849 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.701814 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 13:46:33.701940 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.701857 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 13:46:33.704033 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.704008 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:33.704675 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.704650 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.704750 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.704691 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-18.ec2.internal\": node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:33.755534 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.755500 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:33.802630 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.802564 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal"] Jul 28 13:46:33.802787 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.802685 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.803788 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.803768 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.803866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.803799 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.803866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.803808 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.805397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.805385 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.805510 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.805497 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.805560 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.805525 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.806147 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.806133 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.806221 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.806159 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.806221 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.806168 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.806221 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.806133 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.806317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.806238 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.806317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.806252 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.807483 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.807468 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.807528 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.807501 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:33.808241 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.808229 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:33.808300 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.808250 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:33.808300 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.808260 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:33.829963 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.829933 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0daa214522a163b287fc290469f00d45-config\") pod \"kube-apiserver-proxy-ip-10-0-138-18.ec2.internal\" (UID: \"0daa214522a163b287fc290469f00d45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.829963 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.829964 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bde8475aec9ba864e5438870a5f21a08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal\" (UID: \"bde8475aec9ba864e5438870a5f21a08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.830112 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.829985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bde8475aec9ba864e5438870a5f21a08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal\" (UID: \"bde8475aec9ba864e5438870a5f21a08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.837407 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.837386 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-18.ec2.internal\" not found" node="ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.841962 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.841942 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-18.ec2.internal\" not found" node="ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.856184 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.856155 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:33.930724 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.930696 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0daa214522a163b287fc290469f00d45-config\") pod \"kube-apiserver-proxy-ip-10-0-138-18.ec2.internal\" (UID: \"0daa214522a163b287fc290469f00d45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.930803 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.930726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bde8475aec9ba864e5438870a5f21a08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal\" (UID: \"bde8475aec9ba864e5438870a5f21a08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.930803 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.930765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bde8475aec9ba864e5438870a5f21a08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal\" (UID: \"bde8475aec9ba864e5438870a5f21a08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.930878 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.930806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0daa214522a163b287fc290469f00d45-config\") pod \"kube-apiserver-proxy-ip-10-0-138-18.ec2.internal\" (UID: \"0daa214522a163b287fc290469f00d45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.930878 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.930806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bde8475aec9ba864e5438870a5f21a08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal\" (UID: \"bde8475aec9ba864e5438870a5f21a08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.930878 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:33.930826 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bde8475aec9ba864e5438870a5f21a08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal\" (UID: \"bde8475aec9ba864e5438870a5f21a08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:33.956972 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:33.956911 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.058016 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.057981 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.140497 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.140460 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" Jul 28 13:46:34.145656 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.145630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:34.159070 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.159043 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.259601 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.259491 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.360117 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.360083 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.460623 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.460578 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.468771 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.468743 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 13:46:34.468907 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.468890 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:46:34.554528 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.554433 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 13:41:34 +0000 UTC" deadline="2027-12-31 22:27:13.271287771 +0000 UTC" Jul 28 13:46:34.554528 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.554466 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12512h40m38.716824914s" Jul 28 13:46:34.561634 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.561606 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.662405 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:34.662370 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-18.ec2.internal\" not found" Jul 28 13:46:34.721507 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.721479 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:34.723783 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.723751 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:34.728160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.728143 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" Jul 28 13:46:34.739522 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.739501 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:46:34.741489 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.741475 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" Jul 28 13:46:34.748294 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.748273 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:46:34.867649 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.867624 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:34.867927 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:34.867903 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0daa214522a163b287fc290469f00d45.slice/crio-9e7a3bbfe9eabecbca4cd819b4e14fdde1229838a25287077955a7c9d9d3e460 WatchSource:0}: Error finding container 9e7a3bbfe9eabecbca4cd819b4e14fdde1229838a25287077955a7c9d9d3e460: Status 404 returned error can't find the container with id 9e7a3bbfe9eabecbca4cd819b4e14fdde1229838a25287077955a7c9d9d3e460 Jul 28 13:46:34.873141 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:34.873125 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:46:35.461467 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.461424 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde8475aec9ba864e5438870a5f21a08.slice/crio-68a225c8f747579812211e79d0f54f6947c88c4a02797ce3f12eb82530d613ec WatchSource:0}: Error finding container 68a225c8f747579812211e79d0f54f6947c88c4a02797ce3f12eb82530d613ec: Status 404 returned error can't find the container with id 68a225c8f747579812211e79d0f54f6947c88c4a02797ce3f12eb82530d613ec Jul 28 13:46:35.507651 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.507611 2584 apiserver.go:52] "Watching apiserver" Jul 28 13:46:35.518534 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.518496 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 13:46:35.520100 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.520074 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nxwcj","openshift-network-diagnostics/network-check-target-l9rb7","openshift-network-operator/iptables-alerter-xbzlz","kube-system/global-pull-secret-syncer-lhvgc","kube-system/konnectivity-agent-jvngd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx","openshift-cluster-node-tuning-operator/tuned-7bn87","openshift-dns/node-resolver-7zj82","openshift-image-registry/node-ca-7m6fd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-4slmk","kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal","openshift-multus/multus-additional-cni-plugins-4c9tj","openshift-multus/multus-vvvvh"] Jul 28 13:46:35.521841 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.521820 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.523150 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.523127 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.524391 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.524370 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.524525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.524444 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fzdw7\"" Jul 28 13:46:35.524525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.524487 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.524678 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.524487 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.525727 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.525687 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.525840 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.525817 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.525916 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.525889 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:35.526000 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.525982 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m5zq5\"" Jul 28 13:46:35.527095 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.526703 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 13:46:35.527095 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.526769 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 13:46:35.527095 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.526789 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 13:46:35.527095 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.526853 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.527095 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.526892 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g8n9x\"" Jul 28 13:46:35.527095 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.527019 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 13:46:35.527382 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.527222 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.527382 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.527281 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.527382 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.527322 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.527867 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.527849 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 13:46:35.528830 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.528815 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.530325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.530303 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.531701 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531513 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.531701 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531532 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 13:46:35.531701 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531546 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n29wx\"" Jul 28 13:46:35.531701 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531621 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.531701 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531548 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mc9tp\"" Jul 28 13:46:35.531985 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531827 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:35.531985 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531886 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 13:46:35.531985 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.531890 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 13:46:35.531985 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.531881 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:35.532774 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.532755 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 13:46:35.533066 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.533050 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kbxbk\"" Jul 28 13:46:35.533179 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.533151 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.533179 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.533168 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.533406 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.533389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:35.533474 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.533455 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:35.534996 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.534979 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.536927 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.536908 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.537449 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.537429 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ftq58\"" Jul 28 13:46:35.537539 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.537434 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 13:46:35.538015 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.537998 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-system-cni-dir\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.538074 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538025 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-socket-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.538074 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538043 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-run\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538074 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538065 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-host\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538106 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06-agent-certs\") pod \"konnectivity-agent-jvngd\" (UID: \"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06\") " pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.538168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538132 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06-konnectivity-ca\") pod \"konnectivity-agent-jvngd\" (UID: \"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06\") " pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.538168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538150 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-lib-modules\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538285 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538183 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7164e880-4791-4d39-970c-eb00f93cf61f-dbus\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.538285 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538206 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-registration-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.538285 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538223 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-sys-fs\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.538285 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538238 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-systemd\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538285 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538259 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4kxl\" (UniqueName: \"kubernetes.io/projected/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-kube-api-access-p4kxl\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538285 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538281 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-cni-binary-copy\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538303 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysconfig\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538318 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-var-lib-kubelet\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-tmp\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538393 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-iptables-alerter-script\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538400 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538414 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7164e880-4791-4d39-970c-eb00f93cf61f-kubelet-config\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538430 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538451 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-device-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538473 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-modprobe-d\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538490 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538507 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwhwt\" (UniqueName: \"kubernetes.io/projected/9bc3d7fb-0659-4945-84cc-34e0c947e959-kube-api-access-wwhwt\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538531 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-kubernetes\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.538566 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysctl-conf\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-tuned\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-cnibin\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-os-release\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538704 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538721 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-host-slash\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538742 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538775 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538818 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb972\" (UniqueName: \"kubernetes.io/projected/779c391a-536b-4d59-9280-7e0c1b4070c3-kube-api-access-mb972\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysctl-d\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538874 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-sys\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.539160 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.538936 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fp76\" (UniqueName: \"kubernetes.io/projected/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-kube-api-access-9fp76\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.539493 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539290 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rqxb6\"" Jul 28 13:46:35.539493 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539315 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 13:46:35.539857 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539837 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 13:46:35.539857 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539859 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.539995 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539879 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 13:46:35.539995 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539840 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.539995 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.539841 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 13:46:35.540946 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.540931 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mrsbr\"" Jul 28 13:46:35.540946 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.540941 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 13:46:35.541064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.541042 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 13:46:35.541185 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.541171 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:46:35.568207 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.568179 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n22f7" Jul 28 13:46:35.571505 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.571484 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:35.580815 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.580794 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n22f7" Jul 28 13:46:35.629472 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.629439 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 13:46:35.639168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639134 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb972\" (UniqueName: \"kubernetes.io/projected/779c391a-536b-4d59-9280-7e0c1b4070c3-kube-api-access-mb972\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.639356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-sys\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.639356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639207 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47711bee-dd01-4679-893e-16c1385c94a8-host\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.639356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639232 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-cni-bin\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.639356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639255 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-conf-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.639356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-sys\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.639356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639324 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcssc\" (UniqueName: \"kubernetes.io/projected/a94b9790-40fd-4e5b-8467-8b8097948e4c-kube-api-access-tcssc\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639388 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fp76\" (UniqueName: \"kubernetes.io/projected/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-kube-api-access-9fp76\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639420 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-socket-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-host\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639462 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-k8s-cni-cncf-io\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-kubelet\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639505 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-log-socket\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639532 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-lib-modules\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639549 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-socket-dir-parent\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639564 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-netns\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639583 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639610 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7164e880-4791-4d39-970c-eb00f93cf61f-dbus\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639629 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-host\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.639664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639662 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-sys-fs\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639654 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-socket-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639699 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7bl\" (UniqueName: \"kubernetes.io/projected/47711bee-dd01-4679-893e-16c1385c94a8-kube-api-access-nl7bl\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-lib-modules\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639740 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-sys-fs\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639746 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a94b9790-40fd-4e5b-8467-8b8097948e4c-cni-binary-copy\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639760 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7164e880-4791-4d39-970c-eb00f93cf61f-dbus\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-cni-multus\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-slash\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639857 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-ovn\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639900 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-cni-binary-copy\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639925 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-var-lib-kubelet\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639955 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnnm\" (UniqueName: \"kubernetes.io/projected/f601e367-df72-4305-b87b-88dabb68acde-kube-api-access-zpnnm\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.639981 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-cni-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640013 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-var-lib-kubelet\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640056 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-hostroot\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640103 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-iptables-alerter-script\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.640272 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640138 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-device-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640181 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/014ce2fb-7ebe-4271-a48c-06756765520e-hosts-file\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640207 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-run-netns\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640520 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovnkube-config\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640581 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwhwt\" (UniqueName: \"kubernetes.io/projected/9bc3d7fb-0659-4945-84cc-34e0c947e959-kube-api-access-wwhwt\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640608 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-kubernetes\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640644 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-tuned\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640618 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-cni-binary-copy\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640705 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-systemd-units\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640737 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-cni-netd\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640722 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-iptables-alerter-script\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640244 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-device-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640776 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-cnibin\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640805 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-os-release\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640851 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-system-cni-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-etc-kubernetes\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.640902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640896 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-cnibin\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.640966 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-os-release\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79h7f\" (UniqueName: \"kubernetes.io/projected/af9c255b-3411-4c62-bcf3-bbc14b8f8391-kube-api-access-79h7f\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641007 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641042 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-kubernetes\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641095 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641158 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641183 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysctl-d\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-multus-certs\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641243 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-node-log\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641283 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-run-ovn-kubernetes\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641308 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-system-cni-dir\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641347 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-system-cni-dir\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-run\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641381 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-run\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641380 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:35.641503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06-agent-certs\") pod \"konnectivity-agent-jvngd\" (UID: \"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06\") " pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641421 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06-konnectivity-ca\") pod \"konnectivity-agent-jvngd\" (UID: \"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06\") " pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-daemon-config\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-registration-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641480 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-systemd\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4kxl\" (UniqueName: \"kubernetes.io/projected/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-kube-api-access-p4kxl\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641502 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysctl-d\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641533 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-cnibin\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641618 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-systemd\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-os-release\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641675 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-etc-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641693 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-registration-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641796 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysconfig\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641822 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-tmp\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641854 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-kubelet\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641887 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-env-overrides\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.642455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641913 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovnkube-script-lib\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641942 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7164e880-4791-4d39-970c-eb00f93cf61f-kubelet-config\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.641994 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-modprobe-d\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642023 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/014ce2fb-7ebe-4271-a48c-06756765520e-tmp-dir\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642048 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-cni-bin\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642077 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642139 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06-konnectivity-ca\") pod \"konnectivity-agent-jvngd\" (UID: \"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06\") " pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysconfig\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642155 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysctl-conf\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642189 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fct26\" (UniqueName: \"kubernetes.io/projected/014ce2fb-7ebe-4271-a48c-06756765520e-kube-api-access-fct26\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.642269 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642289 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-modprobe-d\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642301 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-sysctl-conf\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642315 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7164e880-4791-4d39-970c-eb00f93cf61f-kubelet-config\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642359 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/779c391a-536b-4d59-9280-7e0c1b4070c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.643293 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.642377 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:36.142356843 +0000 UTC m=+3.073217200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642400 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47711bee-dd01-4679-893e-16c1385c94a8-serviceca\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642436 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642463 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-systemd\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642521 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-var-lib-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-host-slash\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642604 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovn-node-metrics-cert\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642782 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-host-slash\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642781 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bc3d7fb-0659-4945-84cc-34e0c947e959-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.644168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.642824 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bc3d7fb-0659-4945-84cc-34e0c947e959-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.645230 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.645204 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-etc-tuned\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.645338 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.645234 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-tmp\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.645528 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.645510 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06-agent-certs\") pod \"konnectivity-agent-jvngd\" (UID: \"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06\") " pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.652127 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.652099 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4kxl\" (UniqueName: \"kubernetes.io/projected/9ff22090-7373-430c-a0fb-a3f2ad7fe13f-kube-api-access-p4kxl\") pod \"tuned-7bn87\" (UID: \"9ff22090-7373-430c-a0fb-a3f2ad7fe13f\") " pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.652333 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.652314 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwhwt\" (UniqueName: \"kubernetes.io/projected/9bc3d7fb-0659-4945-84cc-34e0c947e959-kube-api-access-wwhwt\") pod \"multus-additional-cni-plugins-4c9tj\" (UID: \"9bc3d7fb-0659-4945-84cc-34e0c947e959\") " pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.652460 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.652440 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fp76\" (UniqueName: \"kubernetes.io/projected/3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76-kube-api-access-9fp76\") pod \"iptables-alerter-xbzlz\" (UID: \"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76\") " pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.652843 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.652814 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb972\" (UniqueName: \"kubernetes.io/projected/779c391a-536b-4d59-9280-7e0c1b4070c3-kube-api-access-mb972\") pod \"aws-ebs-csi-driver-node-d7cwx\" (UID: \"779c391a-536b-4d59-9280-7e0c1b4070c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.707245 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.707176 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" event={"ID":"bde8475aec9ba864e5438870a5f21a08","Type":"ContainerStarted","Data":"68a225c8f747579812211e79d0f54f6947c88c4a02797ce3f12eb82530d613ec"} Jul 28 13:46:35.708504 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.708473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" event={"ID":"0daa214522a163b287fc290469f00d45","Type":"ContainerStarted","Data":"9e7a3bbfe9eabecbca4cd819b4e14fdde1229838a25287077955a7c9d9d3e460"} Jul 28 13:46:35.743378 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743266 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47711bee-dd01-4679-893e-16c1385c94a8-host\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.743378 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-cni-bin\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743378 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743374 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-conf-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743409 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47711bee-dd01-4679-893e-16c1385c94a8-host\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcssc\" (UniqueName: \"kubernetes.io/projected/a94b9790-40fd-4e5b-8467-8b8097948e4c-kube-api-access-tcssc\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743459 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-cni-bin\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743478 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-conf-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-k8s-cni-cncf-io\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743514 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-k8s-cni-cncf-io\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743556 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-kubelet\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743586 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-log-socket\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.743677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743649 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-log-socket\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743709 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-kubelet\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743690 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-socket-dir-parent\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743839 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-netns\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743872 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743865 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-socket-dir-parent\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7bl\" (UniqueName: \"kubernetes.io/projected/47711bee-dd01-4679-893e-16c1385c94a8-kube-api-access-nl7bl\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-netns\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a94b9790-40fd-4e5b-8467-8b8097948e4c-cni-binary-copy\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743964 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.743995 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-cni-multus\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744051 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-slash\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744089 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744093 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-cni-multus\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744108 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-slash\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-ovn\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744181 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnnm\" (UniqueName: \"kubernetes.io/projected/f601e367-df72-4305-b87b-88dabb68acde-kube-api-access-zpnnm\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744197 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-cni-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-hostroot\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744226 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-ovn\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744248 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/014ce2fb-7ebe-4271-a48c-06756765520e-hosts-file\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744274 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-run-netns\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744292 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-hostroot\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744293 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-cni-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744304 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744338 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744350 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-run-netns\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744358 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/014ce2fb-7ebe-4271-a48c-06756765520e-hosts-file\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovnkube-config\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744420 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-systemd-units\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-cni-netd\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.744596 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744472 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-systemd-units\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744517 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-system-cni-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744542 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-etc-kubernetes\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79h7f\" (UniqueName: \"kubernetes.io/projected/af9c255b-3411-4c62-bcf3-bbc14b8f8391-kube-api-access-79h7f\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744616 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a94b9790-40fd-4e5b-8467-8b8097948e4c-cni-binary-copy\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744628 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-system-cni-dir\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744634 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-multus-certs\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744674 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-node-log\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744682 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-etc-kubernetes\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744705 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-run-multus-certs\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-run-ovn-kubernetes\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-daemon-config\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745207 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-cnibin\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745245 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-os-release\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-etc-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745328 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-kubelet\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.745395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-env-overrides\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovnkube-script-lib\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745475 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovnkube-config\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745507 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-cnibin\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744757 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-cni-netd\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745692 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-etc-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745795 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-host-var-lib-kubelet\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745850 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-node-log\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.744761 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-run-ovn-kubernetes\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.745988 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a94b9790-40fd-4e5b-8467-8b8097948e4c-os-release\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/014ce2fb-7ebe-4271-a48c-06756765520e-tmp-dir\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-cni-bin\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746119 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovnkube-script-lib\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746130 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fct26\" (UniqueName: \"kubernetes.io/projected/014ce2fb-7ebe-4271-a48c-06756765520e-kube-api-access-fct26\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47711bee-dd01-4679-893e-16c1385c94a8-serviceca\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746197 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746234 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-systemd\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.746257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746235 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af9c255b-3411-4c62-bcf3-bbc14b8f8391-env-overrides\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.747084 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746273 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-var-lib-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.747084 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746309 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovn-node-metrics-cert\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.747084 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746343 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-host-cni-bin\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.747084 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746198 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a94b9790-40fd-4e5b-8467-8b8097948e4c-multus-daemon-config\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.747084 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746409 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/014ce2fb-7ebe-4271-a48c-06756765520e-tmp-dir\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.747084 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-var-lib-openvswitch\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.749507 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.746678 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/af9c255b-3411-4c62-bcf3-bbc14b8f8391-run-systemd\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.749684 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.747614 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47711bee-dd01-4679-893e-16c1385c94a8-serviceca\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.749744 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.747763 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:35.749792 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.749154 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af9c255b-3411-4c62-bcf3-bbc14b8f8391-ovn-node-metrics-cert\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.749859 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.749798 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:46:36.249772973 +0000 UTC m=+3.180633313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:35.751987 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.751960 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:35.751987 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.751989 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:35.752182 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.752005 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:35.752182 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:35.752094 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:36.252072376 +0000 UTC m=+3.182932740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:35.755163 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.755129 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7bl\" (UniqueName: \"kubernetes.io/projected/47711bee-dd01-4679-893e-16c1385c94a8-kube-api-access-nl7bl\") pod \"node-ca-7m6fd\" (UID: \"47711bee-dd01-4679-893e-16c1385c94a8\") " pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.755516 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.755486 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcssc\" (UniqueName: \"kubernetes.io/projected/a94b9790-40fd-4e5b-8467-8b8097948e4c-kube-api-access-tcssc\") pod \"multus-vvvvh\" (UID: \"a94b9790-40fd-4e5b-8467-8b8097948e4c\") " pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.756060 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.756031 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79h7f\" (UniqueName: \"kubernetes.io/projected/af9c255b-3411-4c62-bcf3-bbc14b8f8391-kube-api-access-79h7f\") pod \"ovnkube-node-4slmk\" (UID: \"af9c255b-3411-4c62-bcf3-bbc14b8f8391\") " pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.756832 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.756811 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fct26\" (UniqueName: \"kubernetes.io/projected/014ce2fb-7ebe-4271-a48c-06756765520e-kube-api-access-fct26\") pod \"node-resolver-7zj82\" (UID: \"014ce2fb-7ebe-4271-a48c-06756765520e\") " pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.756832 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.756827 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnnm\" (UniqueName: \"kubernetes.io/projected/f601e367-df72-4305-b87b-88dabb68acde-kube-api-access-zpnnm\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:35.833803 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.833767 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bn87" Jul 28 13:46:35.839631 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.839410 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" Jul 28 13:46:35.846253 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.846219 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff22090_7373_430c_a0fb_a3f2ad7fe13f.slice/crio-7a6c440061bd1498a2caebe6a2a37c7b6d87949de086367ecc7ada571acb3e65 WatchSource:0}: Error finding container 7a6c440061bd1498a2caebe6a2a37c7b6d87949de086367ecc7ada571acb3e65: Status 404 returned error can't find the container with id 7a6c440061bd1498a2caebe6a2a37c7b6d87949de086367ecc7ada571acb3e65 Jul 28 13:46:35.849099 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.849073 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbzlz" Jul 28 13:46:35.851416 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.851385 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc3d7fb_0659_4945_84cc_34e0c947e959.slice/crio-8610d4609b54f918447ed7df9d2771d39b306b6e57d9cdd7b92bb1ce5127fbf2 WatchSource:0}: Error finding container 8610d4609b54f918447ed7df9d2771d39b306b6e57d9cdd7b92bb1ce5127fbf2: Status 404 returned error can't find the container with id 8610d4609b54f918447ed7df9d2771d39b306b6e57d9cdd7b92bb1ce5127fbf2 Jul 28 13:46:35.855503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.855481 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:35.859651 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.859623 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbb0ae4_8f43_4fcc_a41e_ed6eebdabf76.slice/crio-9d177616579683b126058848419e39cb5943dc43cf422af233f3d8c5fe32dcd0 WatchSource:0}: Error finding container 9d177616579683b126058848419e39cb5943dc43cf422af233f3d8c5fe32dcd0: Status 404 returned error can't find the container with id 9d177616579683b126058848419e39cb5943dc43cf422af233f3d8c5fe32dcd0 Jul 28 13:46:35.860944 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.860914 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" Jul 28 13:46:35.865930 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.865897 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c5a1a4_e7af_456c_98bc_0d6e89bd3a06.slice/crio-fb5e7b1ce3b40e1eabfed74fe38c71a430d349c96bc0449d2628d62a13148df1 WatchSource:0}: Error finding container fb5e7b1ce3b40e1eabfed74fe38c71a430d349c96bc0449d2628d62a13148df1: Status 404 returned error can't find the container with id fb5e7b1ce3b40e1eabfed74fe38c71a430d349c96bc0449d2628d62a13148df1 Jul 28 13:46:35.867151 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.867131 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7m6fd" Jul 28 13:46:35.871699 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.871650 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779c391a_536b_4d59_9280_7e0c1b4070c3.slice/crio-75cd2269bd2b67352085724add5825780045ae7ab01157e797429fe01459b419 WatchSource:0}: Error finding container 75cd2269bd2b67352085724add5825780045ae7ab01157e797429fe01459b419: Status 404 returned error can't find the container with id 75cd2269bd2b67352085724add5825780045ae7ab01157e797429fe01459b419 Jul 28 13:46:35.873176 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.873151 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvvvh" Jul 28 13:46:35.879705 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.879665 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:46:35.880826 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.880779 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47711bee_dd01_4679_893e_16c1385c94a8.slice/crio-57470c8d08cbe0d09f06cd49b4097f9827abe0da00c11d7bf32535ba3eba53ba WatchSource:0}: Error finding container 57470c8d08cbe0d09f06cd49b4097f9827abe0da00c11d7bf32535ba3eba53ba: Status 404 returned error can't find the container with id 57470c8d08cbe0d09f06cd49b4097f9827abe0da00c11d7bf32535ba3eba53ba Jul 28 13:46:35.884722 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.884688 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94b9790_40fd_4e5b_8467_8b8097948e4c.slice/crio-319258f313ad33ff12e6d0a0c0d63d860cccb07a9a424b84c80511a044d2fc71 WatchSource:0}: Error finding container 319258f313ad33ff12e6d0a0c0d63d860cccb07a9a424b84c80511a044d2fc71: Status 404 returned error can't find the container with id 319258f313ad33ff12e6d0a0c0d63d860cccb07a9a424b84c80511a044d2fc71 Jul 28 13:46:35.885927 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:35.885897 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zj82" Jul 28 13:46:35.891470 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.891442 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9c255b_3411_4c62_bcf3_bbc14b8f8391.slice/crio-84d0b56133cf9b5b836ca7600b705bf108c408aa0ea41ab7a9b8ab3801fb20a5 WatchSource:0}: Error finding container 84d0b56133cf9b5b836ca7600b705bf108c408aa0ea41ab7a9b8ab3801fb20a5: Status 404 returned error can't find the container with id 84d0b56133cf9b5b836ca7600b705bf108c408aa0ea41ab7a9b8ab3801fb20a5 Jul 28 13:46:35.896895 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:46:35.896862 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014ce2fb_7ebe_4271_a48c_06756765520e.slice/crio-99df18db9c64181979b3049998b522ff38ff660eb7518d818c2df70fdac4c5dc WatchSource:0}: Error finding container 99df18db9c64181979b3049998b522ff38ff660eb7518d818c2df70fdac4c5dc: Status 404 returned error can't find the container with id 99df18db9c64181979b3049998b522ff38ff660eb7518d818c2df70fdac4c5dc Jul 28 13:46:36.150432 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.150353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:36.150580 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.150513 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:36.150620 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.150584 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:37.150566102 +0000 UTC m=+4.081426444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:36.251505 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.251463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:36.251715 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.251668 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:36.251770 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.251759 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:46:37.251735514 +0000 UTC m=+4.182595906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:36.351976 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.351932 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:36.352158 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.352092 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:36.352158 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.352118 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:36.352158 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.352131 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:36.352363 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:36.352192 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:37.352178086 +0000 UTC m=+4.283038427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:36.582843 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.582775 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:41:36 +0000 UTC" deadline="2028-01-27 13:54:53.695929774 +0000 UTC" Jul 28 13:46:36.582843 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.582840 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13152h8m17.113095621s" Jul 28 13:46:36.712171 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.712062 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zj82" event={"ID":"014ce2fb-7ebe-4271-a48c-06756765520e","Type":"ContainerStarted","Data":"99df18db9c64181979b3049998b522ff38ff660eb7518d818c2df70fdac4c5dc"} Jul 28 13:46:36.714317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.714278 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvvvh" event={"ID":"a94b9790-40fd-4e5b-8467-8b8097948e4c","Type":"ContainerStarted","Data":"319258f313ad33ff12e6d0a0c0d63d860cccb07a9a424b84c80511a044d2fc71"} Jul 28 13:46:36.716056 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.715988 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvngd" event={"ID":"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06","Type":"ContainerStarted","Data":"fb5e7b1ce3b40e1eabfed74fe38c71a430d349c96bc0449d2628d62a13148df1"} Jul 28 13:46:36.717305 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.717281 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbzlz" event={"ID":"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76","Type":"ContainerStarted","Data":"9d177616579683b126058848419e39cb5943dc43cf422af233f3d8c5fe32dcd0"} Jul 28 13:46:36.719456 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.719432 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerStarted","Data":"8610d4609b54f918447ed7df9d2771d39b306b6e57d9cdd7b92bb1ce5127fbf2"} Jul 28 13:46:36.721200 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.721176 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"84d0b56133cf9b5b836ca7600b705bf108c408aa0ea41ab7a9b8ab3801fb20a5"} Jul 28 13:46:36.723868 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.723798 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7m6fd" event={"ID":"47711bee-dd01-4679-893e-16c1385c94a8","Type":"ContainerStarted","Data":"57470c8d08cbe0d09f06cd49b4097f9827abe0da00c11d7bf32535ba3eba53ba"} Jul 28 13:46:36.726416 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.726367 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" event={"ID":"779c391a-536b-4d59-9280-7e0c1b4070c3","Type":"ContainerStarted","Data":"75cd2269bd2b67352085724add5825780045ae7ab01157e797429fe01459b419"} Jul 28 13:46:36.728221 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:36.728189 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bn87" event={"ID":"9ff22090-7373-430c-a0fb-a3f2ad7fe13f","Type":"ContainerStarted","Data":"7a6c440061bd1498a2caebe6a2a37c7b6d87949de086367ecc7ada571acb3e65"} Jul 28 13:46:37.159686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.159375 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:37.160112 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.159874 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:37.160112 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.159954 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:39.159931003 +0000 UTC m=+6.090791359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:37.261204 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.261075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:37.261380 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.261286 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:37.261380 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.261352 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:46:39.261333336 +0000 UTC m=+6.192193674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:37.362366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.362321 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:37.362597 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.362573 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:37.362698 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.362611 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:37.362698 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.362626 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:37.362825 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.362712 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:39.362690601 +0000 UTC m=+6.293550956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:37.583886 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.583777 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:41:36 +0000 UTC" deadline="2028-01-27 22:32:49.648908964 +0000 UTC" Jul 28 13:46:37.583886 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.583828 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13160h46m12.065085852s" Jul 28 13:46:37.705466 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.705424 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:37.705652 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.705585 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:37.706569 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.705881 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:37.706569 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.705992 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:37.707206 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.706923 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:37.707206 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:37.707071 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:37.754763 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:37.754688 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" event={"ID":"0daa214522a163b287fc290469f00d45","Type":"ContainerStarted","Data":"950ba5c18c75f395602a278f120db75ee88fcb3ef33ff93d3bde35bac797d5d7"} Jul 28 13:46:39.180401 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:39.180351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:39.180939 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.180616 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:39.180939 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.180712 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:43.180691295 +0000 UTC m=+10.111551648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:39.281328 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:39.281282 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:39.281539 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.281467 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:39.281539 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.281537 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:46:43.281517047 +0000 UTC m=+10.212377391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:39.382881 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:39.382077 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:39.382881 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.382317 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:39.382881 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.382344 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:39.382881 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.382357 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:39.382881 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.382419 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:43.382401124 +0000 UTC m=+10.313261487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:39.702803 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:39.702768 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:39.703012 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.702917 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:39.703339 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:39.703320 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:39.703480 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.703457 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:39.703652 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:39.703637 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:39.703779 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:39.703756 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:41.703204 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:41.703166 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:41.703714 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:41.703166 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:41.703714 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:41.703456 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:41.703714 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:41.703325 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:41.703714 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:41.703516 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:41.703714 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:41.703580 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:43.213932 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:43.213880 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:43.214433 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.214069 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:43.214433 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.214144 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:51.214121501 +0000 UTC m=+18.144981864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:43.315263 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:43.315213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:43.315473 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.315368 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:43.315473 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.315436 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:46:51.315415184 +0000 UTC m=+18.246275540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:43.416348 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:43.416304 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:43.416532 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.416488 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:43.416532 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.416509 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:43.416532 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.416523 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:43.416757 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.416579 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:51.416565727 +0000 UTC m=+18.347426071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:43.702857 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:43.702764 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:43.703077 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.702924 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:43.703384 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:43.703365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:43.703491 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.703469 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:43.704754 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:43.704605 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:43.704754 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:43.704713 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:45.702808 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:45.702771 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:45.703263 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:45.702770 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:45.703263 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:45.702908 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:45.703263 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:45.702932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:45.703263 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:45.703008 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:45.703263 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:45.703087 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:47.702231 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:47.702194 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:47.702743 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:47.702195 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:47.702743 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:47.702327 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:47.702743 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:47.702372 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:47.702743 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:47.702195 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:47.702743 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:47.702448 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:49.702895 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:49.702861 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:49.703325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:49.702861 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:49.703325 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:49.702988 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:49.703325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:49.703004 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:49.703325 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:49.703108 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:49.703325 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:49.703208 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:51.276347 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:51.276302 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:51.276931 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.276447 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:51.276931 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.276548 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:47:07.276527556 +0000 UTC m=+34.207387909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:51.377361 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:51.377316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:51.377534 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.377489 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:51.377573 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.377558 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:47:07.377543003 +0000 UTC m=+34.308403340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:51.478565 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:51.478525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:51.478754 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.478733 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:51.478814 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.478760 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:51.478814 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.478771 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:51.478890 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.478829 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:07.478815902 +0000 UTC m=+34.409676239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:51.703135 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:51.703052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:51.703284 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:51.703052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:51.703284 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.703176 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:51.703284 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.703230 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:51.703284 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:51.703052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:51.703511 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:51.703354 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:53.703913 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:53.703877 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:53.704385 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:53.703884 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:53.704385 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:53.704012 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:53.704385 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:53.704061 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:53.704385 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:53.703893 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:53.704385 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:53.704150 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:55.702090 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:55.702052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:55.702090 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:55.702089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:55.702663 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:55.702062 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:55.702663 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:55.702185 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:55.702663 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:55.702291 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:55.702663 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:55.702380 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:56.803283 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.802966 2584 generic.go:356] "Generic (PLEG): container finished" podID="bde8475aec9ba864e5438870a5f21a08" containerID="65b97a7c1cc0fcb5cca40649161911acba6902089595e81cf77df9c3e3bdfd32" exitCode=0 Jul 28 13:46:56.804009 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.803053 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" event={"ID":"bde8475aec9ba864e5438870a5f21a08","Type":"ContainerDied","Data":"65b97a7c1cc0fcb5cca40649161911acba6902089595e81cf77df9c3e3bdfd32"} Jul 28 13:46:56.804859 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.804833 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zj82" event={"ID":"014ce2fb-7ebe-4271-a48c-06756765520e","Type":"ContainerStarted","Data":"3d02527d4a593abf03bede92b250bc6a864eb152403a7822a334e3a77e5f8ec6"} Jul 28 13:46:56.806357 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.806331 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvvvh" event={"ID":"a94b9790-40fd-4e5b-8467-8b8097948e4c","Type":"ContainerStarted","Data":"46b48fc15e94a6ee0f60ca785e62a9885ec290b0188e60787d5f777ed2aaaea2"} Jul 28 13:46:56.807835 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.807814 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvngd" event={"ID":"f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06","Type":"ContainerStarted","Data":"2b91557cedf6309d98e7b8f37ef7065c86c33a8061be0b9e7a54537171033f4e"} Jul 28 13:46:56.809202 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.809182 2584 generic.go:356] "Generic (PLEG): container finished" podID="9bc3d7fb-0659-4945-84cc-34e0c947e959" containerID="bd3fdd5fc7207dd7a7eddef8cceb8b5022534ca29e4b499cc50a9e429787f5d2" exitCode=0 Jul 28 13:46:56.809309 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.809259 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerDied","Data":"bd3fdd5fc7207dd7a7eddef8cceb8b5022534ca29e4b499cc50a9e429787f5d2"} Jul 28 13:46:56.812122 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.812105 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"4038350d87deff08fb0cd873ad78548876043b7611706c357730e5f08639c2c8"} Jul 28 13:46:56.812189 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.812172 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"3b7427b9138a79b32fc15feaf4506e1f7c2b4a1ccd1b0f4bcfaf623eb5cde5b8"} Jul 28 13:46:56.812231 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.812213 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"e599fd64a7c6e9cbbb04424a4d2195d0043b7226e726450892c10b76ee2954f4"} Jul 28 13:46:56.812281 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.812254 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"72eac1a24dbf0dfe69f89f3396e51c354528abc16652ae52f3c678d502f38376"} Jul 28 13:46:56.812330 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.812298 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"eab96909de579a5a3dd78f07d7b6c931c0998b4b1a46634e6c4136748c9c1b15"} Jul 28 13:46:56.812379 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.812335 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"92db3569697352bd6ff183f3246a9857d5f80a6a32c2b018087a9cb4f5932559"} Jul 28 13:46:56.813497 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.813430 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7m6fd" event={"ID":"47711bee-dd01-4679-893e-16c1385c94a8","Type":"ContainerStarted","Data":"82442c844b7eb69efa0bc4507c54d4346c048e6388fa8a3ce73ae3c5af380de8"} Jul 28 13:46:56.814781 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.814759 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" event={"ID":"779c391a-536b-4d59-9280-7e0c1b4070c3","Type":"ContainerStarted","Data":"bae7840b3c17c48b7249d277c649c22322d25a38e2dc1438c33367de25206403"} Jul 28 13:46:56.816103 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.816084 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bn87" event={"ID":"9ff22090-7373-430c-a0fb-a3f2ad7fe13f","Type":"ContainerStarted","Data":"0b7c7a7e6abb37325bb2f669a3e96dc872696c581ac99e72027ac7f3f4861633"} Jul 28 13:46:56.818672 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.818632 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-18.ec2.internal" podStartSLOduration=21.818620269 podStartE2EDuration="21.818620269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:37.776239035 +0000 UTC m=+4.707099403" watchObservedRunningTime="2026-07-28 13:46:56.818620269 +0000 UTC m=+23.749480627" Jul 28 13:46:56.837560 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.837476 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vvvvh" podStartSLOduration=2.885789958 podStartE2EDuration="22.837461019s" totalImagesPullingTime="19.951671061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:56.836872333 +0000 UTC m=+23.767732692" watchObservedRunningTime="2026-07-28 13:46:56.837461019 +0000 UTC m=+23.768321394" Jul 28 13:46:56.882050 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.882005 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7m6fd" podStartSLOduration=2.98731077 podStartE2EDuration="22.88199147s" totalImagesPullingTime="19.8946807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:56.881729471 +0000 UTC m=+23.812589831" watchObservedRunningTime="2026-07-28 13:46:56.88199147 +0000 UTC m=+23.812851829" Jul 28 13:46:56.899776 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.899734 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7zj82" podStartSLOduration=7.039329395 podStartE2EDuration="22.899723304s" totalImagesPullingTime="15.860393909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:56.899321647 +0000 UTC m=+23.830182005" watchObservedRunningTime="2026-07-28 13:46:56.899723304 +0000 UTC m=+23.830583661" Jul 28 13:46:56.920400 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.920350 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7bn87" podStartSLOduration=2.992041596 podStartE2EDuration="22.920335347s" totalImagesPullingTime="19.928293751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:56.919413448 +0000 UTC m=+23.850273844" watchObservedRunningTime="2026-07-28 13:46:56.920335347 +0000 UTC m=+23.851195705" Jul 28 13:46:56.937811 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:56.937764 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jvngd" podStartSLOduration=3.029211182 podStartE2EDuration="22.937750062s" totalImagesPullingTime="19.90853888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:56.937284338 +0000 UTC m=+23.868144696" watchObservedRunningTime="2026-07-28 13:46:56.937750062 +0000 UTC m=+23.868610474" Jul 28 13:46:57.702345 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.702313 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:57.702689 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.702360 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:57.702689 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.702313 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:57.702689 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:57.702456 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:57.702689 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:57.702543 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:57.702689 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:57.702676 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:57.821289 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.821258 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" event={"ID":"bde8475aec9ba864e5438870a5f21a08","Type":"ContainerStarted","Data":"ee2df3bc8d5cd9f11c3522f4c2fcbdab9b42f5faad045de6483a4e8a29030860"} Jul 28 13:46:57.824463 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.823543 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbzlz" event={"ID":"3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76","Type":"ContainerStarted","Data":"0eeaccf62df95c3bea86cb3c9c0a38102ead5a2ec16bca05f9e5d651a5cad915"} Jul 28 13:46:57.858431 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.857554 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-18.ec2.internal" podStartSLOduration=22.857530505 podStartE2EDuration="22.857530505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:57.839158978 +0000 UTC m=+24.770019361" watchObservedRunningTime="2026-07-28 13:46:57.857530505 +0000 UTC m=+24.788390866" Jul 28 13:46:57.858431 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:57.858284 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xbzlz" podStartSLOduration=7.961704891 podStartE2EDuration="23.858272195s" totalImagesPullingTime="15.896567304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:57.857188157 +0000 UTC m=+24.788048515" watchObservedRunningTime="2026-07-28 13:46:57.858272195 +0000 UTC m=+24.789132556" Jul 28 13:46:58.306240 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.306212 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 13:46:58.609968 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.609810 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T13:46:58.306235418Z","UUID":"d900538d-64f3-452e-bcf1-796272fda8fc","Handler":null,"Name":"","Endpoint":""} Jul 28 13:46:58.611536 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.611513 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 13:46:58.611692 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.611559 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 13:46:58.774799 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.774616 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:58.776022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.775997 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:46:58.833138 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.833102 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"624bbd23420488092f6b1820030ea56f20200cec91c51973db9ef6c6837690be"} Jul 28 13:46:58.836197 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:58.836170 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" event={"ID":"779c391a-536b-4d59-9280-7e0c1b4070c3","Type":"ContainerStarted","Data":"7557918ef344fff1093dce8d3085b87b8af7c3eb0a5ec7b1a67055f29e99bd4b"} Jul 28 13:46:59.702536 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:59.702502 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:46:59.702734 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:59.702549 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:46:59.702734 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:59.702502 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:46:59.702734 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:59.702673 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:46:59.702902 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:59.702794 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:46:59.702902 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:46:59.702875 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:46:59.840052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:59.839963 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" event={"ID":"779c391a-536b-4d59-9280-7e0c1b4070c3","Type":"ContainerStarted","Data":"dfbf4e09e7a80aeb07e9465725eadce3c95a1ea605193a9c9a37622b557c8f58"} Jul 28 13:46:59.840052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:59.839990 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:46:59.859805 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:46:59.859751 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7cwx" podStartSLOduration=2.750003151 podStartE2EDuration="25.859732883s" totalImagesPullingTime="23.109729732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:59.859259649 +0000 UTC m=+26.790120019" watchObservedRunningTime="2026-07-28 13:46:59.859732883 +0000 UTC m=+26.790593241" Jul 28 13:47:00.696540 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:00.696503 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:47:00.697299 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:00.697262 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jvngd" Jul 28 13:47:01.702984 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.702784 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:01.703500 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.702797 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:01.703500 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:01.703089 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:01.703500 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.702828 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:01.703500 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:01.703173 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:01.703500 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:01.703210 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:01.849539 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.849508 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerStarted","Data":"e953ee660a295ef33d93dc1147829ed39455b025bc54da6e586d624258abc0a0"} Jul 28 13:47:01.853426 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.853394 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" event={"ID":"af9c255b-3411-4c62-bcf3-bbc14b8f8391","Type":"ContainerStarted","Data":"a6415c4121b2e857693d8e4e976b99ad3fdfa9dd442adf284c16f6ada935351e"} Jul 28 13:47:01.853695 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.853675 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:47:01.853852 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.853836 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:47:01.869970 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.869941 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:47:01.870114 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.870052 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:47:01.906945 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:01.906897 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" podStartSLOduration=7.9618902 podStartE2EDuration="27.906882648s" totalImagesPullingTime="19.944992448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.906143572 +0000 UTC m=+28.837003924" watchObservedRunningTime="2026-07-28 13:47:01.906882648 +0000 UTC m=+28.837743007" Jul 28 13:47:02.857172 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:02.857140 2584 generic.go:356] "Generic (PLEG): container finished" podID="9bc3d7fb-0659-4945-84cc-34e0c947e959" containerID="e953ee660a295ef33d93dc1147829ed39455b025bc54da6e586d624258abc0a0" exitCode=0 Jul 28 13:47:02.857749 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:02.857190 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerDied","Data":"e953ee660a295ef33d93dc1147829ed39455b025bc54da6e586d624258abc0a0"} Jul 28 13:47:02.857749 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:02.857295 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:47:03.224957 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.224880 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zj82_014ce2fb-7ebe-4271-a48c-06756765520e/dns-node-resolver/0.log" Jul 28 13:47:03.703812 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.703534 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:03.703946 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.703580 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:03.703946 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:03.703914 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:03.704072 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.703620 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:03.704130 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:03.703977 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:03.704130 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:03.704105 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:03.862031 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.861942 2584 generic.go:356] "Generic (PLEG): container finished" podID="9bc3d7fb-0659-4945-84cc-34e0c947e959" containerID="c51a6d5dc23382486a6f571999f51507bfac410e898ab85234e1811a6df90afe" exitCode=0 Jul 28 13:47:03.862469 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.862029 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerDied","Data":"c51a6d5dc23382486a6f571999f51507bfac410e898ab85234e1811a6df90afe"} Jul 28 13:47:03.862469 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.862156 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:47:03.870038 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.870008 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxwcj"] Jul 28 13:47:03.870185 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.870136 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:03.870286 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:03.870257 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:03.873716 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.873681 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l9rb7"] Jul 28 13:47:03.873891 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.873788 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:03.873891 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:03.873873 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:03.874364 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.874332 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhvgc"] Jul 28 13:47:03.874448 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:03.874422 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:03.874523 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:03.874506 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:04.199045 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:04.198975 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7m6fd_47711bee-dd01-4679-893e-16c1385c94a8/node-ca/0.log" Jul 28 13:47:05.544747 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:05.544713 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:47:05.702418 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:05.702387 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:05.702418 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:05.702410 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:05.702660 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:05.702389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:05.702660 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:05.702491 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:05.702660 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:05.702558 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:05.702783 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:05.702691 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:05.870493 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:05.870403 2584 generic.go:356] "Generic (PLEG): container finished" podID="9bc3d7fb-0659-4945-84cc-34e0c947e959" containerID="f78708d3162a40b3fb61ab543e49c1c3baa7005b8b5b38218ee6101ff4b2d3b4" exitCode=0 Jul 28 13:47:05.870493 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:05.870472 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerDied","Data":"f78708d3162a40b3fb61ab543e49c1c3baa7005b8b5b38218ee6101ff4b2d3b4"} Jul 28 13:47:07.295867 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:07.295828 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:07.296256 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.295991 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:47:07.296256 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.296063 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret podName:7164e880-4791-4d39-970c-eb00f93cf61f nodeName:}" failed. No retries permitted until 2026-07-28 13:47:39.296047057 +0000 UTC m=+66.226907399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret") pod "global-pull-secret-syncer-lhvgc" (UID: "7164e880-4791-4d39-970c-eb00f93cf61f") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:47:07.396494 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:07.396457 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:07.396685 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.396569 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:47:07.396685 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.396654 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs podName:f601e367-df72-4305-b87b-88dabb68acde nodeName:}" failed. No retries permitted until 2026-07-28 13:47:39.396638671 +0000 UTC m=+66.327499015 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs") pod "network-metrics-daemon-nxwcj" (UID: "f601e367-df72-4305-b87b-88dabb68acde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:47:07.497745 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:07.497662 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:07.497884 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.497774 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:47:07.497884 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.497789 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:47:07.497884 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.497798 2584 projected.go:196] Error preparing data for projected volume kube-api-access-s4lmp for pod openshift-network-diagnostics/network-check-target-l9rb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:47:07.497884 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.497843 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp podName:62d21bac-460f-4911-ad11-52d7d2c83d79 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:39.497831563 +0000 UTC m=+66.428691902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4lmp" (UniqueName: "kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp") pod "network-check-target-l9rb7" (UID: "62d21bac-460f-4911-ad11-52d7d2c83d79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:47:07.702847 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:07.702818 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:07.703043 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:07.702824 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:07.703043 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:07.702946 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:07.703043 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.702942 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:07.703192 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.703035 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:07.703192 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:07.703115 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:09.702812 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:09.702786 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:09.702812 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:09.702815 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:09.703392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:09.702783 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:09.703392 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:09.702921 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:09.703392 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:09.702985 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:09.703392 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:09.703061 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:11.702645 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:11.702420 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:11.703113 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:11.702420 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:11.703113 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:11.702759 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:11.703113 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:11.702420 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:11.703113 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:11.702823 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:11.703113 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:11.702856 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:12.891572 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:12.891530 2584 generic.go:356] "Generic (PLEG): container finished" podID="9bc3d7fb-0659-4945-84cc-34e0c947e959" containerID="f710c1a53110ba4ce68c1cc48dfd59a2f6ba081e5b8b56f419d93e342cc399a0" exitCode=0 Jul 28 13:47:12.892161 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:12.891621 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerDied","Data":"f710c1a53110ba4ce68c1cc48dfd59a2f6ba081e5b8b56f419d93e342cc399a0"} Jul 28 13:47:13.703352 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:13.703313 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:13.703542 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:13.703420 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:13.703542 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:13.703507 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:13.703845 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:13.703620 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:13.703845 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:13.703632 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:13.703845 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:13.703692 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:13.896200 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:13.896169 2584 generic.go:356] "Generic (PLEG): container finished" podID="9bc3d7fb-0659-4945-84cc-34e0c947e959" containerID="6c0291e985caf2c7f1caedb9db17d42372986aa6a89d49a696ceece836151536" exitCode=0 Jul 28 13:47:13.896626 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:13.896208 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerDied","Data":"6c0291e985caf2c7f1caedb9db17d42372986aa6a89d49a696ceece836151536"} Jul 28 13:47:14.901906 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:14.901864 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" event={"ID":"9bc3d7fb-0659-4945-84cc-34e0c947e959","Type":"ContainerStarted","Data":"b7fb93d4141d94450a181863a6ed03c79c65f09a5fb22167f602168352ebf9a8"} Jul 28 13:47:14.929475 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:14.929424 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4c9tj" podStartSLOduration=7.9932232899999995 podStartE2EDuration="40.929407485s" totalImagesPullingTime="32.936184195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:14.928981414 +0000 UTC m=+41.859841772" watchObservedRunningTime="2026-07-28 13:47:14.929407485 +0000 UTC m=+41.860267843" Jul 28 13:47:15.702829 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:15.702794 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:15.703011 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:15.702807 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:15.703011 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:15.702887 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:15.703011 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:15.702990 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:15.703182 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:15.703044 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:15.703182 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:15.703121 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:17.702837 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:17.702793 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:17.702837 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:17.702818 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:17.703322 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:17.702907 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:17.703322 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:17.702916 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:17.703322 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:17.702972 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:17.703322 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:17.703041 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:19.703021 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:19.702981 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:19.703570 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:19.702996 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:19.703570 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:19.703109 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:19.703570 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:19.703000 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:19.703570 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:19.703173 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:19.703570 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:19.703235 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:21.702998 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:21.702962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:21.703406 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:21.702962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:21.703406 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:21.703064 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:21.703406 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:21.703166 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:21.703406 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:21.702968 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:21.703406 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:21.703277 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:23.702936 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:23.702893 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:23.703415 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:23.703005 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:23.703415 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:23.703012 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:23.703415 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:23.703037 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:23.703415 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:23.703104 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:23.703415 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:23.703152 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:25.702430 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:25.702398 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:25.702909 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:25.702399 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:25.702909 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:25.702522 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhvgc" podUID="7164e880-4791-4d39-970c-eb00f93cf61f" Jul 28 13:47:25.702909 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:25.702546 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:25.702909 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:25.702634 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxwcj" podUID="f601e367-df72-4305-b87b-88dabb68acde" Jul 28 13:47:25.702909 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:25.702687 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9rb7" podUID="62d21bac-460f-4911-ad11-52d7d2c83d79" Jul 28 13:47:26.358261 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.358234 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-18.ec2.internal" event="NodeReady" Jul 28 13:47:26.358390 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.358379 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 13:47:26.417550 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.417514 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lg9pp"] Jul 28 13:47:26.419391 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.419373 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.423034 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.422998 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l8nws\"" Jul 28 13:47:26.423180 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.423158 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 13:47:26.423349 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.423285 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 13:47:26.423996 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.423976 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-59hwf"] Jul 28 13:47:26.427418 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.427397 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.430455 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.430433 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 13:47:26.430709 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.430687 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 13:47:26.430823 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.430807 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 13:47:26.430947 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.430922 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t7z7s\"" Jul 28 13:47:26.431036 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.430949 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 13:47:26.433257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.433233 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lg9pp"] Jul 28 13:47:26.445101 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.445071 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-59hwf"] Jul 28 13:47:26.514155 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.514116 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5w4cd"] Jul 28 13:47:26.516333 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.516311 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.518822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.518795 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x6gdw\"" Jul 28 13:47:26.518950 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.518928 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 13:47:26.519034 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.519019 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 13:47:26.519192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.519177 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 13:47:26.530499 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.530467 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5w4cd"] Jul 28 13:47:26.531941 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.531918 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/591927fd-acb5-49c2-b271-d8080663b830-config-volume\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.532005 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.531957 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dae6df41-3868-47dc-9858-93813458fcea-crio-socket\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.532045 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532007 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgsgf\" (UniqueName: \"kubernetes.io/projected/dae6df41-3868-47dc-9858-93813458fcea-kube-api-access-rgsgf\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.532045 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532034 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/591927fd-acb5-49c2-b271-d8080663b830-metrics-tls\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.532139 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532063 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xjwk\" (UniqueName: \"kubernetes.io/projected/591927fd-acb5-49c2-b271-d8080663b830-kube-api-access-9xjwk\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.532139 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6df41-3868-47dc-9858-93813458fcea-data-volume\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.532214 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532162 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591927fd-acb5-49c2-b271-d8080663b830-tmp-dir\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.532214 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532192 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dae6df41-3868-47dc-9858-93813458fcea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.532292 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.532226 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dae6df41-3868-47dc-9858-93813458fcea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.632619 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632496 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/591927fd-acb5-49c2-b271-d8080663b830-metrics-tls\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.632619 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632536 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xjwk\" (UniqueName: \"kubernetes.io/projected/591927fd-acb5-49c2-b271-d8080663b830-kube-api-access-9xjwk\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.632619 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632554 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6df41-3868-47dc-9858-93813458fcea-data-volume\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.632895 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632744 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hsw\" (UniqueName: \"kubernetes.io/projected/71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908-kube-api-access-b5hsw\") pod \"ingress-canary-5w4cd\" (UID: \"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908\") " pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.632895 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591927fd-acb5-49c2-b271-d8080663b830-tmp-dir\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.632895 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632825 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908-cert\") pod \"ingress-canary-5w4cd\" (UID: \"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908\") " pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.632895 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632867 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6df41-3868-47dc-9858-93813458fcea-data-volume\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633034 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632926 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dae6df41-3868-47dc-9858-93813458fcea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633034 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.632968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dae6df41-3868-47dc-9858-93813458fcea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633109 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633079 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/591927fd-acb5-49c2-b271-d8080663b830-tmp-dir\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.633109 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/591927fd-acb5-49c2-b271-d8080663b830-config-volume\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.633188 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633120 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dae6df41-3868-47dc-9858-93813458fcea-crio-socket\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633188 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgsgf\" (UniqueName: \"kubernetes.io/projected/dae6df41-3868-47dc-9858-93813458fcea-kube-api-access-rgsgf\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633342 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dae6df41-3868-47dc-9858-93813458fcea-crio-socket\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633495 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633472 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dae6df41-3868-47dc-9858-93813458fcea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.633622 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.633577 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/591927fd-acb5-49c2-b271-d8080663b830-config-volume\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.637243 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.637202 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/591927fd-acb5-49c2-b271-d8080663b830-metrics-tls\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.637243 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.637204 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dae6df41-3868-47dc-9858-93813458fcea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.641457 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.641428 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgsgf\" (UniqueName: \"kubernetes.io/projected/dae6df41-3868-47dc-9858-93813458fcea-kube-api-access-rgsgf\") pod \"insights-runtime-extractor-59hwf\" (UID: \"dae6df41-3868-47dc-9858-93813458fcea\") " pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.641662 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.641529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xjwk\" (UniqueName: \"kubernetes.io/projected/591927fd-acb5-49c2-b271-d8080663b830-kube-api-access-9xjwk\") pod \"dns-default-lg9pp\" (UID: \"591927fd-acb5-49c2-b271-d8080663b830\") " pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.729721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.729679 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:26.733490 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.733462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hsw\" (UniqueName: \"kubernetes.io/projected/71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908-kube-api-access-b5hsw\") pod \"ingress-canary-5w4cd\" (UID: \"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908\") " pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.733490 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.733490 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908-cert\") pod \"ingress-canary-5w4cd\" (UID: \"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908\") " pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.737883 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.737850 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908-cert\") pod \"ingress-canary-5w4cd\" (UID: \"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908\") " pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.739618 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.739576 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-59hwf" Jul 28 13:47:26.744064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.744035 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hsw\" (UniqueName: \"kubernetes.io/projected/71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908-kube-api-access-b5hsw\") pod \"ingress-canary-5w4cd\" (UID: \"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908\") " pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.824731 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.824702 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5w4cd" Jul 28 13:47:26.883532 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.883404 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-59hwf"] Jul 28 13:47:26.898406 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.898377 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lg9pp"] Jul 28 13:47:26.901846 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:26.901817 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591927fd_acb5_49c2_b271_d8080663b830.slice/crio-36d00f4144c28a8b17173ba47149da4cfd6ca4ec6fe9847b7e192d366e2ea2ad WatchSource:0}: Error finding container 36d00f4144c28a8b17173ba47149da4cfd6ca4ec6fe9847b7e192d366e2ea2ad: Status 404 returned error can't find the container with id 36d00f4144c28a8b17173ba47149da4cfd6ca4ec6fe9847b7e192d366e2ea2ad Jul 28 13:47:26.929122 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.929090 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59hwf" event={"ID":"dae6df41-3868-47dc-9858-93813458fcea","Type":"ContainerStarted","Data":"e6c062286ed7c532ea96641ef244d1ab3fb8500ab770dc05ee30fd482f4ef54c"} Jul 28 13:47:26.930282 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.930255 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9pp" event={"ID":"591927fd-acb5-49c2-b271-d8080663b830","Type":"ContainerStarted","Data":"36d00f4144c28a8b17173ba47149da4cfd6ca4ec6fe9847b7e192d366e2ea2ad"} Jul 28 13:47:26.967528 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:26.967488 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5w4cd"] Jul 28 13:47:26.971442 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:26.971412 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c6ddf1_a9d2_4b5b_89b7_9ea2c1fca908.slice/crio-b8d4b22cc55ec757a0f78f56426c673ec52d2b5a8a5deb84f32d7de11bb01b1b WatchSource:0}: Error finding container b8d4b22cc55ec757a0f78f56426c673ec52d2b5a8a5deb84f32d7de11bb01b1b: Status 404 returned error can't find the container with id b8d4b22cc55ec757a0f78f56426c673ec52d2b5a8a5deb84f32d7de11bb01b1b Jul 28 13:47:27.702900 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.702800 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:27.702900 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.702820 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:27.703148 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.702807 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:27.705738 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.705525 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:47:27.707009 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.706984 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26q9h\"" Jul 28 13:47:27.707369 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.707291 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:47:27.707614 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.707578 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:47:27.707868 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.707852 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:47:27.708064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.708046 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hw72x\"" Jul 28 13:47:27.937731 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:27.937657 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5w4cd" event={"ID":"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908","Type":"ContainerStarted","Data":"b8d4b22cc55ec757a0f78f56426c673ec52d2b5a8a5deb84f32d7de11bb01b1b"} Jul 28 13:47:29.944790 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:29.944755 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9pp" event={"ID":"591927fd-acb5-49c2-b271-d8080663b830","Type":"ContainerStarted","Data":"616fb5e523ea0e8428ceeb8cb74e55131eb565c4beec711f6fb5890fca63c993"} Jul 28 13:47:32.954453 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:32.954419 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9pp" event={"ID":"591927fd-acb5-49c2-b271-d8080663b830","Type":"ContainerStarted","Data":"64e615696e765df0ce535133d96d4d6f464f8b0fa80a8360ee5300d8d7f4c133"} Jul 28 13:47:32.954917 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:32.954524 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:32.956029 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:32.955999 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5w4cd" event={"ID":"71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908","Type":"ContainerStarted","Data":"35dc4c2ce8f8bd30811d9fff3e6b24cbccc745c529864483635b33d2471a4530"} Jul 28 13:47:32.957349 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:32.957329 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59hwf" event={"ID":"dae6df41-3868-47dc-9858-93813458fcea","Type":"ContainerStarted","Data":"9c995cf00e6477b222d464cf52f68e27f450a8dad57b2db7e0e235e775ca9e3f"} Jul 28 13:47:32.973899 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:32.973836 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lg9pp" podStartSLOduration=4.92727987 podStartE2EDuration="6.973817504s" totalImagesPullingTime="2.046537634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:32.973526476 +0000 UTC m=+59.904386835" watchObservedRunningTime="2026-07-28 13:47:32.973817504 +0000 UTC m=+59.904677864" Jul 28 13:47:32.990861 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:32.990799 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5w4cd" podStartSLOduration=1.4688125730000001 podStartE2EDuration="6.990777274s" totalImagesPullingTime="5.521964701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:32.990362173 +0000 UTC m=+59.921222532" watchObservedRunningTime="2026-07-28 13:47:32.990777274 +0000 UTC m=+59.921637633" Jul 28 13:47:34.885435 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:34.885393 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld"] Jul 28 13:47:34.896156 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:34.896126 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:34.897235 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:34.897209 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld"] Jul 28 13:47:34.899177 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:34.898729 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6vxmj\"" Jul 28 13:47:34.899177 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:34.898971 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 13:47:34.992981 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:34.992945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dd516293-d835-479b-adfe-da30b9381f79-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55hld\" (UID: \"dd516293-d835-479b-adfe-da30b9381f79\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:35.093773 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:35.093727 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dd516293-d835-479b-adfe-da30b9381f79-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55hld\" (UID: \"dd516293-d835-479b-adfe-da30b9381f79\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:35.093948 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:35.093890 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 13:47:35.093993 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:35.093958 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd516293-d835-479b-adfe-da30b9381f79-tls-certificates podName:dd516293-d835-479b-adfe-da30b9381f79 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:35.593941848 +0000 UTC m=+62.524802188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/dd516293-d835-479b-adfe-da30b9381f79-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-55hld" (UID: "dd516293-d835-479b-adfe-da30b9381f79") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 13:47:35.559667 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:35.559640 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4slmk" Jul 28 13:47:35.598184 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:35.598140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dd516293-d835-479b-adfe-da30b9381f79-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55hld\" (UID: \"dd516293-d835-479b-adfe-da30b9381f79\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:35.600757 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:35.600731 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dd516293-d835-479b-adfe-da30b9381f79-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-55hld\" (UID: \"dd516293-d835-479b-adfe-da30b9381f79\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:35.807312 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:35.807280 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:36.712233 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:36.712197 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld"] Jul 28 13:47:36.715962 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:36.715935 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd516293_d835_479b_adfe_da30b9381f79.slice/crio-1cc44644eb6880b2d348058cf29b824571e4109c65962a9412ba1f39694707f8 WatchSource:0}: Error finding container 1cc44644eb6880b2d348058cf29b824571e4109c65962a9412ba1f39694707f8: Status 404 returned error can't find the container with id 1cc44644eb6880b2d348058cf29b824571e4109c65962a9412ba1f39694707f8 Jul 28 13:47:36.969417 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:36.969322 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" event={"ID":"dd516293-d835-479b-adfe-da30b9381f79","Type":"ContainerStarted","Data":"1cc44644eb6880b2d348058cf29b824571e4109c65962a9412ba1f39694707f8"} Jul 28 13:47:36.970952 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:36.970930 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59hwf" event={"ID":"dae6df41-3868-47dc-9858-93813458fcea","Type":"ContainerStarted","Data":"d8531ba409732a2e82e173e2d3de255c6fc66c8e78158d28a0689858ab524354"} Jul 28 13:47:38.980831 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:38.980795 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" event={"ID":"dd516293-d835-479b-adfe-da30b9381f79","Type":"ContainerStarted","Data":"7ae925c9cf0dc62c4ef423fd916d1f9af7607339174c338a15894907cd26d2c6"} Jul 28 13:47:38.981322 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:38.981032 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:38.986800 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:38.986774 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" Jul 28 13:47:39.000150 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.000086 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-55hld" podStartSLOduration=3.563300997 podStartE2EDuration="5.000065527s" totalImagesPullingTime="1.43676453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:38.999615338 +0000 UTC m=+65.930475698" watchObservedRunningTime="2026-07-28 13:47:39.000065527 +0000 UTC m=+65.930925888" Jul 28 13:47:39.329163 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.329111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:39.332157 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.332135 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:47:39.342921 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.342896 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7164e880-4791-4d39-970c-eb00f93cf61f-original-pull-secret\") pod \"global-pull-secret-syncer-lhvgc\" (UID: \"7164e880-4791-4d39-970c-eb00f93cf61f\") " pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:39.421212 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.421172 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhvgc" Jul 28 13:47:39.430557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.430523 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:39.433395 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.433369 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:47:39.444382 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.444353 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f601e367-df72-4305-b87b-88dabb68acde-metrics-certs\") pod \"network-metrics-daemon-nxwcj\" (UID: \"f601e367-df72-4305-b87b-88dabb68acde\") " pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:39.530946 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.530889 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:39.533837 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.533815 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:47:39.544787 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.544754 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:47:39.554767 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.554741 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lmp\" (UniqueName: \"kubernetes.io/projected/62d21bac-460f-4911-ad11-52d7d2c83d79-kube-api-access-s4lmp\") pod \"network-check-target-l9rb7\" (UID: \"62d21bac-460f-4911-ad11-52d7d2c83d79\") " pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:39.734112 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.734043 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hw72x\"" Jul 28 13:47:39.742171 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.742141 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxwcj" Jul 28 13:47:39.742514 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.742494 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26q9h\"" Jul 28 13:47:39.750207 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.750165 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:39.963182 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.963149 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lg9pp" Jul 28 13:47:39.969998 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.969967 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qjhfz"] Jul 28 13:47:39.975927 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.975900 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:39.978601 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.978568 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 13:47:39.978744 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.978570 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 13:47:39.979656 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.979312 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 13:47:39.979656 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.979365 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fh4dk\"" Jul 28 13:47:39.979656 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.979389 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 13:47:39.979656 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.979366 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 13:47:39.990441 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:39.990370 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qjhfz"] Jul 28 13:47:40.035019 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.034977 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.035208 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.035048 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.035208 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.035080 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66n5\" (UniqueName: \"kubernetes.io/projected/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-kube-api-access-k66n5\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.035323 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.035237 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.136327 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.136295 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.136486 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.136357 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.136486 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.136395 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k66n5\" (UniqueName: \"kubernetes.io/projected/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-kube-api-access-k66n5\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.136486 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.136446 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.136670 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:40.136619 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 13:47:40.136728 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:40.136691 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-tls podName:7f5147dc-a047-4e4c-81f2-b84a2e1b143f nodeName:}" failed. No retries permitted until 2026-07-28 13:47:40.636668782 +0000 UTC m=+67.567529138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-qjhfz" (UID: "7f5147dc-a047-4e4c-81f2-b84a2e1b143f") : secret "prometheus-operator-tls" not found Jul 28 13:47:40.138171 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.138104 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.144113 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.144052 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.152554 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.152518 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66n5\" (UniqueName: \"kubernetes.io/projected/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-kube-api-access-k66n5\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.224000 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.223952 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxwcj"] Jul 28 13:47:40.228429 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:40.228393 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf601e367_df72_4305_b87b_88dabb68acde.slice/crio-89d1d21661f760ed073d861390d60d330a8edd6e987c2155c9e2b4536a1b7b6a WatchSource:0}: Error finding container 89d1d21661f760ed073d861390d60d330a8edd6e987c2155c9e2b4536a1b7b6a: Status 404 returned error can't find the container with id 89d1d21661f760ed073d861390d60d330a8edd6e987c2155c9e2b4536a1b7b6a Jul 28 13:47:40.246326 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.246246 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l9rb7"] Jul 28 13:47:40.248904 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:40.248881 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d21bac_460f_4911_ad11_52d7d2c83d79.slice/crio-ae754d26234776d6068c893735056cbd63d211724e40afdf9da2d69c7dc83106 WatchSource:0}: Error finding container ae754d26234776d6068c893735056cbd63d211724e40afdf9da2d69c7dc83106: Status 404 returned error can't find the container with id ae754d26234776d6068c893735056cbd63d211724e40afdf9da2d69c7dc83106 Jul 28 13:47:40.445564 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.445534 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhvgc"] Jul 28 13:47:40.448961 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:40.448935 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7164e880_4791_4d39_970c_eb00f93cf61f.slice/crio-9842581312f74f9d5b6a01cd726e9e52277c18a1bcb0a4b9fc52ae7f0acf62e4 WatchSource:0}: Error finding container 9842581312f74f9d5b6a01cd726e9e52277c18a1bcb0a4b9fc52ae7f0acf62e4: Status 404 returned error can't find the container with id 9842581312f74f9d5b6a01cd726e9e52277c18a1bcb0a4b9fc52ae7f0acf62e4 Jul 28 13:47:40.640860 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.640821 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.643432 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.643395 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f5147dc-a047-4e4c-81f2-b84a2e1b143f-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qjhfz\" (UID: \"7f5147dc-a047-4e4c-81f2-b84a2e1b143f\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.886746 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.886707 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" Jul 28 13:47:40.996764 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.996723 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhvgc" event={"ID":"7164e880-4791-4d39-970c-eb00f93cf61f","Type":"ContainerStarted","Data":"9842581312f74f9d5b6a01cd726e9e52277c18a1bcb0a4b9fc52ae7f0acf62e4"} Jul 28 13:47:40.999394 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:40.999361 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-59hwf" event={"ID":"dae6df41-3868-47dc-9858-93813458fcea","Type":"ContainerStarted","Data":"dc0e1bc69acc73bbc884b37be5796b050a5152f16a56209b9820b8655170734c"} Jul 28 13:47:41.001323 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:41.001190 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l9rb7" event={"ID":"62d21bac-460f-4911-ad11-52d7d2c83d79","Type":"ContainerStarted","Data":"ae754d26234776d6068c893735056cbd63d211724e40afdf9da2d69c7dc83106"} Jul 28 13:47:41.002665 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:41.002562 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxwcj" event={"ID":"f601e367-df72-4305-b87b-88dabb68acde","Type":"ContainerStarted","Data":"89d1d21661f760ed073d861390d60d330a8edd6e987c2155c9e2b4536a1b7b6a"} Jul 28 13:47:41.020826 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:41.020777 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-59hwf" podStartSLOduration=1.9467385209999999 podStartE2EDuration="15.020759457s" totalImagesPullingTime="13.074020936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:47:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:41.019139537 +0000 UTC m=+67.949999896" watchObservedRunningTime="2026-07-28 13:47:41.020759457 +0000 UTC m=+67.951619815" Jul 28 13:47:41.040357 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:41.040324 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qjhfz"] Jul 28 13:47:41.044335 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:41.044305 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5147dc_a047_4e4c_81f2_b84a2e1b143f.slice/crio-90dd490e328aff24dfe10ffbd8b747e53c0e2c78a1a5f570ebc586ad086567f5 WatchSource:0}: Error finding container 90dd490e328aff24dfe10ffbd8b747e53c0e2c78a1a5f570ebc586ad086567f5: Status 404 returned error can't find the container with id 90dd490e328aff24dfe10ffbd8b747e53c0e2c78a1a5f570ebc586ad086567f5 Jul 28 13:47:42.010788 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:42.010696 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" event={"ID":"7f5147dc-a047-4e4c-81f2-b84a2e1b143f","Type":"ContainerStarted","Data":"90dd490e328aff24dfe10ffbd8b747e53c0e2c78a1a5f570ebc586ad086567f5"} Jul 28 13:47:42.015311 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:42.015272 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxwcj" event={"ID":"f601e367-df72-4305-b87b-88dabb68acde","Type":"ContainerStarted","Data":"4a402946d4b0e7ac76208fd8e82f9a0be06163cf6c34dcbb4285570d46bc4ec7"} Jul 28 13:47:42.015483 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:42.015330 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxwcj" event={"ID":"f601e367-df72-4305-b87b-88dabb68acde","Type":"ContainerStarted","Data":"c6d65b00ec9efc2c07318c5632ecddc3ea63c72c33d2f5d543798f7fc2fcc4e1"} Jul 28 13:47:42.036052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:42.035990 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nxwcj" podStartSLOduration=66.703746195 podStartE2EDuration="1m8.035967595s" totalImagesPullingTime="1.3322214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:42.034183859 +0000 UTC m=+68.965044218" watchObservedRunningTime="2026-07-28 13:47:42.035967595 +0000 UTC m=+68.966827951" Jul 28 13:47:44.023855 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:44.023803 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l9rb7" event={"ID":"62d21bac-460f-4911-ad11-52d7d2c83d79","Type":"ContainerStarted","Data":"283b511c057e5b531b7bf23cb2c549062d91794282b158b977d2e6d8811617a4"} Jul 28 13:47:44.024480 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:44.023904 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:47:44.025637 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:44.025613 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" event={"ID":"7f5147dc-a047-4e4c-81f2-b84a2e1b143f","Type":"ContainerStarted","Data":"c6f19fa98891bcfcb0cfc853d55de5eb943e43debbdb681a66dff2c53fb2b2f7"} Jul 28 13:47:46.034444 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:46.034403 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhvgc" event={"ID":"7164e880-4791-4d39-970c-eb00f93cf61f","Type":"ContainerStarted","Data":"0cfb8eb98c3dfed1e92f2a3709140c2c52b4dc261ae82755db2cc6205cc38d0c"} Jul 28 13:47:46.036153 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:46.036124 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" event={"ID":"7f5147dc-a047-4e4c-81f2-b84a2e1b143f","Type":"ContainerStarted","Data":"d1533cdec7833b70e03e9eba868c340f780374d3a8602cd3af2191b7c3bf60c2"} Jul 28 13:47:46.064139 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:46.064086 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l9rb7" podStartSLOduration=68.454328542 podStartE2EDuration="1m12.064070155s" totalImagesPullingTime="3.609741613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:44.041099387 +0000 UTC m=+70.971959758" watchObservedRunningTime="2026-07-28 13:47:46.064070155 +0000 UTC m=+72.994930515" Jul 28 13:47:46.064262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:46.064211 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lhvgc" podStartSLOduration=67.213142591 podStartE2EDuration="1m12.064206336s" totalImagesPullingTime="4.851063745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:46.063574403 +0000 UTC m=+72.994434760" watchObservedRunningTime="2026-07-28 13:47:46.064206336 +0000 UTC m=+72.995066687" Jul 28 13:47:46.098904 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:46.098851 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-qjhfz" podStartSLOduration=4.299648089 podStartE2EDuration="7.098831871s" totalImagesPullingTime="2.799183782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:46.097874125 +0000 UTC m=+73.028734485" watchObservedRunningTime="2026-07-28 13:47:46.098831871 +0000 UTC m=+73.029692229" Jul 28 13:47:48.370356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.370317 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd"] Jul 28 13:47:48.372753 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.372735 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.375660 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.375629 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 13:47:48.375793 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.375643 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 13:47:48.376675 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.376662 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jw54f\"" Jul 28 13:47:48.388192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.388165 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd"] Jul 28 13:47:48.394542 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.394509 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sf9lv"] Jul 28 13:47:48.395633 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.395613 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.395696 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.395647 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.395696 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.395687 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glggb\" (UniqueName: \"kubernetes.io/projected/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-kube-api-access-glggb\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.395759 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.395737 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.396615 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.396581 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.399042 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.399019 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 13:47:48.399129 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.399061 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 13:47:48.399129 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.399117 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-88xsk\"" Jul 28 13:47:48.399793 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.399771 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 13:47:48.406348 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.406324 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4"] Jul 28 13:47:48.408419 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.408401 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.411846 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.411825 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 13:47:48.411978 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.411825 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 13:47:48.411978 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.411931 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nsb94\"" Jul 28 13:47:48.412121 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.412106 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 13:47:48.426434 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.426405 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4"] Jul 28 13:47:48.496367 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496330 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-metrics-client-ca\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.496367 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496372 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.496648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.496648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496468 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.496648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496495 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5j4j\" (UniqueName: \"kubernetes.io/projected/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-api-access-z5j4j\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.496648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496517 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-accelerators-collector-config\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.496648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.496648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496622 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-tls\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.496866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.496866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496690 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glggb\" (UniqueName: \"kubernetes.io/projected/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-kube-api-access-glggb\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.496866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ede43a5-3528-49b9-aab6-81f5468aa71c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.496866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496817 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ede43a5-3528-49b9-aab6-81f5468aa71c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.496866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-sys\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496884 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496909 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-root\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-textfile\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.496970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-wtmp\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.497014 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.497041 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzz2\" (UniqueName: \"kubernetes.io/projected/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-kube-api-access-hhzz2\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.497064 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:48.497054 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 13:47:48.497376 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:48.497144 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls podName:3cb8bf21-ce2e-43e7-89ad-28076b2745ea nodeName:}" failed. No retries permitted until 2026-07-28 13:47:48.997122063 +0000 UTC m=+75.927982422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-rtnqd" (UID: "3cb8bf21-ce2e-43e7-89ad-28076b2745ea") : secret "openshift-state-metrics-tls" not found Jul 28 13:47:48.497376 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.497244 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.499015 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.498993 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.505889 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.505860 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glggb\" (UniqueName: \"kubernetes.io/projected/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-kube-api-access-glggb\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:48.597965 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.597925 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ede43a5-3528-49b9-aab6-81f5468aa71c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.597965 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.597964 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-sys\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598201 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598028 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-sys\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598201 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598054 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-root\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598201 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-textfile\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598201 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598091 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-wtmp\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598201 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.598201 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598182 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-root\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzz2\" (UniqueName: \"kubernetes.io/projected/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-kube-api-access-hhzz2\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598240 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-wtmp\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-metrics-client-ca\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598335 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ede43a5-3528-49b9-aab6-81f5468aa71c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5j4j\" (UniqueName: \"kubernetes.io/projected/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-api-access-z5j4j\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.598477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-accelerators-collector-config\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598840 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598499 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.598840 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598460 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-textfile\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598840 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598520 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-tls\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598840 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598607 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.598840 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598656 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ede43a5-3528-49b9-aab6-81f5468aa71c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.599083 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.598992 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-accelerators-collector-config\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.599138 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.599053 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-metrics-client-ca\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.599138 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.599097 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.599287 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.599267 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ede43a5-3528-49b9-aab6-81f5468aa71c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.600865 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.600842 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.601148 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.601131 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.601391 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.601374 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-node-exporter-tls\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.601458 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.601436 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.607060 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.607021 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5j4j\" (UniqueName: \"kubernetes.io/projected/4ede43a5-3528-49b9-aab6-81f5468aa71c-kube-api-access-z5j4j\") pod \"kube-state-metrics-56d9f944b4-vmzs4\" (UID: \"4ede43a5-3528-49b9-aab6-81f5468aa71c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.607060 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.607036 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzz2\" (UniqueName: \"kubernetes.io/projected/8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32-kube-api-access-hhzz2\") pod \"node-exporter-sf9lv\" (UID: \"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32\") " pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.706050 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.705961 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sf9lv" Jul 28 13:47:48.716263 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:48.716230 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c69db8b_3f5f_4a0a_b1fe_5aa7316b1c32.slice/crio-8730a46bd806de0a7ef68ed15b3b66aa5d5b0f8df0526e0a17c2de8b6861a9a6 WatchSource:0}: Error finding container 8730a46bd806de0a7ef68ed15b3b66aa5d5b0f8df0526e0a17c2de8b6861a9a6: Status 404 returned error can't find the container with id 8730a46bd806de0a7ef68ed15b3b66aa5d5b0f8df0526e0a17c2de8b6861a9a6 Jul 28 13:47:48.716808 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.716784 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" Jul 28 13:47:48.851761 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:48.851576 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4"] Jul 28 13:47:48.854369 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:48.854340 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ede43a5_3528_49b9_aab6_81f5468aa71c.slice/crio-98d6e0ac6d3371db4de58126a9f41c6917848b74e75043521f35fdd1b04a98bf WatchSource:0}: Error finding container 98d6e0ac6d3371db4de58126a9f41c6917848b74e75043521f35fdd1b04a98bf: Status 404 returned error can't find the container with id 98d6e0ac6d3371db4de58126a9f41c6917848b74e75043521f35fdd1b04a98bf Jul 28 13:47:49.001723 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.001635 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:49.001870 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:49.001788 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 13:47:49.001870 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:49.001850 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls podName:3cb8bf21-ce2e-43e7-89ad-28076b2745ea nodeName:}" failed. No retries permitted until 2026-07-28 13:47:50.001835943 +0000 UTC m=+76.932696281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-rtnqd" (UID: "3cb8bf21-ce2e-43e7-89ad-28076b2745ea") : secret "openshift-state-metrics-tls" not found Jul 28 13:47:49.047660 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.047624 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" event={"ID":"4ede43a5-3528-49b9-aab6-81f5468aa71c","Type":"ContainerStarted","Data":"98d6e0ac6d3371db4de58126a9f41c6917848b74e75043521f35fdd1b04a98bf"} Jul 28 13:47:49.048741 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.048719 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf9lv" event={"ID":"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32","Type":"ContainerStarted","Data":"8730a46bd806de0a7ef68ed15b3b66aa5d5b0f8df0526e0a17c2de8b6861a9a6"} Jul 28 13:47:49.388912 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.388865 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:47:49.410803 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.410772 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.419532 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.419497 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 13:47:49.421879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.420681 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 13:47:49.421879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.420753 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 13:47:49.421879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.421109 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w8f7f\"" Jul 28 13:47:49.421879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.421406 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 13:47:49.422181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.422157 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 13:47:49.422666 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.422636 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 13:47:49.422775 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.422703 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 13:47:49.424119 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.424062 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 13:47:49.424498 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.424478 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 13:47:49.425005 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.424982 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:47:49.511001 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.510957 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511001 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511000 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511028 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmhbs\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-kube-api-access-dmhbs\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511061 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-config-volume\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511087 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511111 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-config-out\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511135 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-web-config\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511215 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511668 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511668 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511308 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.511668 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.511352 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612696 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612709 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612733 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612752 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmhbs\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-kube-api-access-dmhbs\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612776 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-config-volume\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612827 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-config-out\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.612879 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612850 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613142 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:47:49.612877 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle podName:eeebc780-b7e7-494a-87a9-1911de05a540 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:50.112851129 +0000 UTC m=+77.043711478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540") : configmap references non-existent config key: ca-bundle.crt Jul 28 13:47:49.613142 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.612925 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-web-config\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613142 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.613010 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613142 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.613037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613142 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.613066 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613142 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.613114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613627 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.613580 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.613758 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.613646 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.616157 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.616104 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.618924 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.618893 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.621158 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.621129 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-web-config\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.622250 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.622228 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.622364 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.622258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.622364 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.622270 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.622672 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.622654 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-config-volume\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.623161 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.623136 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.623852 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.623812 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-config-out\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:49.627506 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:49.627455 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmhbs\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-kube-api-access-dmhbs\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:50.017449 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.017356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:50.020076 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.020043 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cb8bf21-ce2e-43e7-89ad-28076b2745ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-rtnqd\" (UID: \"3cb8bf21-ce2e-43e7-89ad-28076b2745ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:50.054101 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.054058 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf9lv" event={"ID":"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32","Type":"ContainerStarted","Data":"d04b1851832b18c5e7b162a2dcf6ace738b2b1bfb519b15a6f478850c3ff29a3"} Jul 28 13:47:50.117822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.117787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:50.118683 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.118653 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:50.181847 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.181823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" Jul 28 13:47:50.336856 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.336773 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:47:50.345185 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.345077 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd"] Jul 28 13:47:50.351740 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:50.351703 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb8bf21_ce2e_43e7_89ad_28076b2745ea.slice/crio-13d039b897840f8c5c77a446155e7811eaa6c05f6cbcd3f6c06873d2c0b7e9d1 WatchSource:0}: Error finding container 13d039b897840f8c5c77a446155e7811eaa6c05f6cbcd3f6c06873d2c0b7e9d1: Status 404 returned error can't find the container with id 13d039b897840f8c5c77a446155e7811eaa6c05f6cbcd3f6c06873d2c0b7e9d1 Jul 28 13:47:50.442509 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.442477 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69b9b899-p52bw"] Jul 28 13:47:50.449327 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.449308 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.456624 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.456753 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nzls5\"" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.456886 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.457000 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.457112 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.457165 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-84s350fvfk192\"" Jul 28 13:47:50.457557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.457397 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 13:47:50.464133 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.464032 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69b9b899-p52bw"] Jul 28 13:47:50.518254 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.518215 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:47:50.520407 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:50.520362 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeebc780_b7e7_494a_87a9_1911de05a540.slice/crio-53de3ccf5c6b22ba747b0030c411ce15d6fdc3eb59595f61141f178ea273ed4f WatchSource:0}: Error finding container 53de3ccf5c6b22ba747b0030c411ce15d6fdc3eb59595f61141f178ea273ed4f: Status 404 returned error can't find the container with id 53de3ccf5c6b22ba747b0030c411ce15d6fdc3eb59595f61141f178ea273ed4f Jul 28 13:47:50.522055 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.521971 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfvs\" (UniqueName: \"kubernetes.io/projected/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-kube-api-access-pzfvs\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522055 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522014 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-metrics-client-ca\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522055 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522051 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522270 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522192 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522270 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522231 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522270 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522256 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-tls\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522415 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522322 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-grpc-tls\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.522415 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.522358 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623641 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfvs\" (UniqueName: \"kubernetes.io/projected/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-kube-api-access-pzfvs\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623827 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623662 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-metrics-client-ca\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623827 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623697 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623827 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623733 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623979 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623979 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623907 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-tls\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.623979 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.623966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-grpc-tls\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.624114 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.624094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.624858 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.624706 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-metrics-client-ca\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.626835 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.626786 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.627106 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.627085 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.627474 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.627445 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.627580 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.627560 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-grpc-tls\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.627661 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.627619 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-tls\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.627661 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.627624 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.632282 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.632258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfvs\" (UniqueName: \"kubernetes.io/projected/6d6aeb9c-e1fc-4196-8c22-7cea90831f55-kube-api-access-pzfvs\") pod \"thanos-querier-69b9b899-p52bw\" (UID: \"6d6aeb9c-e1fc-4196-8c22-7cea90831f55\") " pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.781872 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.781773 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:50.917897 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:50.917867 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69b9b899-p52bw"] Jul 28 13:47:50.921250 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:50.921219 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6aeb9c_e1fc_4196_8c22_7cea90831f55.slice/crio-c4a07af53ebabdab667841341bce85d4c630475d81b3c56db9a294579f803ed6 WatchSource:0}: Error finding container c4a07af53ebabdab667841341bce85d4c630475d81b3c56db9a294579f803ed6: Status 404 returned error can't find the container with id c4a07af53ebabdab667841341bce85d4c630475d81b3c56db9a294579f803ed6 Jul 28 13:47:51.060934 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.060897 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" event={"ID":"4ede43a5-3528-49b9-aab6-81f5468aa71c","Type":"ContainerStarted","Data":"547e90879b88d429585ee056719377f7cab0c9e06ca3a579c68ad6667153a613"} Jul 28 13:47:51.061110 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.060968 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" event={"ID":"4ede43a5-3528-49b9-aab6-81f5468aa71c","Type":"ContainerStarted","Data":"ebf929e2b0a40f7856b38db1165562e046749d366aa9ce941d4d90ecfc763e22"} Jul 28 13:47:51.061110 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.061002 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" event={"ID":"4ede43a5-3528-49b9-aab6-81f5468aa71c","Type":"ContainerStarted","Data":"3fd07a2099c1bab6337d034d941d62f46afa9a4d8ea5420739d5ad6e25317c54"} Jul 28 13:47:51.062834 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.062808 2584 generic.go:356] "Generic (PLEG): container finished" podID="8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32" containerID="d04b1851832b18c5e7b162a2dcf6ace738b2b1bfb519b15a6f478850c3ff29a3" exitCode=0 Jul 28 13:47:51.063099 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.063075 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf9lv" event={"ID":"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32","Type":"ContainerDied","Data":"d04b1851832b18c5e7b162a2dcf6ace738b2b1bfb519b15a6f478850c3ff29a3"} Jul 28 13:47:51.065543 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.065514 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" event={"ID":"3cb8bf21-ce2e-43e7-89ad-28076b2745ea","Type":"ContainerStarted","Data":"5cb0fcf2f8117d88178693440497e3884fcaa1f7c8449de8da6c5f083a08cfb9"} Jul 28 13:47:51.065671 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.065575 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" event={"ID":"3cb8bf21-ce2e-43e7-89ad-28076b2745ea","Type":"ContainerStarted","Data":"7bff9811a9de6adbcceef57d1c9f9b8f5165ea39b5f9d436882f85b6566022c4"} Jul 28 13:47:51.065671 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.065629 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" event={"ID":"3cb8bf21-ce2e-43e7-89ad-28076b2745ea","Type":"ContainerStarted","Data":"13d039b897840f8c5c77a446155e7811eaa6c05f6cbcd3f6c06873d2c0b7e9d1"} Jul 28 13:47:51.067108 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.067028 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"c4a07af53ebabdab667841341bce85d4c630475d81b3c56db9a294579f803ed6"} Jul 28 13:47:51.069139 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.069113 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"53de3ccf5c6b22ba747b0030c411ce15d6fdc3eb59595f61141f178ea273ed4f"} Jul 28 13:47:51.082611 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.082543 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vmzs4" podStartSLOduration=1.833412722 podStartE2EDuration="3.082527511s" totalImagesPullingTime="1.249114789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:51.082160612 +0000 UTC m=+78.013020969" watchObservedRunningTime="2026-07-28 13:47:51.082527511 +0000 UTC m=+78.013387869" Jul 28 13:47:51.170445 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.170411 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-8r68l"] Jul 28 13:47:51.173780 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.173758 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:47:51.177116 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.176665 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 13:47:51.177116 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.176726 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 13:47:51.177116 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.176952 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7bfhd\"" Jul 28 13:47:51.185077 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.185006 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8r68l"] Jul 28 13:47:51.231284 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.231246 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4t97\" (UniqueName: \"kubernetes.io/projected/eb19aa02-8a52-4c6f-8682-1447ae80cadb-kube-api-access-v4t97\") pod \"downloads-7c97dc4555-8r68l\" (UID: \"eb19aa02-8a52-4c6f-8682-1447ae80cadb\") " pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:47:51.332891 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.332795 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4t97\" (UniqueName: \"kubernetes.io/projected/eb19aa02-8a52-4c6f-8682-1447ae80cadb-kube-api-access-v4t97\") pod \"downloads-7c97dc4555-8r68l\" (UID: \"eb19aa02-8a52-4c6f-8682-1447ae80cadb\") " pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:47:51.341743 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.341715 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4t97\" (UniqueName: \"kubernetes.io/projected/eb19aa02-8a52-4c6f-8682-1447ae80cadb-kube-api-access-v4t97\") pod \"downloads-7c97dc4555-8r68l\" (UID: \"eb19aa02-8a52-4c6f-8682-1447ae80cadb\") " pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:47:51.485959 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.485919 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:47:51.868715 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:51.868677 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8r68l"] Jul 28 13:47:51.872887 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:51.872806 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb19aa02_8a52_4c6f_8682_1447ae80cadb.slice/crio-b8b4a1e35d143c520adaeb588c2079c04004a3721a5482ffb05b3d96a16f32c1 WatchSource:0}: Error finding container b8b4a1e35d143c520adaeb588c2079c04004a3721a5482ffb05b3d96a16f32c1: Status 404 returned error can't find the container with id b8b4a1e35d143c520adaeb588c2079c04004a3721a5482ffb05b3d96a16f32c1 Jul 28 13:47:52.075271 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.075234 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9" exitCode=0 Jul 28 13:47:52.075477 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.075337 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9"} Jul 28 13:47:52.077949 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.077857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf9lv" event={"ID":"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32","Type":"ContainerStarted","Data":"5d8f7e2f8c1e77d26aabb0ce9818009dffade242a2bdb994ebdc4b8482b3ce59"} Jul 28 13:47:52.077949 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.077911 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf9lv" event={"ID":"8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32","Type":"ContainerStarted","Data":"c5ea964e8d8faf92b6a9d46c41bf546615d31a22988f2fda8bd986056f0535d4"} Jul 28 13:47:52.079960 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.079930 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8r68l" event={"ID":"eb19aa02-8a52-4c6f-8682-1447ae80cadb","Type":"ContainerStarted","Data":"b8b4a1e35d143c520adaeb588c2079c04004a3721a5482ffb05b3d96a16f32c1"} Jul 28 13:47:52.082069 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.082043 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" event={"ID":"3cb8bf21-ce2e-43e7-89ad-28076b2745ea","Type":"ContainerStarted","Data":"e51582650121ab8937facf3f740a2ef54f1f53758c886f09857c9e5f238f0317"} Jul 28 13:47:52.131517 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.131410 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sf9lv" podStartSLOduration=3.07646715 podStartE2EDuration="4.131388774s" totalImagesPullingTime="977.342024ms" totalInitContainerRuntime="77.5796ms" isStatefulPod=true podCreationTimestamp="2026-07-28 13:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:52.128618232 +0000 UTC m=+79.059478590" watchObservedRunningTime="2026-07-28 13:47:52.131388774 +0000 UTC m=+79.062249136" Jul 28 13:47:52.152433 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.152370 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-rtnqd" podStartSLOduration=2.976326618 podStartE2EDuration="4.152350029s" totalImagesPullingTime="1.176023411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:52.15107858 +0000 UTC m=+79.081938951" watchObservedRunningTime="2026-07-28 13:47:52.152350029 +0000 UTC m=+79.083210390" Jul 28 13:47:52.639179 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.639131 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj"] Jul 28 13:47:52.642843 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.642347 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.647422 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.647222 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9hg3vos2c1pv7\"" Jul 28 13:47:52.647422 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.647351 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 13:47:52.647669 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.647623 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-whh57\"" Jul 28 13:47:52.648261 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.648225 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 13:47:52.648503 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.648461 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 13:47:52.648737 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.648717 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 13:47:52.659442 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.659410 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj"] Jul 28 13:47:52.745927 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.745886 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-secret-metrics-server-client-certs\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.746105 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.745955 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7sx\" (UniqueName: \"kubernetes.io/projected/20562c78-cbff-454f-a07a-b30bf4113a32-kube-api-access-zl7sx\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.746105 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.746002 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20562c78-cbff-454f-a07a-b30bf4113a32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.746105 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.746029 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20562c78-cbff-454f-a07a-b30bf4113a32-metrics-server-audit-profiles\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.746105 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.746071 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20562c78-cbff-454f-a07a-b30bf4113a32-audit-log\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.746105 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.746093 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-secret-metrics-server-tls\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.746348 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.746130 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-client-ca-bundle\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.846791 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.846751 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20562c78-cbff-454f-a07a-b30bf4113a32-audit-log\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.846918 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.846801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-secret-metrics-server-tls\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.846918 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.846851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-client-ca-bundle\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.846918 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.846905 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-secret-metrics-server-client-certs\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.847092 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.846956 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7sx\" (UniqueName: \"kubernetes.io/projected/20562c78-cbff-454f-a07a-b30bf4113a32-kube-api-access-zl7sx\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.847092 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.846994 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20562c78-cbff-454f-a07a-b30bf4113a32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.847092 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.847016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20562c78-cbff-454f-a07a-b30bf4113a32-metrics-server-audit-profiles\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.847092 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.847076 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20562c78-cbff-454f-a07a-b30bf4113a32-audit-log\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.847914 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.847887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20562c78-cbff-454f-a07a-b30bf4113a32-metrics-server-audit-profiles\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.848247 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.848136 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20562c78-cbff-454f-a07a-b30bf4113a32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.849766 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.849740 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-secret-metrics-server-client-certs\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.849933 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.849913 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-secret-metrics-server-tls\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.850070 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.850051 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20562c78-cbff-454f-a07a-b30bf4113a32-client-ca-bundle\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.857108 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.857082 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7sx\" (UniqueName: \"kubernetes.io/projected/20562c78-cbff-454f-a07a-b30bf4113a32-kube-api-access-zl7sx\") pod \"metrics-server-6f7f67d9f9-lnxfj\" (UID: \"20562c78-cbff-454f-a07a-b30bf4113a32\") " pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:52.954577 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:52.954545 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:47:53.095108 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.093727 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf"] Jul 28 13:47:53.100715 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.100103 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.106373 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.105265 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 13:47:53.106373 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.105516 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-27qbv\"" Jul 28 13:47:53.108053 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.107940 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf"] Jul 28 13:47:53.111746 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.111656 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"f287c419945c481771af349a5b0b2c18d376a6c3d0a6b94a810c9ac64125db28"} Jul 28 13:47:53.116957 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.114317 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"7ebf053cd155dfef5d20786d7e17f6a59a21379d9cb7a550cc1a22c352e7e343"} Jul 28 13:47:53.152363 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.151764 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbfjz\" (UniqueName: \"kubernetes.io/projected/b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6-kube-api-access-gbfjz\") pod \"monitoring-plugin-68b7fc9574-dhmzf\" (UID: \"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.152363 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.151847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dhmzf\" (UID: \"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.164881 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.164843 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj"] Jul 28 13:47:53.169898 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:53.169868 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20562c78_cbff_454f_a07a_b30bf4113a32.slice/crio-ba0276d91d62f816d73308a47aa188467eece8723371080aac3975a719e5fa60 WatchSource:0}: Error finding container ba0276d91d62f816d73308a47aa188467eece8723371080aac3975a719e5fa60: Status 404 returned error can't find the container with id ba0276d91d62f816d73308a47aa188467eece8723371080aac3975a719e5fa60 Jul 28 13:47:53.254414 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.254126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbfjz\" (UniqueName: \"kubernetes.io/projected/b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6-kube-api-access-gbfjz\") pod \"monitoring-plugin-68b7fc9574-dhmzf\" (UID: \"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.254414 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.254339 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dhmzf\" (UID: \"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.258054 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.257978 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-dhmzf\" (UID: \"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.271618 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.271522 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbfjz\" (UniqueName: \"kubernetes.io/projected/b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6-kube-api-access-gbfjz\") pod \"monitoring-plugin-68b7fc9574-dhmzf\" (UID: \"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.421770 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.421682 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:53.607852 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:53.607764 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf"] Jul 28 13:47:53.615557 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:53.615519 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb938b9e5_12f2_4e11_84d4_bf2db9ba7cf6.slice/crio-b058e98b8e61fcdc16651a8e3ca79f06ee78c5e02154ffcb2aa81eb92385be37 WatchSource:0}: Error finding container b058e98b8e61fcdc16651a8e3ca79f06ee78c5e02154ffcb2aa81eb92385be37: Status 404 returned error can't find the container with id b058e98b8e61fcdc16651a8e3ca79f06ee78c5e02154ffcb2aa81eb92385be37 Jul 28 13:47:54.119824 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.119579 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" event={"ID":"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6","Type":"ContainerStarted","Data":"b058e98b8e61fcdc16651a8e3ca79f06ee78c5e02154ffcb2aa81eb92385be37"} Jul 28 13:47:54.121875 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.121768 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" event={"ID":"20562c78-cbff-454f-a07a-b30bf4113a32","Type":"ContainerStarted","Data":"ba0276d91d62f816d73308a47aa188467eece8723371080aac3975a719e5fa60"} Jul 28 13:47:54.124727 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.124688 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"75c52faf4fb9c2bff9164e01864939af8df90660235bf25a9f43f6729fb610c7"} Jul 28 13:47:54.711726 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.711077 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:47:54.715654 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.715620 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.719627 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.719521 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 13:47:54.721721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.720130 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 13:47:54.721721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.720394 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 13:47:54.721721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.720607 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 13:47:54.721721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.720961 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 13:47:54.721721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.721175 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f62j2\"" Jul 28 13:47:54.721721 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.721443 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.723775 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evl9aadjc8knq\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.724014 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.724212 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.724409 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.724756 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.724963 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.725132 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 13:47:54.727192 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.727036 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 13:47:54.731711 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.731661 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 13:47:54.736725 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.735882 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:47:54.768190 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768143 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768238 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768272 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768333 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768357 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768379 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768403 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768435 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768545 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmg98\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-kube-api-access-lmg98\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768786 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768814 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768859 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768888 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.768920 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.768916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870232 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870400 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870400 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870270 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870400 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870400 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870400 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870369 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870567 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870404 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870567 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870567 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870567 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870485 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870567 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870511 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870567 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870543 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870580 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmg98\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-kube-api-access-lmg98\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870664 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870684 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870719 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870748 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870774 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.870818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.870798 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.871866 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.871834 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.872448 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.872424 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.873939 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.873296 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.874056 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.873954 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.874230 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.874041 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.876087 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.874656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.876181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.876098 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.878147 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.878079 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.878489 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.878466 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.879533 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.879321 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.879533 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.879490 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.880997 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.880966 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.881167 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.881145 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.881456 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.881436 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.881518 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.881501 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.881518 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.881511 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.881802 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.881778 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.881964 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.881942 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.883564 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.883541 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:54.884942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:54.884920 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmg98\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-kube-api-access-lmg98\") pod \"prometheus-k8s-0\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:55.042270 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:55.042231 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:47:55.131918 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:55.131885 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96"} Jul 28 13:47:55.132332 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:55.131990 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78"} Jul 28 13:47:55.356743 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:55.356680 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:47:55.361429 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:47:55.361237 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64cbbde_50ab_4da6_9dfb_10469f8c7bf9.slice/crio-6b09d7b8e8951087a7f07ee9c4b6593cff65469a47918aea6f6fdfbf0a956e2e WatchSource:0}: Error finding container 6b09d7b8e8951087a7f07ee9c4b6593cff65469a47918aea6f6fdfbf0a956e2e: Status 404 returned error can't find the container with id 6b09d7b8e8951087a7f07ee9c4b6593cff65469a47918aea6f6fdfbf0a956e2e Jul 28 13:47:56.146340 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.146302 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" exitCode=0 Jul 28 13:47:56.147068 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.147038 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} Jul 28 13:47:56.147294 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.147275 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"6b09d7b8e8951087a7f07ee9c4b6593cff65469a47918aea6f6fdfbf0a956e2e"} Jul 28 13:47:56.149952 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.149917 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" event={"ID":"20562c78-cbff-454f-a07a-b30bf4113a32","Type":"ContainerStarted","Data":"5e19923bd7d8bd14560f6338a443b042c0dce2e4abe78451d0851faf22f3030a"} Jul 28 13:47:56.155695 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.155670 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"8766eec7cc952b2eb8a9520d0cbcf2b98c38e6fac95566019f4645b1ecbeea13"} Jul 28 13:47:56.155900 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.155882 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"434aa8cded92b1ad49d6a64715f58d1dfe72ae838d8e893fe2fd6d043054c4b2"} Jul 28 13:47:56.155981 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.155931 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" event={"ID":"6d6aeb9c-e1fc-4196-8c22-7cea90831f55","Type":"ContainerStarted","Data":"eb53ff04473434c516df5f65d4ece026b1bcd1fc3fd24c36b481dc301008fb22"} Jul 28 13:47:56.156221 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.156199 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:56.160921 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.160887 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b"} Jul 28 13:47:56.161055 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.160967 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a"} Jul 28 13:47:56.161055 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.161010 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38"} Jul 28 13:47:56.161055 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.161047 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerStarted","Data":"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c"} Jul 28 13:47:56.211797 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.211730 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.871584072 podStartE2EDuration="7.211709194s" totalImagesPullingTime="3.313345526s" totalInitContainerRuntime="26.779596ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:56.211220153 +0000 UTC m=+83.142080511" watchObservedRunningTime="2026-07-28 13:47:56.211709194 +0000 UTC m=+83.142569555" Jul 28 13:47:56.239780 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.239643 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" podStartSLOduration=2.286030115 podStartE2EDuration="6.239628909s" totalImagesPullingTime="3.953598794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:56.238956716 +0000 UTC m=+83.169817076" watchObservedRunningTime="2026-07-28 13:47:56.239628909 +0000 UTC m=+83.170489267" Jul 28 13:47:56.259130 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:56.259065 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" podStartSLOduration=2.262614346 podStartE2EDuration="4.259046988s" totalImagesPullingTime="1.996432642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:56.258482051 +0000 UTC m=+83.189342435" watchObservedRunningTime="2026-07-28 13:47:56.259046988 +0000 UTC m=+83.189907348" Jul 28 13:47:57.167959 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:57.167853 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" event={"ID":"b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6","Type":"ContainerStarted","Data":"d7d3b79f6c5eeb40b0a9d8786aef19f83bee774a8da04b1c4c4105841410b157"} Jul 28 13:47:57.168407 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:57.168343 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:57.174895 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:57.174866 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" Jul 28 13:47:57.175178 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:57.175160 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69b9b899-p52bw" Jul 28 13:47:57.186497 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:47:57.186445 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-dhmzf" podStartSLOduration=0.992773979 podStartE2EDuration="4.186427915s" totalImagesPullingTime="3.193653936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:57.184193923 +0000 UTC m=+84.115054273" watchObservedRunningTime="2026-07-28 13:47:57.186427915 +0000 UTC m=+84.117288274" Jul 28 13:48:01.197960 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.197734 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} Jul 28 13:48:01.197960 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.197856 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} Jul 28 13:48:01.197960 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.197883 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} Jul 28 13:48:01.197960 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.197905 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} Jul 28 13:48:01.198553 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.198532 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} Jul 28 13:48:01.198636 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.198578 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerStarted","Data":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} Jul 28 13:48:01.231130 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:01.230995 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.148182452 podStartE2EDuration="7.23097288s" totalImagesPullingTime="4.05653416s" totalInitContainerRuntime="26.256268ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:48:01.229165015 +0000 UTC m=+88.160025391" watchObservedRunningTime="2026-07-28 13:48:01.23097288 +0000 UTC m=+88.161833241" Jul 28 13:48:05.043442 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:05.043397 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:48:11.250034 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:11.249929 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8r68l" event={"ID":"eb19aa02-8a52-4c6f-8682-1447ae80cadb","Type":"ContainerStarted","Data":"fd7401d2b57e5056efb595dfc19f6d2b3654352f961b58947f60c6dbb5b71f9e"} Jul 28 13:48:11.250429 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:11.250037 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:48:11.251665 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:11.251639 2584 patch_prober.go:28] interesting pod/downloads-7c97dc4555-8r68l container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body= Jul 28 13:48:11.251767 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:11.251690 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-8r68l" podUID="eb19aa02-8a52-4c6f-8682-1447ae80cadb" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 13:48:11.272258 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:11.272204 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-8r68l" podStartSLOduration=1.250235991 podStartE2EDuration="20.272189379s" totalImagesPullingTime="19.021953388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:48:11.271748713 +0000 UTC m=+98.202609073" watchObservedRunningTime="2026-07-28 13:48:11.272189379 +0000 UTC m=+98.203049738" Jul 28 13:48:12.272388 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:12.272349 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-8r68l" Jul 28 13:48:12.955819 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:12.955779 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:48:12.956021 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:12.955853 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:48:15.032759 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:15.032728 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l9rb7" Jul 28 13:48:32.960897 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:32.960868 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:48:32.964675 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:32.964651 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f7f67d9f9-lnxfj" Jul 28 13:48:55.043494 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:55.043457 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:48:55.097016 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:55.096988 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:48:55.450880 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:48:55.450801 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:08.749775 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.749734 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:49:08.750321 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.750080 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy" containerID="cri-o://9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38" gracePeriod=120 Jul 28 13:49:08.750321 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.750128 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="config-reloader" containerID="cri-o://a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96" gracePeriod=120 Jul 28 13:49:08.750321 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.750178 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="alertmanager" containerID="cri-o://30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78" gracePeriod=120 Jul 28 13:49:08.750321 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.750081 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-web" containerID="cri-o://ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c" gracePeriod=120 Jul 28 13:49:08.750321 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.750136 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-metric" containerID="cri-o://141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a" gracePeriod=120 Jul 28 13:49:08.750321 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:08.750084 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="prom-label-proxy" containerID="cri-o://dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b" gracePeriod=120 Jul 28 13:49:09.496133 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496102 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b" exitCode=0 Jul 28 13:49:09.496133 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496127 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38" exitCode=0 Jul 28 13:49:09.496133 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496136 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96" exitCode=0 Jul 28 13:49:09.496133 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496146 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78" exitCode=0 Jul 28 13:49:09.496401 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496182 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b"} Jul 28 13:49:09.496401 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496252 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38"} Jul 28 13:49:09.496401 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496279 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96"} Jul 28 13:49:09.496401 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.496303 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78"} Jul 28 13:49:09.996656 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:09.996630 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.063425 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063386 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063631 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063452 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-main-db\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063631 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063486 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-metric\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063631 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063512 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-cluster-tls-config\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063631 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063555 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-main-tls\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063863 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063633 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-web-config\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063863 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063681 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmhbs\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-kube-api-access-dmhbs\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.063863 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063824 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:49:10.064021 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063862 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:10.064021 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063952 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-web\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.064021 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.063989 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.064169 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.064030 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-config-out\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.064169 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.064069 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-tls-assets\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.064169 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.064098 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-config-volume\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.064169 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.064137 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-metrics-client-ca\") pod \"eeebc780-b7e7-494a-87a9-1911de05a540\" (UID: \"eeebc780-b7e7-494a-87a9-1911de05a540\") " Jul 28 13:49:10.064623 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.064603 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.064799 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.064785 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-alertmanager-main-db\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.065255 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.065219 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:10.066709 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.066662 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.067339 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.067229 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.067435 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.067398 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:49:10.067506 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.067462 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-config-out" (OuterVolumeSpecName: "config-out") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:49:10.067820 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.067748 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-kube-api-access-dmhbs" (OuterVolumeSpecName: "kube-api-access-dmhbs") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "kube-api-access-dmhbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:49:10.069359 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.069327 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-config-volume" (OuterVolumeSpecName: "config-volume") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.069466 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.069361 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.069466 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.069438 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.071862 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.071835 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.079326 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.079295 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-web-config" (OuterVolumeSpecName: "web-config") pod "eeebc780-b7e7-494a-87a9-1911de05a540" (UID: "eeebc780-b7e7-494a-87a9-1911de05a540"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:10.166062 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166022 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmhbs\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-kube-api-access-dmhbs\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166062 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166053 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166062 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166064 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166062 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166074 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeebc780-b7e7-494a-87a9-1911de05a540-config-out\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166082 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeebc780-b7e7-494a-87a9-1911de05a540-tls-assets\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166090 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-config-volume\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166097 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeebc780-b7e7-494a-87a9-1911de05a540-metrics-client-ca\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166106 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166116 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-cluster-tls-config\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166124 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-secret-alertmanager-main-tls\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.166317 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.166132 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeebc780-b7e7-494a-87a9-1911de05a540-web-config\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:10.503924 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.503834 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a" exitCode=0 Jul 28 13:49:10.503924 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.503860 2584 generic.go:356] "Generic (PLEG): container finished" podID="eeebc780-b7e7-494a-87a9-1911de05a540" containerID="ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c" exitCode=0 Jul 28 13:49:10.503924 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.503888 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a"} Jul 28 13:49:10.503924 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.503913 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.504168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.503948 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c"} Jul 28 13:49:10.504168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.503977 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eeebc780-b7e7-494a-87a9-1911de05a540","Type":"ContainerDied","Data":"53de3ccf5c6b22ba747b0030c411ce15d6fdc3eb59595f61141f178ea273ed4f"} Jul 28 13:49:10.504168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.504008 2584 scope.go:117] "RemoveContainer" containerID="dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b" Jul 28 13:49:10.513356 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.513336 2584 scope.go:117] "RemoveContainer" containerID="141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a" Jul 28 13:49:10.521248 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.521229 2584 scope.go:117] "RemoveContainer" containerID="9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38" Jul 28 13:49:10.528818 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.528781 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:49:10.530144 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.530127 2584 scope.go:117] "RemoveContainer" containerID="ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c" Jul 28 13:49:10.533518 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.533493 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:49:10.538203 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.538184 2584 scope.go:117] "RemoveContainer" containerID="a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96" Jul 28 13:49:10.546502 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.546483 2584 scope.go:117] "RemoveContainer" containerID="30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78" Jul 28 13:49:10.554542 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.554517 2584 scope.go:117] "RemoveContainer" containerID="07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9" Jul 28 13:49:10.562635 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.562607 2584 scope.go:117] "RemoveContainer" containerID="dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b" Jul 28 13:49:10.563037 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.563005 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b\": container with ID starting with dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b not found: ID does not exist" containerID="dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b" Jul 28 13:49:10.563037 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.563052 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b"} err="failed to get container status \"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b\": rpc error: code = NotFound desc = could not find container \"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b\": container with ID starting with dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b not found: ID does not exist" Jul 28 13:49:10.563037 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.563148 2584 scope.go:117] "RemoveContainer" containerID="141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a" Jul 28 13:49:10.563692 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.563654 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a\": container with ID starting with 141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a not found: ID does not exist" containerID="141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a" Jul 28 13:49:10.563805 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.563689 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a"} err="failed to get container status \"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a\": rpc error: code = NotFound desc = could not find container \"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a\": container with ID starting with 141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a not found: ID does not exist" Jul 28 13:49:10.563805 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.563712 2584 scope.go:117] "RemoveContainer" containerID="9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38" Jul 28 13:49:10.564071 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.564046 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38\": container with ID starting with 9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38 not found: ID does not exist" containerID="9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38" Jul 28 13:49:10.564164 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.564076 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38"} err="failed to get container status \"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38\": rpc error: code = NotFound desc = could not find container \"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38\": container with ID starting with 9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38 not found: ID does not exist" Jul 28 13:49:10.564164 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.564096 2584 scope.go:117] "RemoveContainer" containerID="ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c" Jul 28 13:49:10.564351 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.564321 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c\": container with ID starting with ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c not found: ID does not exist" containerID="ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c" Jul 28 13:49:10.564351 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.564351 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c"} err="failed to get container status \"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c\": rpc error: code = NotFound desc = could not find container \"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c\": container with ID starting with ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c not found: ID does not exist" Jul 28 13:49:10.564483 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.564369 2584 scope.go:117] "RemoveContainer" containerID="a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96" Jul 28 13:49:10.564665 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.564644 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96\": container with ID starting with a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96 not found: ID does not exist" containerID="a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96" Jul 28 13:49:10.564767 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.564672 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96"} err="failed to get container status \"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96\": rpc error: code = NotFound desc = could not find container \"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96\": container with ID starting with a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96 not found: ID does not exist" Jul 28 13:49:10.564767 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.564690 2584 scope.go:117] "RemoveContainer" containerID="30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78" Jul 28 13:49:10.565018 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.564993 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78\": container with ID starting with 30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78 not found: ID does not exist" containerID="30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78" Jul 28 13:49:10.565116 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565029 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78"} err="failed to get container status \"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78\": rpc error: code = NotFound desc = could not find container \"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78\": container with ID starting with 30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78 not found: ID does not exist" Jul 28 13:49:10.565116 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565049 2584 scope.go:117] "RemoveContainer" containerID="07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9" Jul 28 13:49:10.565207 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565185 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:49:10.565446 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:10.565384 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9\": container with ID starting with 07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9 not found: ID does not exist" containerID="07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9" Jul 28 13:49:10.565446 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565415 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9"} err="failed to get container status \"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9\": rpc error: code = NotFound desc = could not find container \"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9\": container with ID starting with 07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9 not found: ID does not exist" Jul 28 13:49:10.565446 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565433 2584 scope.go:117] "RemoveContainer" containerID="dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565601 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-metric" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565618 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-metric" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565637 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="init-config-reloader" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565644 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="init-config-reloader" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565655 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565664 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565675 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="alertmanager" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565680 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="alertmanager" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565700 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="config-reloader" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565706 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="config-reloader" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565711 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-web" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565716 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-web" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565722 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="prom-label-proxy" Jul 28 13:49:10.565718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565727 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="prom-label-proxy" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565741 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b"} err="failed to get container status \"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b\": rpc error: code = NotFound desc = could not find container \"dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b\": container with ID starting with dbcb18ce7847342ab0757a8d80117b8412c40aaeba33f1a89bbd01f5b4a2b83b not found: ID does not exist" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565763 2584 scope.go:117] "RemoveContainer" containerID="141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565774 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="prom-label-proxy" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565783 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="alertmanager" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565791 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-web" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565797 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy-metric" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565802 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="kube-rbac-proxy" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.565809 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" containerName="config-reloader" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566033 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a"} err="failed to get container status \"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a\": rpc error: code = NotFound desc = could not find container \"141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a\": container with ID starting with 141e3b8c532da757523e5f256c97de8a1bf8559a6ae4ec71a4d24cfe3e5d630a not found: ID does not exist" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566053 2584 scope.go:117] "RemoveContainer" containerID="9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566294 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38"} err="failed to get container status \"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38\": rpc error: code = NotFound desc = could not find container \"9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38\": container with ID starting with 9f018e52345242c8aedb1fcab7d76bdfa72855e71f74cc60924c017c3ff93e38 not found: ID does not exist" Jul 28 13:49:10.566325 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566317 2584 scope.go:117] "RemoveContainer" containerID="ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c" Jul 28 13:49:10.566795 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566524 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c"} err="failed to get container status \"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c\": rpc error: code = NotFound desc = could not find container \"ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c\": container with ID starting with ae365f43b54902b45dc5ba66b22f0d520ea262bebcd7d7199998216585c6572c not found: ID does not exist" Jul 28 13:49:10.566795 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566541 2584 scope.go:117] "RemoveContainer" containerID="a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96" Jul 28 13:49:10.566795 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566757 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96"} err="failed to get container status \"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96\": rpc error: code = NotFound desc = could not find container \"a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96\": container with ID starting with a3c93974b8be8e0ee3e05b825050592d839eb02ae9c09aacc1a4527c099eeb96 not found: ID does not exist" Jul 28 13:49:10.566795 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566773 2584 scope.go:117] "RemoveContainer" containerID="30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78" Jul 28 13:49:10.567010 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.566994 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78"} err="failed to get container status \"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78\": rpc error: code = NotFound desc = could not find container \"30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78\": container with ID starting with 30fb75b81af0affc86c1db376b2fb168a71ab4e2317a1b882a6451508cd27a78 not found: ID does not exist" Jul 28 13:49:10.567058 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.567012 2584 scope.go:117] "RemoveContainer" containerID="07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9" Jul 28 13:49:10.567179 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.567157 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9"} err="failed to get container status \"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9\": rpc error: code = NotFound desc = could not find container \"07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9\": container with ID starting with 07d8baa705869f4914fce735c2c0a32ace7603120b51ed870adfcc98f8539cf9 not found: ID does not exist" Jul 28 13:49:10.569387 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.569369 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.572328 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572303 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 13:49:10.572464 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572331 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 13:49:10.572464 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572352 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 13:49:10.572464 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572363 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w8f7f\"" Jul 28 13:49:10.572464 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572448 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 13:49:10.572687 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572304 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 13:49:10.572784 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572769 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 13:49:10.572847 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572817 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 13:49:10.572847 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.572830 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 13:49:10.577686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.577666 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 13:49:10.587528 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.587499 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:49:10.670499 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670462 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670711 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670506 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670711 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670536 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670711 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670637 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670711 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670666 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-web-config\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670711 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670685 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670715 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-config-out\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670786 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670821 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4fms\" (UniqueName: \"kubernetes.io/projected/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-kube-api-access-p4fms\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670850 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.670954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.671157 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.670979 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.671157 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.671020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772081 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772000 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772081 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772036 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772081 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772081 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772076 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772099 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-web-config\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772149 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-config-out\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772241 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4fms\" (UniqueName: \"kubernetes.io/projected/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-kube-api-access-p4fms\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772262 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.772366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.772351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.773631 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.773579 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.775261 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.775232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-config-out\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.775376 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.775262 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.775376 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.775305 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.775493 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.775425 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.775964 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.775937 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-web-config\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.776072 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.776060 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.776224 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.776205 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.776365 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.776312 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.776365 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.776341 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.776491 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.776468 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.781177 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.778293 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.784353 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.784330 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4fms\" (UniqueName: \"kubernetes.io/projected/1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c-kube-api-access-p4fms\") pod \"alertmanager-main-0\" (UID: \"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:10.879305 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:10.879263 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 13:49:11.031930 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:11.031902 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 13:49:11.033489 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:49:11.033454 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbcb9e5_8bd0_4756_bd94_f7b5f183ec8c.slice/crio-4ad78d1b4804b91518d1763f6613f305d0648a2241a6fd82519ca91b6ca7287d WatchSource:0}: Error finding container 4ad78d1b4804b91518d1763f6613f305d0648a2241a6fd82519ca91b6ca7287d: Status 404 returned error can't find the container with id 4ad78d1b4804b91518d1763f6613f305d0648a2241a6fd82519ca91b6ca7287d Jul 28 13:49:11.510171 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:11.510131 2584 generic.go:356] "Generic (PLEG): container finished" podID="1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c" containerID="9ecb7bd975b2dd6091efe2b9af745604d1da0a9c488fde7bfb934e2585434ed3" exitCode=0 Jul 28 13:49:11.510354 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:11.510187 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerDied","Data":"9ecb7bd975b2dd6091efe2b9af745604d1da0a9c488fde7bfb934e2585434ed3"} Jul 28 13:49:11.510354 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:11.510252 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"4ad78d1b4804b91518d1763f6613f305d0648a2241a6fd82519ca91b6ca7287d"} Jul 28 13:49:11.709273 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:11.709238 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeebc780-b7e7-494a-87a9-1911de05a540" path="/var/lib/kubelet/pods/eeebc780-b7e7-494a-87a9-1911de05a540/volumes" Jul 28 13:49:12.517555 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.517519 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"d1438e004dd35ce202a8245dde144d1c6a2f55c7ff32e7d8120926d13d5f8efe"} Jul 28 13:49:12.517942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.517607 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"13055ed03e1afb7cfac00a0ffc5a32f4b5d8073a3b477ae53fc44c76c502aad2"} Jul 28 13:49:12.517942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.517633 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"7ca53f006bbef0a9dfdb74592c1cf3539ac087a41309be3720babe2a46539b72"} Jul 28 13:49:12.517942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.517665 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"eb5925c1494eed2f3f45f2046d7e0dca8cd062ed85279bab523f43f04b856b31"} Jul 28 13:49:12.517942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.517688 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"4f6a9198bb78d37686ea0c0391537930f6caf33eb64a72056dc7c00f70d19735"} Jul 28 13:49:12.517942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.517720 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c","Type":"ContainerStarted","Data":"38b476be33b07bfc952227a186640c6d3c9dd316b97777dc1a672add01385ae0"} Jul 28 13:49:12.555955 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:12.555892 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.537815611 podStartE2EDuration="2.555873736s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.058125ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:49:12.55513332 +0000 UTC m=+159.485993678" watchObservedRunningTime="2026-07-28 13:49:12.555873736 +0000 UTC m=+159.486734094" Jul 28 13:49:13.126474 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126434 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:49:13.126834 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126803 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="prometheus" containerID="cri-o://8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" gracePeriod=600 Jul 28 13:49:13.126948 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126835 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy" containerID="cri-o://8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" gracePeriod=600 Jul 28 13:49:13.126948 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126863 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="thanos-sidecar" containerID="cri-o://dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" gracePeriod=600 Jul 28 13:49:13.126948 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126881 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-web" containerID="cri-o://f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" gracePeriod=600 Jul 28 13:49:13.126948 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126924 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" gracePeriod=600 Jul 28 13:49:13.127125 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.126884 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="config-reloader" containerID="cri-o://8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" gracePeriod=600 Jul 28 13:49:13.385643 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.385541 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.494432 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494397 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494442 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-metrics-client-certs\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494461 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-0\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494482 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-1\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494523 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-db\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494547 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494569 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-metrics-client-ca\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.494647 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494636 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config-out\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494662 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-kubelet-serving-ca-bundle\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494689 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-kube-rbac-proxy\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494722 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-tls\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494754 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494780 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-2\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494813 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-grpc-tls\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494867 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-web-config\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494888 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494912 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-trusted-ca-bundle\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.494977 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-tls-assets\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495007 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-serving-certs-ca-bundle\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495037 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-thanos-prometheus-http-client-file\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495073 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmg98\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-kube-api-access-lmg98\") pod \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\" (UID: \"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9\") " Jul 28 13:49:13.495525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495188 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.495525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495374 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.495525 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495390 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.495789 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495530 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:49:13.495789 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495701 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.495789 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495705 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.495947 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.495896 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.497476 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.497427 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.497661 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.497566 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.498722 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.498399 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.498722 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.498435 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config" (OuterVolumeSpecName: "config") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.498722 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.498469 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.498722 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.498685 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.499009 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.498871 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.499009 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.498910 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:13.499292 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.499257 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:49:13.499807 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.499786 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-kube-api-access-lmg98" (OuterVolumeSpecName: "kube-api-access-lmg98") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "kube-api-access-lmg98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:49:13.499894 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.499875 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.500397 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.500366 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.500829 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.500807 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config-out" (OuterVolumeSpecName: "config-out") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:49:13.511010 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.510979 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-web-config" (OuterVolumeSpecName: "web-config") pod "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" (UID: "f64cbbde-50ab-4da6-9dfb-10469f8c7bf9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:13.525392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525362 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" exitCode=0 Jul 28 13:49:13.525392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525384 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" exitCode=0 Jul 28 13:49:13.525392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525390 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" exitCode=0 Jul 28 13:49:13.525392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525396 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" exitCode=0 Jul 28 13:49:13.525392 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525401 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" exitCode=0 Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525406 2584 generic.go:356] "Generic (PLEG): container finished" podID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" exitCode=0 Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525439 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525439 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525538 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525570 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525623 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525659 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525697 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} Jul 28 13:49:13.526052 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.525734 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f64cbbde-50ab-4da6-9dfb-10469f8c7bf9","Type":"ContainerDied","Data":"6b09d7b8e8951087a7f07ee9c4b6593cff65469a47918aea6f6fdfbf0a956e2e"} Jul 28 13:49:13.536944 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.536919 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.547347 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.547325 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.550751 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.550728 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:49:13.555206 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.555181 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:49:13.556540 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.556522 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.564247 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.564228 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.571675 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.571651 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.579741 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.579719 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.587185 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.587163 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.587514 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.587493 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.587614 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.587525 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} err="failed to get container status \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" Jul 28 13:49:13.587614 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.587547 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.587891 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.587857 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.588004 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.587924 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} err="failed to get container status \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" Jul 28 13:49:13.588004 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.587945 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.588448 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.588427 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.588617 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.588551 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} err="failed to get container status \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" Jul 28 13:49:13.588617 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.588608 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.588963 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.588943 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.589047 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.588967 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} err="failed to get container status \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" Jul 28 13:49:13.589047 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.588982 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.589236 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.589222 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.589283 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.589239 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} err="failed to get container status \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" Jul 28 13:49:13.589283 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.589251 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.589453 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.589438 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.589498 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.589455 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} err="failed to get container status \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" Jul 28 13:49:13.589498 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.589476 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.589779 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:49:13.589762 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.589848 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.589782 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} err="failed to get container status \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" Jul 28 13:49:13.589848 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.589795 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.590026 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590009 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} err="failed to get container status \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" Jul 28 13:49:13.590065 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590028 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.590225 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590204 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:49:13.590300 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590244 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} err="failed to get container status \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" Jul 28 13:49:13.590300 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590264 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.590504 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590487 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} err="failed to get container status \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" Jul 28 13:49:13.590555 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590506 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.590555 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590551 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="thanos-sidecar" Jul 28 13:49:13.590648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590565 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="thanos-sidecar" Jul 28 13:49:13.590648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590581 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="init-config-reloader" Jul 28 13:49:13.590648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590613 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="init-config-reloader" Jul 28 13:49:13.590648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590623 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="config-reloader" Jul 28 13:49:13.590648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590632 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="config-reloader" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590650 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-thanos" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590656 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-thanos" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590667 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="prometheus" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590672 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="prometheus" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590685 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590691 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590698 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-web" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590704 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-web" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590748 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} err="failed to get container status \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590776 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.590809 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590758 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="prometheus" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590822 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="config-reloader" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590829 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590840 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-web" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590845 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="kube-rbac-proxy-thanos" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590853 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" containerName="thanos-sidecar" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.590999 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} err="failed to get container status \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" Jul 28 13:49:13.591181 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591017 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.591403 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591205 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} err="failed to get container status \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" Jul 28 13:49:13.591403 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591220 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.591469 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591434 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} err="failed to get container status \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" Jul 28 13:49:13.591469 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591452 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.591741 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591724 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} err="failed to get container status \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" Jul 28 13:49:13.591800 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591742 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.591955 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591937 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} err="failed to get container status \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" Jul 28 13:49:13.592011 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.591957 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.592199 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592184 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} err="failed to get container status \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" Jul 28 13:49:13.592263 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592200 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.592431 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592414 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} err="failed to get container status \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" Jul 28 13:49:13.592478 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592431 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.592662 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592644 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} err="failed to get container status \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" Jul 28 13:49:13.592745 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592664 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.592891 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592872 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} err="failed to get container status \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" Jul 28 13:49:13.592980 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.592924 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.593393 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.593365 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} err="failed to get container status \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" Jul 28 13:49:13.593509 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.593394 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.593747 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.593721 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} err="failed to get container status \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" Jul 28 13:49:13.593833 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.593748 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.594047 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594027 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} err="failed to get container status \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" Jul 28 13:49:13.594106 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594048 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.594230 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594210 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} err="failed to get container status \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" Jul 28 13:49:13.594274 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594231 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.594447 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594428 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} err="failed to get container status \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" Jul 28 13:49:13.594502 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594450 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.594728 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594713 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} err="failed to get container status \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" Jul 28 13:49:13.594791 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594729 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.594964 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594943 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} err="failed to get container status \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" Jul 28 13:49:13.595013 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.594965 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.595042 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.595026 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.595262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.595236 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} err="failed to get container status \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" Jul 28 13:49:13.595262 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.595263 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.595720 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.595694 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} err="failed to get container status \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" Jul 28 13:49:13.595788 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.595723 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.596038 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596009 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} err="failed to get container status \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" Jul 28 13:49:13.596038 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596039 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596218 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596244 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596260 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596273 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-grpc-tls\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596279 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} err="failed to get container status \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596298 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-web-config\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596305 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596316 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-tls-assets\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596330 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596345 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596361 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmg98\" (UniqueName: \"kubernetes.io/projected/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-kube-api-access-lmg98\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596376 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596391 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-metrics-client-certs\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596405 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596420 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-prometheus-k8s-db\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596433 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596446 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-metrics-client-ca\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596459 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-config-out\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596471 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596479 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9-secret-kube-rbac-proxy\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596718 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} err="failed to get container status \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" Jul 28 13:49:13.596853 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596737 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.597186 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596971 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} err="failed to get container status \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" Jul 28 13:49:13.597186 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.596986 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.597186 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597178 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} err="failed to get container status \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" Jul 28 13:49:13.597283 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597192 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.597389 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597372 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} err="failed to get container status \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" Jul 28 13:49:13.597451 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597393 2584 scope.go:117] "RemoveContainer" containerID="a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298" Jul 28 13:49:13.597679 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597653 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298"} err="failed to get container status \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": rpc error: code = NotFound desc = could not find container \"a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298\": container with ID starting with a2802c15ec09ebc409a2dd6ffb665c39b213bfbdf2081de5f33002190fd7d298 not found: ID does not exist" Jul 28 13:49:13.597679 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597672 2584 scope.go:117] "RemoveContainer" containerID="8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e" Jul 28 13:49:13.597926 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597897 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e"} err="failed to get container status \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": rpc error: code = NotFound desc = could not find container \"8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e\": container with ID starting with 8a459867f811008bd8623e526be16c8d6f051219e71ed1998f1e218f463eda2e not found: ID does not exist" Jul 28 13:49:13.598028 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.597927 2584 scope.go:117] "RemoveContainer" containerID="f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b" Jul 28 13:49:13.598090 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598046 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 13:49:13.598163 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598145 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b"} err="failed to get container status \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": rpc error: code = NotFound desc = could not find container \"f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b\": container with ID starting with f722a0b6c57d6dbf1d9bd1c5977c839ddfa138025e1e00324901afe0d783595b not found: ID does not exist" Jul 28 13:49:13.598225 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598162 2584 scope.go:117] "RemoveContainer" containerID="dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5" Jul 28 13:49:13.598327 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598312 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 13:49:13.598383 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598369 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5"} err="failed to get container status \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": rpc error: code = NotFound desc = could not find container \"dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5\": container with ID starting with dad5581d6cb8e0a6799538b1ed3625351dbf73f2b09a540b7daf1f1d0d5eaff5 not found: ID does not exist" Jul 28 13:49:13.598447 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598385 2584 scope.go:117] "RemoveContainer" containerID="8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7" Jul 28 13:49:13.598640 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598623 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7"} err="failed to get container status \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": rpc error: code = NotFound desc = could not find container \"8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7\": container with ID starting with 8e3f591278339ff894e94de07c4ec3341fa48008c0684050718e05e16166b6f7 not found: ID does not exist" Jul 28 13:49:13.598640 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598639 2584 scope.go:117] "RemoveContainer" containerID="8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e" Jul 28 13:49:13.598873 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598848 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e"} err="failed to get container status \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": rpc error: code = NotFound desc = could not find container \"8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e\": container with ID starting with 8be8a224c324376cf1797162dd55b61bb9c127a5f5b0f06b5f31236aa18ab51e not found: ID does not exist" Jul 28 13:49:13.598873 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.598873 2584 scope.go:117] "RemoveContainer" containerID="d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3" Jul 28 13:49:13.599104 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.599083 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3"} err="failed to get container status \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": rpc error: code = NotFound desc = could not find container \"d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3\": container with ID starting with d886715a97ad33ced94607810d5642fa66aa3b63416f6ee48822a9340ff73bc3 not found: ID does not exist" Jul 28 13:49:13.600429 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.600415 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 13:49:13.600799 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.600774 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 13:49:13.600799 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.600793 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 13:49:13.600939 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.600887 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 13:49:13.601008 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.600994 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 13:49:13.601094 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.601029 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evl9aadjc8knq\"" Jul 28 13:49:13.601220 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.601166 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f62j2\"" Jul 28 13:49:13.601524 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.601368 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 13:49:13.601524 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.601344 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 13:49:13.601524 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.601440 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 13:49:13.601524 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.601491 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 13:49:13.602045 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.602030 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 13:49:13.607006 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.606986 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 13:49:13.608267 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.608250 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 13:49:13.617453 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.617424 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:49:13.697718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697618 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697670 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697718 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697695 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqdj\" (UniqueName: \"kubernetes.io/projected/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-kube-api-access-7qqdj\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697720 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697741 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697825 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697875 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697940 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.697992 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.697969 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698006 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698059 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698117 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698138 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698188 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-config\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698212 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.698278 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.698275 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.707443 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.707416 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64cbbde-50ab-4da6-9dfb-10469f8c7bf9" path="/var/lib/kubelet/pods/f64cbbde-50ab-4da6-9dfb-10469f8c7bf9/volumes" Jul 28 13:49:13.798806 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.798772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.798806 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.798809 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.798993 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.798834 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-config\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.798993 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.798856 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.798993 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.798876 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.798993 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.798908 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799191 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799026 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799191 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799053 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799191 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqdj\" (UniqueName: \"kubernetes.io/projected/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-kube-api-access-7qqdj\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799191 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799156 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799191 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799187 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799224 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799280 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799372 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799423 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799835 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799428 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799835 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799835 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799490 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.799971 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.799867 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.801523 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.800726 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.801523 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.800883 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.802665 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.802328 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.802665 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.802465 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.802665 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.802633 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.802896 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.802767 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.804410 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.804489 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.804766 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.805065 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.805071 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.805146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.805273 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.805451 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-config\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.807686 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.805619 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.810413 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.810388 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.810533 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.810469 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqdj\" (UniqueName: \"kubernetes.io/projected/d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f-kube-api-access-7qqdj\") pod \"prometheus-k8s-0\" (UID: \"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:13.905733 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:13.905689 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:49:14.053760 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:14.053732 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 13:49:14.055008 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:49:14.054985 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a6b0b1_213b_4e4a_bf14_fe7130c7ed7f.slice/crio-c7cc01f5faaecfce2f4aaeae8508dc11ab929b361ba8d7c595b8eb72053af881 WatchSource:0}: Error finding container c7cc01f5faaecfce2f4aaeae8508dc11ab929b361ba8d7c595b8eb72053af881: Status 404 returned error can't find the container with id c7cc01f5faaecfce2f4aaeae8508dc11ab929b361ba8d7c595b8eb72053af881 Jul 28 13:49:14.532529 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:14.532498 2584 generic.go:356] "Generic (PLEG): container finished" podID="d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f" containerID="9a53df4246c55916ecff15a0fe2eef34ddcf5d3a7a6a3c93c9bf186112c59f6a" exitCode=0 Jul 28 13:49:14.532954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:14.532557 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerDied","Data":"9a53df4246c55916ecff15a0fe2eef34ddcf5d3a7a6a3c93c9bf186112c59f6a"} Jul 28 13:49:14.532954 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:14.532622 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"c7cc01f5faaecfce2f4aaeae8508dc11ab929b361ba8d7c595b8eb72053af881"} Jul 28 13:49:15.539782 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.539744 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"acc4cb87a8556a0f1ec1a41a37840817500b156098fe2a37f0843e55644f470c"} Jul 28 13:49:15.540168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.539814 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"d12921d96d7d3195def10da2833c547eaa98f1f93e1b24f0b3af85baedccb7c3"} Jul 28 13:49:15.540168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.539855 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"9bae4b6c6d4581dc9eca20d86eaec77d72d496fb5b8f6878ebf59cd026e3407b"} Jul 28 13:49:15.540168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.539883 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"726215a15a5937eb03927ce126057477caed4e7558b04f98db757f14de9d6b42"} Jul 28 13:49:15.540168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.539906 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"f8d40bf7106249205e964f745242387233bfe2111b0772ac1bc5d171bbb87a15"} Jul 28 13:49:15.540168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.539946 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f","Type":"ContainerStarted","Data":"44a6d5c79c7d31356bef0c311df12e10cd538f48b3b1112d323e36ee8af5c9f6"} Jul 28 13:49:15.572032 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:15.571973 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.551970593 podStartE2EDuration="2.571954879s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.984286ms" isStatefulPod=false podCreationTimestamp="2026-07-28 13:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:49:15.569304393 +0000 UTC m=+162.500164809" watchObservedRunningTime="2026-07-28 13:49:15.571954879 +0000 UTC m=+162.502815238" Jul 28 13:49:18.905998 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:49:18.905953 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:50:13.906835 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:50:13.906796 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:50:13.923085 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:50:13.923060 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:50:14.792623 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:50:14.792570 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 13:51:33.554119 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:33.554089 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 13:51:47.639995 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.639952 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7mdhl"] Jul 28 13:51:47.642041 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.642024 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.645687 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.645664 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 13:51:47.645831 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.645732 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 13:51:47.646664 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.646645 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mqr4p\"" Jul 28 13:51:47.651627 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.651573 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7mdhl"] Jul 28 13:51:47.754382 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.754343 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d68771-97e7-49ad-8510-38668c12c409-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7mdhl\" (UID: \"c5d68771-97e7-49ad-8510-38668c12c409\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.754560 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.754448 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjf5h\" (UniqueName: \"kubernetes.io/projected/c5d68771-97e7-49ad-8510-38668c12c409-kube-api-access-fjf5h\") pod \"cert-manager-webhook-6486ffd997-7mdhl\" (UID: \"c5d68771-97e7-49ad-8510-38668c12c409\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.855636 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.855554 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d68771-97e7-49ad-8510-38668c12c409-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7mdhl\" (UID: \"c5d68771-97e7-49ad-8510-38668c12c409\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.856194 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.856161 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjf5h\" (UniqueName: \"kubernetes.io/projected/c5d68771-97e7-49ad-8510-38668c12c409-kube-api-access-fjf5h\") pod \"cert-manager-webhook-6486ffd997-7mdhl\" (UID: \"c5d68771-97e7-49ad-8510-38668c12c409\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.868028 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.867985 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d68771-97e7-49ad-8510-38668c12c409-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7mdhl\" (UID: \"c5d68771-97e7-49ad-8510-38668c12c409\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.868723 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.868701 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjf5h\" (UniqueName: \"kubernetes.io/projected/c5d68771-97e7-49ad-8510-38668c12c409-kube-api-access-fjf5h\") pod \"cert-manager-webhook-6486ffd997-7mdhl\" (UID: \"c5d68771-97e7-49ad-8510-38668c12c409\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:47.961327 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:47.961228 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:48.104243 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:48.104206 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7mdhl"] Jul 28 13:51:48.107651 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:51:48.107617 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5d68771_97e7_49ad_8510_38668c12c409.slice/crio-3cd9e25fc431e9dc4d40b9b8e2945be39f5cd3b014dc107032e7cea715ddf438 WatchSource:0}: Error finding container 3cd9e25fc431e9dc4d40b9b8e2945be39f5cd3b014dc107032e7cea715ddf438: Status 404 returned error can't find the container with id 3cd9e25fc431e9dc4d40b9b8e2945be39f5cd3b014dc107032e7cea715ddf438 Jul 28 13:51:48.109643 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:48.109625 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:51:48.143964 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:48.143925 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" event={"ID":"c5d68771-97e7-49ad-8510-38668c12c409","Type":"ContainerStarted","Data":"3cd9e25fc431e9dc4d40b9b8e2945be39f5cd3b014dc107032e7cea715ddf438"} Jul 28 13:51:49.722056 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.721998 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s2djh"] Jul 28 13:51:49.727979 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.727858 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:49.731001 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.730964 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xxcdq\"" Jul 28 13:51:49.740449 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.740411 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s2djh"] Jul 28 13:51:49.876564 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.876523 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fe3b643-8354-4848-8c52-322137bf32c5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s2djh\" (UID: \"2fe3b643-8354-4848-8c52-322137bf32c5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:49.876768 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.876694 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk6qq\" (UniqueName: \"kubernetes.io/projected/2fe3b643-8354-4848-8c52-322137bf32c5-kube-api-access-tk6qq\") pod \"cert-manager-cainjector-559cdd8c87-s2djh\" (UID: \"2fe3b643-8354-4848-8c52-322137bf32c5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:49.977897 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.977810 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6qq\" (UniqueName: \"kubernetes.io/projected/2fe3b643-8354-4848-8c52-322137bf32c5-kube-api-access-tk6qq\") pod \"cert-manager-cainjector-559cdd8c87-s2djh\" (UID: \"2fe3b643-8354-4848-8c52-322137bf32c5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:49.978057 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.977899 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fe3b643-8354-4848-8c52-322137bf32c5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s2djh\" (UID: \"2fe3b643-8354-4848-8c52-322137bf32c5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:49.987434 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.987368 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fe3b643-8354-4848-8c52-322137bf32c5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s2djh\" (UID: \"2fe3b643-8354-4848-8c52-322137bf32c5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:49.987629 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:49.987491 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk6qq\" (UniqueName: \"kubernetes.io/projected/2fe3b643-8354-4848-8c52-322137bf32c5-kube-api-access-tk6qq\") pod \"cert-manager-cainjector-559cdd8c87-s2djh\" (UID: \"2fe3b643-8354-4848-8c52-322137bf32c5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:50.043648 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:50.043610 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" Jul 28 13:51:51.357612 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:51.357544 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s2djh"] Jul 28 13:51:51.360707 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:51:51.360674 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fe3b643_8354_4848_8c52_322137bf32c5.slice/crio-e3442f8fdadd3a4650e514b0cfc072bdb8aebcda34ab7e1df37bd0ebd200e0eb WatchSource:0}: Error finding container e3442f8fdadd3a4650e514b0cfc072bdb8aebcda34ab7e1df37bd0ebd200e0eb: Status 404 returned error can't find the container with id e3442f8fdadd3a4650e514b0cfc072bdb8aebcda34ab7e1df37bd0ebd200e0eb Jul 28 13:51:52.163894 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:52.163844 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" event={"ID":"c5d68771-97e7-49ad-8510-38668c12c409","Type":"ContainerStarted","Data":"8d5af09d59eba938a7d60c5d493b92d86490b5e8563b008b0a81c3ae73b057b3"} Jul 28 13:51:52.164070 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:52.163904 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:51:52.165437 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:52.165412 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" event={"ID":"2fe3b643-8354-4848-8c52-322137bf32c5","Type":"ContainerStarted","Data":"e116b1abf7eef8aabbaabbd1eeab8cf52309c1e540d0b4e545ce8187f8d09dcd"} Jul 28 13:51:52.165546 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:52.165444 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" event={"ID":"2fe3b643-8354-4848-8c52-322137bf32c5","Type":"ContainerStarted","Data":"e3442f8fdadd3a4650e514b0cfc072bdb8aebcda34ab7e1df37bd0ebd200e0eb"} Jul 28 13:51:52.195942 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:52.195884 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" podStartSLOduration=2.0524629 podStartE2EDuration="5.195866744s" totalImagesPullingTime="3.143403844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:51:52.194038847 +0000 UTC m=+319.124899236" watchObservedRunningTime="2026-07-28 13:51:52.195866744 +0000 UTC m=+319.126727103" Jul 28 13:51:52.214608 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:52.214535 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s2djh" podStartSLOduration=3.214518868 podStartE2EDuration="3.214518868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:51:52.212625726 +0000 UTC m=+319.143486088" watchObservedRunningTime="2026-07-28 13:51:52.214518868 +0000 UTC m=+319.145379228" Jul 28 13:51:58.172015 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:51:58.171975 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7mdhl" Jul 28 13:52:45.246989 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.246902 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-btj6j/must-gather-8rc2g"] Jul 28 13:52:45.251404 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.251375 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.254786 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.254755 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-btj6j\"/\"default-dockercfg-tf2xf\"" Jul 28 13:52:45.254786 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.254755 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btj6j\"/\"openshift-service-ca.crt\"" Jul 28 13:52:45.255011 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.254993 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btj6j\"/\"kube-root-ca.crt\"" Jul 28 13:52:45.265557 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.265528 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btj6j/must-gather-8rc2g"] Jul 28 13:52:45.360708 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.360672 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6017a993-c687-46cc-85c2-799f23a65387-must-gather-output\") pod \"must-gather-8rc2g\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.360708 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.360710 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbf8s\" (UniqueName: \"kubernetes.io/projected/6017a993-c687-46cc-85c2-799f23a65387-kube-api-access-tbf8s\") pod \"must-gather-8rc2g\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.461998 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.461958 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6017a993-c687-46cc-85c2-799f23a65387-must-gather-output\") pod \"must-gather-8rc2g\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.461998 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.461997 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbf8s\" (UniqueName: \"kubernetes.io/projected/6017a993-c687-46cc-85c2-799f23a65387-kube-api-access-tbf8s\") pod \"must-gather-8rc2g\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.462336 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.462317 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6017a993-c687-46cc-85c2-799f23a65387-must-gather-output\") pod \"must-gather-8rc2g\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.471334 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.471305 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbf8s\" (UniqueName: \"kubernetes.io/projected/6017a993-c687-46cc-85c2-799f23a65387-kube-api-access-tbf8s\") pod \"must-gather-8rc2g\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.560898 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.560865 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:52:45.711159 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:45.711067 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btj6j/must-gather-8rc2g"] Jul 28 13:52:45.713858 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:52:45.713823 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6017a993_c687_46cc_85c2_799f23a65387.slice/crio-388dd95de527c6d0c03a971ed5ff3fbee6eb011c9811e5ad20da4005a6175a8f WatchSource:0}: Error finding container 388dd95de527c6d0c03a971ed5ff3fbee6eb011c9811e5ad20da4005a6175a8f: Status 404 returned error can't find the container with id 388dd95de527c6d0c03a971ed5ff3fbee6eb011c9811e5ad20da4005a6175a8f Jul 28 13:52:46.391276 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:46.391197 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btj6j/must-gather-8rc2g" event={"ID":"6017a993-c687-46cc-85c2-799f23a65387","Type":"ContainerStarted","Data":"388dd95de527c6d0c03a971ed5ff3fbee6eb011c9811e5ad20da4005a6175a8f"} Jul 28 13:52:52.422902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:52.422806 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btj6j/must-gather-8rc2g" event={"ID":"6017a993-c687-46cc-85c2-799f23a65387","Type":"ContainerStarted","Data":"6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3"} Jul 28 13:52:52.422902 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:52.422856 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btj6j/must-gather-8rc2g" event={"ID":"6017a993-c687-46cc-85c2-799f23a65387","Type":"ContainerStarted","Data":"742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd"} Jul 28 13:52:52.463014 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:52:52.462950 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-btj6j/must-gather-8rc2g" podStartSLOduration=1.293229985 podStartE2EDuration="7.462931942s" totalImagesPullingTime="6.169701957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:52:52.462176634 +0000 UTC m=+379.393036995" watchObservedRunningTime="2026-07-28 13:52:52.462931942 +0000 UTC m=+379.393792380" Jul 28 13:53:40.666812 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:40.666774 2584 generic.go:356] "Generic (PLEG): container finished" podID="6017a993-c687-46cc-85c2-799f23a65387" containerID="742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd" exitCode=0 Jul 28 13:53:40.666812 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:40.666817 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btj6j/must-gather-8rc2g" event={"ID":"6017a993-c687-46cc-85c2-799f23a65387","Type":"ContainerDied","Data":"742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd"} Jul 28 13:53:40.667306 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:40.667142 2584 scope.go:117] "RemoveContainer" containerID="742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd" Jul 28 13:53:41.469540 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:41.469508 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-btj6j_must-gather-8rc2g_6017a993-c687-46cc-85c2-799f23a65387/gather/0.log" Jul 28 13:53:45.167287 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:45.167255 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lhvgc_7164e880-4791-4d39-970c-eb00f93cf61f/global-pull-secret-syncer/0.log" Jul 28 13:53:45.278876 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:45.278839 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jvngd_f5c5a1a4-e7af-456c-98bc-0d6e89bd3a06/konnectivity-agent/0.log" Jul 28 13:53:45.331851 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:45.331823 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-18.ec2.internal_0daa214522a163b287fc290469f00d45/haproxy/0.log" Jul 28 13:53:46.837872 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:46.837836 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-btj6j/must-gather-8rc2g"] Jul 28 13:53:46.838275 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:46.838016 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-btj6j/must-gather-8rc2g" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="copy" containerID="cri-o://6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3" gracePeriod=2 Jul 28 13:53:46.840146 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:53:46.840110 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8rc2g\" is forbidden: User \"system:node:ip-10-0-138-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-btj6j\": no relationship found between node 'ip-10-0-138-18.ec2.internal' and this object" podUID="6017a993-c687-46cc-85c2-799f23a65387" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:53:46.841064 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:46.841041 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-btj6j/must-gather-8rc2g"] Jul 28 13:53:47.078002 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.077977 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-btj6j_must-gather-8rc2g_6017a993-c687-46cc-85c2-799f23a65387/copy/0.log" Jul 28 13:53:47.080622 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.080605 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:53:47.082972 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:53:47.082947 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8rc2g\" is forbidden: User \"system:node:ip-10-0-138-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-btj6j\": no relationship found between node 'ip-10-0-138-18.ec2.internal' and this object" podUID="6017a993-c687-46cc-85c2-799f23a65387" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:53:47.150115 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.150028 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbf8s\" (UniqueName: \"kubernetes.io/projected/6017a993-c687-46cc-85c2-799f23a65387-kube-api-access-tbf8s\") pod \"6017a993-c687-46cc-85c2-799f23a65387\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " Jul 28 13:53:47.150115 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.150089 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6017a993-c687-46cc-85c2-799f23a65387-must-gather-output\") pod \"6017a993-c687-46cc-85c2-799f23a65387\" (UID: \"6017a993-c687-46cc-85c2-799f23a65387\") " Jul 28 13:53:47.151645 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.151604 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6017a993-c687-46cc-85c2-799f23a65387-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "6017a993-c687-46cc-85c2-799f23a65387" (UID: "6017a993-c687-46cc-85c2-799f23a65387"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:53:47.152785 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.152744 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6017a993-c687-46cc-85c2-799f23a65387-kube-api-access-tbf8s" (OuterVolumeSpecName: "kube-api-access-tbf8s") pod "6017a993-c687-46cc-85c2-799f23a65387" (UID: "6017a993-c687-46cc-85c2-799f23a65387"). InnerVolumeSpecName "kube-api-access-tbf8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:53:47.251110 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.251070 2584 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6017a993-c687-46cc-85c2-799f23a65387-must-gather-output\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:53:47.251110 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.251102 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbf8s\" (UniqueName: \"kubernetes.io/projected/6017a993-c687-46cc-85c2-799f23a65387-kube-api-access-tbf8s\") on node \"ip-10-0-138-18.ec2.internal\" DevicePath \"\"" Jul 28 13:53:47.697011 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.696984 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-btj6j_must-gather-8rc2g_6017a993-c687-46cc-85c2-799f23a65387/copy/0.log" Jul 28 13:53:47.697354 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.697333 2584 generic.go:356] "Generic (PLEG): container finished" podID="6017a993-c687-46cc-85c2-799f23a65387" containerID="6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3" exitCode=143 Jul 28 13:53:47.697446 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.697390 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:53:47.697510 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.697446 2584 scope.go:117] "RemoveContainer" containerID="6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3" Jul 28 13:53:47.699740 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:53:47.699710 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8rc2g\" is forbidden: User \"system:node:ip-10-0-138-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-btj6j\": no relationship found between node 'ip-10-0-138-18.ec2.internal' and this object" podUID="6017a993-c687-46cc-85c2-799f23a65387" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:53:47.705814 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.705796 2584 scope.go:117] "RemoveContainer" containerID="742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd" Jul 28 13:53:47.707709 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:53:47.707673 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8rc2g\" is forbidden: User \"system:node:ip-10-0-138-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-btj6j\": no relationship found between node 'ip-10-0-138-18.ec2.internal' and this object" podUID="6017a993-c687-46cc-85c2-799f23a65387" pod="openshift-must-gather-btj6j/must-gather-8rc2g" Jul 28 13:53:47.708143 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.708121 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6017a993-c687-46cc-85c2-799f23a65387" path="/var/lib/kubelet/pods/6017a993-c687-46cc-85c2-799f23a65387/volumes" Jul 28 13:53:47.718677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.718655 2584 scope.go:117] "RemoveContainer" containerID="6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3" Jul 28 13:53:47.718976 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:53:47.718956 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3\": container with ID starting with 6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3 not found: ID does not exist" containerID="6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3" Jul 28 13:53:47.719023 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.718986 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3"} err="failed to get container status \"6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3\": rpc error: code = NotFound desc = could not find container \"6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3\": container with ID starting with 6f4c83b3af8bcdf7628b01e692753faa997874d729fa58fcaed76afd1fc014c3 not found: ID does not exist" Jul 28 13:53:47.719023 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.719006 2584 scope.go:117] "RemoveContainer" containerID="742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd" Jul 28 13:53:47.719251 ip-10-0-138-18 kubenswrapper[2584]: E0728 13:53:47.719233 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd\": container with ID starting with 742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd not found: ID does not exist" containerID="742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd" Jul 28 13:53:47.719287 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:47.719257 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd"} err="failed to get container status \"742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd\": rpc error: code = NotFound desc = could not find container \"742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd\": container with ID starting with 742e62b4e05f69845fe9d277e72916e2aeac887aaaf441f0a837ef02d5c8c7fd not found: ID does not exist" Jul 28 13:53:48.778605 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.778571 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/alertmanager/0.log" Jul 28 13:53:48.814841 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.814816 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/config-reloader/0.log" Jul 28 13:53:48.850236 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.850203 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/kube-rbac-proxy-web/0.log" Jul 28 13:53:48.889353 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.889328 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/kube-rbac-proxy/0.log" Jul 28 13:53:48.915967 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.915920 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/kube-rbac-proxy-metric/0.log" Jul 28 13:53:48.950296 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.950264 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/prom-label-proxy/0.log" Jul 28 13:53:48.982537 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:48.982512 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bbcb9e5-8bd0-4756-bd94-f7b5f183ec8c/init-config-reloader/0.log" Jul 28 13:53:49.056926 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.056903 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vmzs4_4ede43a5-3528-49b9-aab6-81f5468aa71c/kube-state-metrics/0.log" Jul 28 13:53:49.091728 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.091699 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vmzs4_4ede43a5-3528-49b9-aab6-81f5468aa71c/kube-rbac-proxy-main/0.log" Jul 28 13:53:49.122739 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.122710 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vmzs4_4ede43a5-3528-49b9-aab6-81f5468aa71c/kube-rbac-proxy-self/0.log" Jul 28 13:53:49.163479 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.163448 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f7f67d9f9-lnxfj_20562c78-cbff-454f-a07a-b30bf4113a32/metrics-server/0.log" Jul 28 13:53:49.194369 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.194343 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-dhmzf_b938b9e5-12f2-4e11-84d4-bf2db9ba7cf6/monitoring-plugin/0.log" Jul 28 13:53:49.322154 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.322063 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf9lv_8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32/node-exporter/0.log" Jul 28 13:53:49.357801 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.357774 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf9lv_8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32/kube-rbac-proxy/0.log" Jul 28 13:53:49.387605 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.387559 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf9lv_8c69db8b-3f5f-4a0a-b1fe-5aa7316b1c32/init-textfile/0.log" Jul 28 13:53:49.513620 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.513562 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-rtnqd_3cb8bf21-ce2e-43e7-89ad-28076b2745ea/kube-rbac-proxy-main/0.log" Jul 28 13:53:49.555208 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.555169 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-rtnqd_3cb8bf21-ce2e-43e7-89ad-28076b2745ea/kube-rbac-proxy-self/0.log" Jul 28 13:53:49.582509 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.582422 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-rtnqd_3cb8bf21-ce2e-43e7-89ad-28076b2745ea/openshift-state-metrics/0.log" Jul 28 13:53:49.628697 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.628674 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/prometheus/0.log" Jul 28 13:53:49.660419 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.660397 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/config-reloader/0.log" Jul 28 13:53:49.691659 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.691629 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/thanos-sidecar/0.log" Jul 28 13:53:49.720795 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.720769 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/kube-rbac-proxy-web/0.log" Jul 28 13:53:49.751842 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.751821 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/kube-rbac-proxy/0.log" Jul 28 13:53:49.784202 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.784175 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/kube-rbac-proxy-thanos/0.log" Jul 28 13:53:49.811690 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.811667 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2a6b0b1-213b-4e4a-bf14-fe7130c7ed7f/init-config-reloader/0.log" Jul 28 13:53:49.860022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.859936 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-qjhfz_7f5147dc-a047-4e4c-81f2-b84a2e1b143f/prometheus-operator/0.log" Jul 28 13:53:49.886761 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.886729 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-qjhfz_7f5147dc-a047-4e4c-81f2-b84a2e1b143f/kube-rbac-proxy/0.log" Jul 28 13:53:49.916783 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:49.916759 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-55hld_dd516293-d835-479b-adfe-da30b9381f79/prometheus-operator-admission-webhook/0.log" Jul 28 13:53:50.096157 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:50.096133 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69b9b899-p52bw_6d6aeb9c-e1fc-4196-8c22-7cea90831f55/thanos-query/0.log" Jul 28 13:53:50.142016 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:50.141942 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69b9b899-p52bw_6d6aeb9c-e1fc-4196-8c22-7cea90831f55/kube-rbac-proxy-web/0.log" Jul 28 13:53:50.203007 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:50.202988 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69b9b899-p52bw_6d6aeb9c-e1fc-4196-8c22-7cea90831f55/kube-rbac-proxy/0.log" Jul 28 13:53:50.243194 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:50.243162 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69b9b899-p52bw_6d6aeb9c-e1fc-4196-8c22-7cea90831f55/prom-label-proxy/0.log" Jul 28 13:53:50.301371 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:50.301345 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69b9b899-p52bw_6d6aeb9c-e1fc-4196-8c22-7cea90831f55/kube-rbac-proxy-rules/0.log" Jul 28 13:53:50.337382 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:50.337354 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69b9b899-p52bw_6d6aeb9c-e1fc-4196-8c22-7cea90831f55/kube-rbac-proxy-metrics/0.log" Jul 28 13:53:52.429796 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.429767 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-8r68l_eb19aa02-8a52-4c6f-8682-1447ae80cadb/download-server/0.log" Jul 28 13:53:52.683263 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683181 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv"] Jul 28 13:53:52.683530 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683517 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="gather" Jul 28 13:53:52.683575 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683531 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="gather" Jul 28 13:53:52.683575 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683542 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="copy" Jul 28 13:53:52.683575 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683547 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="copy" Jul 28 13:53:52.683700 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683616 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="gather" Jul 28 13:53:52.683700 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.683628 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6017a993-c687-46cc-85c2-799f23a65387" containerName="copy" Jul 28 13:53:52.688994 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.688966 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.691505 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.691473 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ng2n9\"/\"openshift-service-ca.crt\"" Jul 28 13:53:52.691705 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.691520 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ng2n9\"/\"kube-root-ca.crt\"" Jul 28 13:53:52.691705 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.691544 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ng2n9\"/\"default-dockercfg-bh9hw\"" Jul 28 13:53:52.695624 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.695596 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv"] Jul 28 13:53:52.795154 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.795114 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-proc\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.795318 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.795168 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-lib-modules\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.795318 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.795240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-podres\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.795318 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.795268 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cphw2\" (UniqueName: \"kubernetes.io/projected/d3538336-eb17-4a24-bee5-4d5b69c19dda-kube-api-access-cphw2\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.795318 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.795308 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-sys\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896652 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896620 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-proc\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896664 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-lib-modules\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896703 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-podres\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896723 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphw2\" (UniqueName: \"kubernetes.io/projected/d3538336-eb17-4a24-bee5-4d5b69c19dda-kube-api-access-cphw2\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-proc\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896748 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-sys\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.896822 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896810 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-sys\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.897002 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896843 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-podres\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.897002 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.896842 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3538336-eb17-4a24-bee5-4d5b69c19dda-lib-modules\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:52.909197 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:52.909171 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cphw2\" (UniqueName: \"kubernetes.io/projected/d3538336-eb17-4a24-bee5-4d5b69c19dda-kube-api-access-cphw2\") pod \"perf-node-gather-daemonset-mz6cv\" (UID: \"d3538336-eb17-4a24-bee5-4d5b69c19dda\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:53.001141 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.001052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:53.148816 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.148772 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv"] Jul 28 13:53:53.151625 ip-10-0-138-18 kubenswrapper[2584]: W0728 13:53:53.151572 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd3538336_eb17_4a24_bee5_4d5b69c19dda.slice/crio-43a5e42f0d1a808bc54e9e417ba5447b92f9d77ebf26b837a5bb31de9bc12ba5 WatchSource:0}: Error finding container 43a5e42f0d1a808bc54e9e417ba5447b92f9d77ebf26b837a5bb31de9bc12ba5: Status 404 returned error can't find the container with id 43a5e42f0d1a808bc54e9e417ba5447b92f9d77ebf26b837a5bb31de9bc12ba5 Jul 28 13:53:53.723168 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.723120 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" event={"ID":"d3538336-eb17-4a24-bee5-4d5b69c19dda","Type":"ContainerStarted","Data":"b09ce47a53440e61cb0ddf8e90049f6d9995dd1c53e7d4040b758e8a91db60d8"} Jul 28 13:53:53.723661 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.723178 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" event={"ID":"d3538336-eb17-4a24-bee5-4d5b69c19dda","Type":"ContainerStarted","Data":"43a5e42f0d1a808bc54e9e417ba5447b92f9d77ebf26b837a5bb31de9bc12ba5"} Jul 28 13:53:53.723661 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.723283 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:53:53.741824 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.741759 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" podStartSLOduration=1.741737978 podStartE2EDuration="1.741737978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:53:53.740290752 +0000 UTC m=+440.671151111" watchObservedRunningTime="2026-07-28 13:53:53.741737978 +0000 UTC m=+440.672598341" Jul 28 13:53:53.934257 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.934216 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lg9pp_591927fd-acb5-49c2-b271-d8080663b830/dns/0.log" Jul 28 13:53:53.965026 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:53.965001 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lg9pp_591927fd-acb5-49c2-b271-d8080663b830/kube-rbac-proxy/0.log" Jul 28 13:53:54.049520 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:54.049487 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zj82_014ce2fb-7ebe-4271-a48c-06756765520e/dns-node-resolver/0.log" Jul 28 13:53:54.517436 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:54.517356 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7m6fd_47711bee-dd01-4679-893e-16c1385c94a8/node-ca/0.log" Jul 28 13:53:55.757354 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:55.757330 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5w4cd_71c6ddf1-a9d2-4b5b-89b7-9ea2c1fca908/serve-healthcheck-canary/0.log" Jul 28 13:53:56.198482 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:56.198446 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59hwf_dae6df41-3868-47dc-9858-93813458fcea/kube-rbac-proxy/0.log" Jul 28 13:53:56.222516 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:56.222489 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59hwf_dae6df41-3868-47dc-9858-93813458fcea/exporter/0.log" Jul 28 13:53:56.248103 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:56.248063 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-59hwf_dae6df41-3868-47dc-9858-93813458fcea/extractor/0.log" Jul 28 13:53:59.738179 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:53:59.738150 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-mz6cv" Jul 28 13:54:02.680159 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.680132 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/kube-multus-additional-cni-plugins/0.log" Jul 28 13:54:02.706217 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.706191 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/egress-router-binary-copy/0.log" Jul 28 13:54:02.733229 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.733202 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/cni-plugins/0.log" Jul 28 13:54:02.759303 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.759276 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/bond-cni-plugin/0.log" Jul 28 13:54:02.785613 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.785569 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/routeoverride-cni/0.log" Jul 28 13:54:02.810600 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.810569 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/whereabouts-cni-bincopy/0.log" Jul 28 13:54:02.835365 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:02.835332 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4c9tj_9bc3d7fb-0659-4945-84cc-34e0c947e959/whereabouts-cni/0.log" Jul 28 13:54:03.263022 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:03.262996 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vvvvh_a94b9790-40fd-4e5b-8467-8b8097948e4c/kube-multus/0.log" Jul 28 13:54:03.347516 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:03.347488 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxwcj_f601e367-df72-4305-b87b-88dabb68acde/network-metrics-daemon/0.log" Jul 28 13:54:03.372787 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:03.372761 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxwcj_f601e367-df72-4305-b87b-88dabb68acde/kube-rbac-proxy/0.log" Jul 28 13:54:04.279558 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.279465 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/ovn-controller/0.log" Jul 28 13:54:04.304667 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.304637 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/ovn-acl-logging/0.log" Jul 28 13:54:04.330512 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.330483 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/kube-rbac-proxy-node/0.log" Jul 28 13:54:04.356550 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.356518 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 13:54:04.384565 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.384534 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/northd/0.log" Jul 28 13:54:04.411366 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.411337 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/nbdb/0.log" Jul 28 13:54:04.436111 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.436088 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/sbdb/0.log" Jul 28 13:54:04.476131 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:04.476096 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4slmk_af9c255b-3411-4c62-bcf3-bbc14b8f8391/ovnkube-controller/0.log" Jul 28 13:54:05.953677 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:05.953649 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-l9rb7_62d21bac-460f-4911-ad11-52d7d2c83d79/network-check-target-container/0.log" Jul 28 13:54:07.126839 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:07.126814 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xbzlz_3cbb0ae4-8f43-4fcc-a41e-ed6eebdabf76/iptables-alerter/0.log" Jul 28 13:54:07.830738 ip-10-0-138-18 kubenswrapper[2584]: I0728 13:54:07.830708 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7bn87_9ff22090-7373-430c-a0fb-a3f2ad7fe13f/tuned/0.log"