Jul 31 14:25:33.411941 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 31 14:25:33.411952 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 31 14:25:33.411959 ip-10-0-138-146 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 31 14:25:33.412211 ip-10-0-138-146 systemd[1]: Failed to start Kubernetes Kubelet. Jul 31 14:25:44.501015 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 31 14:25:44.501033 ip-10-0-138-146 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ec295cfcc27a409ea720d79968f60f64 -- Jul 31 14:27:15.439870 ip-10-0-138-146 systemd[1]: Starting Kubernetes Kubelet... Jul 31 14:27:15.896910 ip-10-0-138-146 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:27:15.896910 ip-10-0-138-146 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 14:27:15.896910 ip-10-0-138-146 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:27:15.896910 ip-10-0-138-146 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 14:27:15.896910 ip-10-0-138-146 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:27:15.898326 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.898233 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 14:27:15.903523 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903506 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:27:15.903523 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903522 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903526 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903530 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903533 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903536 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903545 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903549 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903552 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903555 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903558 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903560 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903563 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903566 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903569 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903571 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903585 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903589 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903591 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903594 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903597 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:27:15.903602 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903599 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903602 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903605 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903608 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903611 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903613 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903616 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903619 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903622 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903626 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903630 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903633 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903636 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903639 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903641 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903644 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903650 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903652 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903655 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:27:15.904080 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903658 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903661 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903663 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903666 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903668 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903671 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903673 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903676 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903678 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903681 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903683 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903686 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903688 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903691 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903693 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903697 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903700 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903702 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903705 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903708 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:27:15.904592 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903710 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903713 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903719 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903722 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903725 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903729 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903732 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903734 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903737 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903739 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903742 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903745 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903748 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903751 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903753 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903756 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903759 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903761 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903764 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:27:15.905086 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903766 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903769 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903771 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903774 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903776 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903778 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903781 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903784 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903787 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903792 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903795 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903798 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903801 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903804 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903807 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903809 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903812 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903815 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903817 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.903820 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:27:15.905558 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904501 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904508 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904511 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904513 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904517 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904520 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904523 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904526 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904529 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904533 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904537 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904540 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904543 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904546 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904549 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904551 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904554 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904556 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904559 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:27:15.906073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904562 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904565 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904568 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904570 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904573 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904590 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904594 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904598 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904601 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904604 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904606 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904609 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904611 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904614 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904617 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904619 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904622 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904625 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904628 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904631 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:27:15.906551 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904634 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904638 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904641 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904644 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904647 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904649 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904652 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904655 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904657 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904660 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904662 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904665 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904668 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904671 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904674 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904676 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904679 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904681 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904684 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:27:15.907058 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904687 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904689 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904692 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904694 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904697 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904701 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904703 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904706 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904708 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904714 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904716 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904719 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904722 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904725 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904728 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904730 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904733 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904735 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904738 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904740 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:27:15.907559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904743 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904745 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904748 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904753 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904755 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904758 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904761 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904764 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904766 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904769 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904771 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904774 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904776 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904779 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904782 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904784 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904787 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904789 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904792 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:27:15.908070 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.904794 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905175 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905179 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905182 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905186 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905189 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905191 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905194 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905196 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905199 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905201 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905204 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905207 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905209 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905212 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905215 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905217 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905220 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905222 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905225 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:27:15.908559 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905228 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905230 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905233 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905236 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905238 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905241 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905243 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905246 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905248 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905250 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905253 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905256 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905258 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905262 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905265 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905268 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905270 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905273 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905276 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905278 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:27:15.909183 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905281 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905283 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905286 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905288 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905290 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905293 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905295 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905298 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905301 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905303 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905306 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905309 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905311 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905314 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905316 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905319 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905323 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905326 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905329 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905331 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:27:15.909712 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905334 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905336 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905339 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905341 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905344 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905348 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905350 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905353 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905355 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905358 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905361 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905363 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905366 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905368 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905370 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905373 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905375 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905378 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905381 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905383 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:27:15.910204 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905386 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905389 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905393 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905397 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905401 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905404 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905407 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905410 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905413 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905415 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905417 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905420 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905423 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905426 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905428 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905431 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905433 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905437 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905439 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:27:15.910694 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.905442 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905517 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905524 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905530 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905538 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905544 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905552 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905559 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905564 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905567 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905571 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905591 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905596 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905599 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905602 2576 flags.go:64] FLAG: --cgroup-root="" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905605 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905608 2576 flags.go:64] FLAG: --client-ca-file="" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905611 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905614 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905618 2576 flags.go:64] FLAG: --cluster-domain="" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905621 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905624 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905627 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905631 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 14:27:15.911156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905635 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905638 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905641 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905644 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905647 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905650 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905654 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905658 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905661 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905665 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905668 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905671 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905674 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905678 2576 flags.go:64] FLAG: --enable-server="true" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905682 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905687 2576 flags.go:64] FLAG: --event-burst="100" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905690 2576 flags.go:64] FLAG: --event-qps="50" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905693 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905696 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905699 2576 flags.go:64] FLAG: --eviction-hard="" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905703 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905706 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905708 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905712 2576 flags.go:64] FLAG: --eviction-soft="" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905714 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 14:27:15.911751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905717 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905720 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905723 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905726 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905729 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905732 2576 flags.go:64] FLAG: --feature-gates="" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905736 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905739 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905742 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905745 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905748 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905751 2576 flags.go:64] FLAG: --help="false" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905754 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-146.ec2.internal" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905759 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905762 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905765 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905768 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905771 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905774 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905777 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905780 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905786 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905789 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905793 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 14:27:15.912563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905796 2576 flags.go:64] FLAG: --kube-reserved="" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905799 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905801 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905805 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905807 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905810 2576 flags.go:64] FLAG: --lock-file="" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905813 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905816 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905819 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905825 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905828 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905831 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905833 2576 flags.go:64] FLAG: --logging-format="text" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905836 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905840 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905842 2576 flags.go:64] FLAG: --manifest-url="" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905845 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905850 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905852 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905857 2576 flags.go:64] FLAG: --max-pods="110" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905860 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905864 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905866 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905869 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905872 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 14:27:15.913381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905875 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905878 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905886 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905889 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905893 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905896 2576 flags.go:64] FLAG: --pod-cidr="" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905899 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905905 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905908 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905911 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905914 2576 flags.go:64] FLAG: --port="10250" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905917 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905920 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02aa3e7d46311e346" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905923 2576 flags.go:64] FLAG: --qos-reserved="" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905926 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905929 2576 flags.go:64] FLAG: --register-node="true" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905932 2576 flags.go:64] FLAG: --register-with-taints="" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905936 2576 flags.go:64] FLAG: --registry-burst="10" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905939 2576 flags.go:64] FLAG: --registry-qps="5" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905942 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905945 2576 flags.go:64] FLAG: --reserved-memory="" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905948 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905951 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905954 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905957 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 14:27:15.914095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905960 2576 flags.go:64] FLAG: --runonce="false" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905963 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905966 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905971 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905974 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905977 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905980 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905983 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905986 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905988 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905991 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905994 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.905998 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906002 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906005 2576 flags.go:64] FLAG: --system-cgroups="" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906007 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906013 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906015 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906018 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906021 2576 flags.go:64] FLAG: --tls-min-version="" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906024 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906027 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906029 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906032 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906035 2576 flags.go:64] FLAG: --v="2" Jul 31 14:27:15.914819 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906039 2576 flags.go:64] FLAG: --version="false" Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906043 2576 flags.go:64] FLAG: --vmodule="" Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906047 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906050 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906169 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906173 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906176 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906179 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906181 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906184 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906187 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906190 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906192 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906195 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906198 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906201 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906203 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906206 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906208 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906212 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:27:15.915419 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906215 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906218 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906220 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906223 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906226 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906228 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906231 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906233 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906236 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906239 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906242 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906244 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906247 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906250 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906252 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906255 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906257 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906260 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906262 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906265 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:27:15.915925 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906267 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906270 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906272 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906275 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906278 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906280 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906283 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906285 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906288 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906290 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906293 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906296 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906299 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906302 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906305 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906308 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906310 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906313 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906315 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906318 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:27:15.916420 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906320 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906323 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906325 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906328 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906330 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906332 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906335 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906338 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906340 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906343 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906345 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906348 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906350 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906353 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906355 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906359 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906363 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906366 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906368 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:27:15.916967 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906371 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906374 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906376 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906379 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906383 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906385 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906388 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906391 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906394 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906396 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906399 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906401 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906404 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906407 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906409 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906413 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906417 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906419 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906423 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:27:15.917465 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906427 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906430 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906432 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906435 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.906437 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.906443 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.915201 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.915218 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.915238 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.915244 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915309 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915313 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915317 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915320 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915323 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:27:15.917966 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915325 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915328 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915331 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915333 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915336 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915338 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915341 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915344 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915347 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915350 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915352 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915355 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915357 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915360 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915363 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915365 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915373 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915376 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915378 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915381 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:27:15.918336 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915384 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915387 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915391 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915394 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915399 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915402 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915405 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915408 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915411 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915413 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915416 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915419 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915422 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915425 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915427 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915430 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915433 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915436 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915439 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:27:15.918856 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915441 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915444 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915448 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915452 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915455 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915458 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915461 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915464 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915467 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915471 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915475 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915477 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915480 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915483 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915485 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915488 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915491 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915494 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915497 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:27:15.919325 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915500 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915502 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915505 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915508 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915511 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915513 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915515 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915518 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915520 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915523 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915525 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915528 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915530 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915533 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915535 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915538 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915541 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915544 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915546 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915549 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:27:15.919816 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915551 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915554 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915556 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915559 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915561 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915564 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915566 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915569 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915571 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915588 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915591 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915595 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915598 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915601 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915603 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:27:15.920297 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915606 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.915611 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915730 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915735 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915738 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915741 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915745 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915747 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915750 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915753 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915756 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915759 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915762 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915765 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:27:15.920719 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915768 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915771 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915773 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915776 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915778 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915781 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915784 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915786 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915789 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915791 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915794 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915797 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915799 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915802 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915805 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915807 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915810 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915813 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915815 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915818 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:27:15.921073 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915821 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915824 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915826 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915829 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915831 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915834 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915836 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915839 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915841 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915844 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915847 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915849 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915852 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915855 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915857 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915860 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915862 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915865 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915868 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915870 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:27:15.921572 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915873 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915875 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915879 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915883 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915886 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915889 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915892 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915895 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915898 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915900 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915903 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915906 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915909 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915913 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915915 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915918 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915921 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915924 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915927 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:27:15.922079 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915931 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915934 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915937 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915939 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915942 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915945 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915947 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915950 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915953 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915955 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915958 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915960 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915963 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915965 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915968 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915971 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915973 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915976 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915979 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915982 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:27:15.922542 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915985 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915987 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915990 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915992 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915995 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.915998 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.916000 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:15.916003 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.916008 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.916124 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.918813 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.921427 2576 server.go:1019] "Starting client certificate rotation" Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.921523 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:27:15.923089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.921563 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:27:15.924063 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.924050 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:27:15.927160 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.927144 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:27:15.937728 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.937711 2576 log.go:25] "Validated CRI v1 runtime API" Jul 31 14:27:15.939913 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.939897 2576 log.go:25] "Validated CRI v1 image API" Jul 31 14:27:15.940656 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.940640 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 14:27:15.943282 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.943263 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b54d4cf0-cbca-48ba-9f97-7fd7c894f421:/dev/nvme0n1p3 df47fc99-ea2b-4dca-962c-8a95e83d5719:/dev/nvme0n1p4] Jul 31 14:27:15.943331 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.943281 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 14:27:15.948089 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.948070 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:27:15.951236 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.951125 2576 manager.go:216] Machine: {Timestamp:2026-07-31 14:27:15.947949919 +0000 UTC m=+0.379438562 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:4568965 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf6402a3a9464e3be789227b02ca7 SystemUUID:ec2bf640-2a3a-9464-e3be-789227b02ca7 BootID:ec295cfc-c27a-409e-a720-d79968f60f64 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:e4:38:5b:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:e4:38:5b:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:b6:d1:7c:09:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 14:27:15.951236 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.951223 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 14:27:15.951365 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.951306 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 14:27:15.955314 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.955286 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 14:27:15.955473 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.955318 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 14:27:15.957081 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.957070 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 14:27:15.957121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.957084 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 14:27:15.957121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.957092 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:27:15.957805 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.957794 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:27:15.959501 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.959491 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 14:27:15.964246 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964234 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:27:15.964377 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964365 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 14:27:15.964415 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964400 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 31 14:27:15.964415 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964412 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 14:27:15.964465 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964427 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 14:27:15.964465 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964437 2576 kubelet.go:398] "Adding apiserver pod source" Jul 31 14:27:15.964465 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964447 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 14:27:15.964842 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964828 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:27:15.964914 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.964848 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:27:15.968508 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.968488 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 14:27:15.970382 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.970368 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 14:27:15.970445 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:15.970397 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 14:27:15.975138 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:15.975114 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 14:27:15.975138 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:15.975113 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 14:27:16.004847 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.004832 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gznmp" Jul 31 14:27:16.012050 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.012034 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gznmp" Jul 31 14:27:16.097409 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097379 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 14:27:16.097409 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097412 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097422 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097431 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097443 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097451 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097473 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097481 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097491 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097499 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097513 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 14:27:16.097571 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.097522 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 14:27:16.099742 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.099730 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 14:27:16.099795 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.099746 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 14:27:16.102880 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.102862 2576 server.go:1268] "Started kubelet" Jul 31 14:27:16.102996 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.102934 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 14:27:16.103069 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.103003 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 14:27:16.103123 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.103096 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 14:27:16.103780 ip-10-0-138-146 systemd[1]: Started Kubernetes Kubelet. Jul 31 14:27:16.104677 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.104659 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 31 14:27:16.105243 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.105223 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 14:27:16.109027 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.109006 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 14:27:16.120512 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.120493 2576 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-146.ec2.internal" not found Jul 31 14:27:16.122338 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.122318 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 14:27:16.122338 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.122329 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 14:27:16.122478 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.122394 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.122982 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.122953 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 14:27:16.122982 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.122969 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 14:27:16.122982 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.122981 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 14:27:16.123204 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123189 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 31 14:27:16.123204 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123203 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 31 14:27:16.123342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123321 2576 factory.go:55] Registering systemd factory Jul 31 14:27:16.123342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123342 2576 factory.go:223] Registration of the systemd container factory successfully Jul 31 14:27:16.123604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123572 2576 factory.go:153] Registering CRI-O factory Jul 31 14:27:16.123604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123606 2576 factory.go:223] Registration of the crio container factory successfully Jul 31 14:27:16.123726 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123656 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 14:27:16.123726 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123677 2576 factory.go:103] Registering Raw factory Jul 31 14:27:16.123726 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.123692 2576 manager.go:1196] Started watching for new ooms in manager Jul 31 14:27:16.124113 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.124099 2576 manager.go:349] Starting recovery of all containers Jul 31 14:27:16.125468 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.125448 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:27:16.127978 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.127954 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.134632 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.134617 2576 manager.go:354] Recovery completed Jul 31 14:27:16.136397 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.136381 2576 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-146.ec2.internal" not found Jul 31 14:27:16.138834 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.138819 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.140743 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.140728 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.140832 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.140771 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.140832 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.140787 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.141303 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.141289 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.141371 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.141290 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 14:27:16.141371 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.141339 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 14:27:16.141371 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.141370 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:27:16.141980 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.141966 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.142032 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.141990 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.142032 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.142000 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.143494 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.143483 2576 policy_none.go:49] "None policy: Start" Jul 31 14:27:16.143527 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.143498 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 14:27:16.143527 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.143509 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 14:27:16.145448 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.145437 2576 policy_none.go:47] "Start" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.195041 2576 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-146.ec2.internal" not found Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.195905 2576 manager.go:337] "Starting Device Plugin manager" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.195934 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.195944 2576 server.go:87] "Starting device plugin registration server" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.196209 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.196219 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.196301 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.196390 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.196403 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.197031 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.197079 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.205699 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.206847 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.206902 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.206936 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.206980 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 14:27:16.211730 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.209782 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:27:16.297392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.297228 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.298384 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.298365 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.298491 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.298395 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.298491 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.298406 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.298491 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.298436 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.307469 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.307439 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"] Jul 31 14:27:16.307570 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.307517 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.309386 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.309371 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.309475 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.309397 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.309475 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.309415 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.311691 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.311678 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.311860 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.311835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.311937 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.311862 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.312405 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.312388 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.312473 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.312389 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.312473 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.312437 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.312473 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.312449 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.312567 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.312416 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.312567 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.312506 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.314692 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.314677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.314756 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.314720 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:27:16.315351 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.315336 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:27:16.315408 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.315355 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:27:16.315408 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.315364 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:27:16.318625 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.318612 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.318669 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.318633 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-146.ec2.internal\": node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.324158 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.324135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58387e90a18e6c6e85d87a433f7aa861-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"58387e90a18e6c6e85d87a433f7aa861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.324254 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.324165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843ba45b6c019ae57a16abd9f1a1bf3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"843ba45b6c019ae57a16abd9f1a1bf3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.324254 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.324194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843ba45b6c019ae57a16abd9f1a1bf3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"843ba45b6c019ae57a16abd9f1a1bf3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.342222 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.342194 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.346644 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.346627 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.366546 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.366525 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.424360 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.424281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843ba45b6c019ae57a16abd9f1a1bf3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"843ba45b6c019ae57a16abd9f1a1bf3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.424360 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.424310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843ba45b6c019ae57a16abd9f1a1bf3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"843ba45b6c019ae57a16abd9f1a1bf3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.424360 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.424337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58387e90a18e6c6e85d87a433f7aa861-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"58387e90a18e6c6e85d87a433f7aa861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.424543 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.424368 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/843ba45b6c019ae57a16abd9f1a1bf3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"843ba45b6c019ae57a16abd9f1a1bf3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.424543 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.424391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/843ba45b6c019ae57a16abd9f1a1bf3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"843ba45b6c019ae57a16abd9f1a1bf3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.424543 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.424408 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58387e90a18e6c6e85d87a433f7aa861-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"58387e90a18e6c6e85d87a433f7aa861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.466732 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.466704 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.566938 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.566902 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.645882 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.645834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.650246 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.650212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 31 14:27:16.667326 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.667303 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.770746 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.770651 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.873972 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.873940 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.921786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.921751 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 14:27:16.922320 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.921912 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:27:16.922320 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.921962 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:27:16.974608 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:16.974568 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:16.994910 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:16.994880 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:27:17.075264 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:17.075173 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:17.099099 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.099031 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 14:22:16 +0000 UTC" deadline="2028-01-12 20:59:52.936097209 +0000 UTC" Jul 31 14:27:17.099099 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.099092 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12726h32m35.837007547s" Jul 31 14:27:17.175768 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:17.175730 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:17.276313 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:17.276260 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:17.312163 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:17.312129 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58387e90a18e6c6e85d87a433f7aa861.slice/crio-20132940baf2f73e2d4510da22bf1b9015ebb9c420793c3f38bdb3d51be5aa8b WatchSource:0}: Error finding container 20132940baf2f73e2d4510da22bf1b9015ebb9c420793c3f38bdb3d51be5aa8b: Status 404 returned error can't find the container with id 20132940baf2f73e2d4510da22bf1b9015ebb9c420793c3f38bdb3d51be5aa8b Jul 31 14:27:17.312981 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:17.312955 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843ba45b6c019ae57a16abd9f1a1bf3c.slice/crio-aec2815222c2e0b3601c1bda6b0aa63620aa1737f96268f3e409a5bc849a2c8a WatchSource:0}: Error finding container aec2815222c2e0b3601c1bda6b0aa63620aa1737f96268f3e409a5bc849a2c8a: Status 404 returned error can't find the container with id aec2815222c2e0b3601c1bda6b0aa63620aa1737f96268f3e409a5bc849a2c8a Jul 31 14:27:17.319697 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.319636 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:27:17.378543 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:17.378433 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found" Jul 31 14:27:17.380896 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.380878 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:27:17.423769 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.423723 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" Jul 31 14:27:17.440583 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.440558 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:27:17.442046 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.442031 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" Jul 31 14:27:17.451550 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.451529 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:27:17.966961 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.966925 2576 apiserver.go:52] "Watching apiserver" Jul 31 14:27:17.972596 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.972573 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 14:27:17.973046 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.973024 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8","openshift-cluster-node-tuning-operator/tuned-tgt8v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal","openshift-multus/multus-additional-cni-plugins-2lrnq","openshift-network-operator/iptables-alerter-bsqm8","openshift-ovn-kubernetes/ovnkube-node-9mttx","kube-system/global-pull-secret-syncer-q8pk6","kube-system/konnectivity-agent-548cm","openshift-dns/node-resolver-f5ngl","openshift-image-registry/node-ca-gcflc","openshift-multus/multus-wm448","openshift-multus/network-metrics-daemon-znd7x","openshift-network-diagnostics/network-check-target-ch4lf"] Jul 31 14:27:17.976993 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.976975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:17.979262 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.979244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:17.979359 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:17.979314 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:17.981509 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.981486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 14:27:17.981591 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.981533 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:17.981675 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.981619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 14:27:17.981675 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.981633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p6vk6\"" Jul 31 14:27:17.983737 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.983717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d7nsf\"" Jul 31 14:27:17.983845 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.983723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:17.983845 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:17.983811 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:17.984231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.984098 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:27:17.984231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.984136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 14:27:17.986098 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.986080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:17.988454 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.988431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:17.988727 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.988709 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 14:27:17.989065 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.989041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 14:27:17.989065 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.989055 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zstmm\"" Jul 31 14:27:17.989215 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.989093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 14:27:17.989215 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.989115 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 14:27:17.989215 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.989133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 14:27:17.991504 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.990776 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:27:17.991504 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.990881 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 14:27:17.991504 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.990928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:17.991504 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.991153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qm8nt\"" Jul 31 14:27:17.991504 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.991391 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 14:27:17.994118 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.994101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:17.995829 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.995798 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 14:27:17.995926 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.995855 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 14:27:17.997530 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.997190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:17.998282 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.997767 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 14:27:17.998282 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.998106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7pkkr\"" Jul 31 14:27:17.999723 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.999703 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nm9rs\"" Jul 31 14:27:17.999876 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.999779 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 14:27:17.999946 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.999883 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 14:27:17.999946 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.999903 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 14:27:18.000062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:17.999984 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 14:27:18.000062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.000030 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 14:27:18.000157 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.000125 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 14:27:18.001036 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.001020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lqzf4\"" Jul 31 14:27:18.001473 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.001455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.001573 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.001546 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:18.001573 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.001572 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 14:27:18.001758 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.001619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 14:27:18.004107 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.004089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.005961 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.005944 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qptzm\"" Jul 31 14:27:18.006415 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.006400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 14:27:18.006483 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.006429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 14:27:18.006607 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.006588 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 14:27:18.006912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.006896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wm448" Jul 31 14:27:18.008803 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.008787 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 14:27:18.008894 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.008791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tvg95\"" Jul 31 14:27:18.024822 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.024769 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 14:27:18.033858 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.033785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:18.033858 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.033826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-cni-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.034038 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.033858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-os-release\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.034038 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.033887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-registration-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.034038 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.033937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-device-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.034038 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.033974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af335670-24e5-41c3-8eb3-5f81c629018f-serviceca\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.034038 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-tmp-dir\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysctl-d\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovnkube-config\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e38e136e-327d-4353-924f-8417850b3d3d-iptables-alerter-script\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e38e136e-327d-4353-924f-8417850b3d3d-host-slash\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gz9j\" (UniqueName: \"kubernetes.io/projected/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-kube-api-access-8gz9j\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9l9p\" (UniqueName: \"kubernetes.io/projected/a37468ac-06e2-491e-9843-a1a509836df1-kube-api-access-f9l9p\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.034260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cnibin\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-kubelet\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-log-socket\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4hm\" (UniqueName: \"kubernetes.io/projected/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-kube-api-access-md4hm\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-hosts-file\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0791dbf3-6c03-43d9-bd9c-132b99030260-agent-certs\") pod \"konnectivity-agent-548cm\" (UID: \"0791dbf3-6c03-43d9-bd9c-132b99030260\") " pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-run\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-var-lib-kubelet\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-host\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a37468ac-06e2-491e-9843-a1a509836df1-etc-tuned\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.034667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-node-log\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-os-release\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-daemon-config\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-systemd-units\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-env-overrides\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-socket-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-dbus\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af335670-24e5-41c3-8eb3-5f81c629018f-host\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-cnibin\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-cni-binary-copy\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysconfig\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-cni-bin\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.034994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-cni-multus\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-hostroot\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-conf-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-multus-certs\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035231 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-kube-api-access-vkhn5\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-slash\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-etc-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-etc-kubernetes\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-modprobe-d\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-systemd\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxk6\" (UniqueName: \"kubernetes.io/projected/fc87c6db-643a-48c0-9ea0-b5610e1abad5-kube-api-access-zcxk6\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-kubernetes\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysctl-conf\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-systemd\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-sys\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-lib-modules\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-cni-netd\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-sys-fs\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.035943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4rj\" (UniqueName: \"kubernetes.io/projected/af335670-24e5-41c3-8eb3-5f81c629018f-kube-api-access-wj4rj\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-cni-bin\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9wpb\" (UniqueName: \"kubernetes.io/projected/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-kube-api-access-l9wpb\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovn-node-metrics-cert\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovnkube-script-lib\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bznfk\" (UniqueName: \"kubernetes.io/projected/242131e2-d4b8-4169-87c3-897f36027eab-kube-api-access-bznfk\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-kubelet-config\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-k8s-cni-cncf-io\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-netns\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.035984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-run-netns\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-var-lib-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-socket-dir-parent\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.036604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-kubelet\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a37468ac-06e2-491e-9843-a1a509836df1-tmp\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-system-cni-dir\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0791dbf3-6c03-43d9-bd9c-132b99030260-konnectivity-ca\") pod \"konnectivity-agent-548cm\" (UID: \"0791dbf3-6c03-43d9-bd9c-132b99030260\") " pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-ovn\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml9kk\" (UniqueName: \"kubernetes.io/projected/e38e136e-327d-4353-924f-8417850b3d3d-kube-api-access-ml9kk\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.037418 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.036229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-system-cni-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.124291 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.124252 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 14:27:18.137066 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-sys-fs\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.137235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.137235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4rj\" (UniqueName: \"kubernetes.io/projected/af335670-24e5-41c3-8eb3-5f81c629018f-kube-api-access-wj4rj\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.137235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-cni-bin\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.137235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.137235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9wpb\" (UniqueName: \"kubernetes.io/projected/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-kube-api-access-l9wpb\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.137235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovn-node-metrics-cert\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovnkube-script-lib\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bznfk\" (UniqueName: \"kubernetes.io/projected/242131e2-d4b8-4169-87c3-897f36027eab-kube-api-access-bznfk\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-kubelet-config\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-k8s-cni-cncf-io\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-netns\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-run-netns\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-var-lib-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-socket-dir-parent\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-kubelet\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.137560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a37468ac-06e2-491e-9843-a1a509836df1-tmp\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-system-cni-dir\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0791dbf3-6c03-43d9-bd9c-132b99030260-konnectivity-ca\") pod \"konnectivity-agent-548cm\" (UID: \"0791dbf3-6c03-43d9-bd9c-132b99030260\") " pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-ovn\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml9kk\" (UniqueName: \"kubernetes.io/projected/e38e136e-327d-4353-924f-8417850b3d3d-kube-api-access-ml9kk\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-system-cni-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-cni-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-os-release\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-registration-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-device-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af335670-24e5-41c3-8eb3-5f81c629018f-serviceca\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-tmp-dir\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysctl-d\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovnkube-config\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.137991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e38e136e-327d-4353-924f-8417850b3d3d-iptables-alerter-script\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.138191 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e38e136e-327d-4353-924f-8417850b3d3d-host-slash\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gz9j\" (UniqueName: \"kubernetes.io/projected/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-kube-api-access-8gz9j\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9l9p\" (UniqueName: \"kubernetes.io/projected/a37468ac-06e2-491e-9843-a1a509836df1-kube-api-access-f9l9p\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cnibin\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-kubelet\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-log-socket\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md4hm\" (UniqueName: \"kubernetes.io/projected/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-kube-api-access-md4hm\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-hosts-file\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0791dbf3-6c03-43d9-bd9c-132b99030260-agent-certs\") pod \"konnectivity-agent-548cm\" (UID: \"0791dbf3-6c03-43d9-bd9c-132b99030260\") " pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-run\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.138999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.138643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-var-lib-kubelet\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.139754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-sys-fs\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.139862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-host\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.139968 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-cni-bin\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.140158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-cni-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.140248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-os-release\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.140315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-registration-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.140390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-device-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.140884 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af335670-24e5-41c3-8eb3-5f81c629018f-serviceca\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141070 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.141203 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141229 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysctl-d\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141278 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 14:27:18.141664 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.141340 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:27:18.641298915 +0000 UTC m=+3.072787571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovnkube-config\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141878 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-netns\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141936 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-k8s-cni-cncf-io\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.141986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-tmp-dir\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142109 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-kubelet-config\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.142307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-system-cni-dir\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.142572 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-ovn\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.142572 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0791dbf3-6c03-43d9-bd9c-132b99030260-konnectivity-ca\") pod \"konnectivity-agent-548cm\" (UID: \"0791dbf3-6c03-43d9-bd9c-132b99030260\") " pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.142572 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e38e136e-327d-4353-924f-8417850b3d3d-iptables-alerter-script\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.142752 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-system-cni-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.142752 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142725 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.142861 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-run-netns\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.142861 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-var-lib-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.142963 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-socket-dir-parent\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.142963 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-kubelet\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.143100 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.143155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.143102 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:27:18.143155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.143111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.143720 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.143382 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:18.143720 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.143448 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:18.643431468 +0000 UTC m=+3.074920102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:18.143887 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.143827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovnkube-script-lib\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.143944 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.143896 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-cnibin\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.143997 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.143958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-run\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.143997 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.143963 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-kubelet\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.144112 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.144245 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-hosts-file\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.144307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144249 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-var-lib-kubelet\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.144307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-log-socket\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.144414 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.142615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e38e136e-327d-4353-924f-8417850b3d3d-host-slash\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-host\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a37468ac-06e2-491e-9843-a1a509836df1-etc-tuned\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-node-log\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-os-release\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-daemon-config\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-systemd-units\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-env-overrides\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-socket-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.144919 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.144949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-dbus\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-systemd-units\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-dbus\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af335670-24e5-41c3-8eb3-5f81c629018f-host\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145108 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-node-log\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-cnibin\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145170 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-cnibin\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-cni-binary-copy\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysconfig\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-cni-bin\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-cni-multus\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.145392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-hostroot\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-etc-selinux\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.146062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-socket-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.146062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145609 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-env-overrides\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.146062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af335670-24e5-41c3-8eb3-5f81c629018f-host\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.146062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.145732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-os-release\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146358 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-cni-binary-copy\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146358 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-daemon-config\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146358 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146329 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-cni-bin\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.146510 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysconfig\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.146510 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146461 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-var-lib-cni-multus\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-conf-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146673 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-multus-certs\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.146939 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-hostroot\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.147018 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.146976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-kube-api-access-vkhn5\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.147080 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-slash\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.147080 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147030 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-host-run-multus-certs\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.147080 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-etc-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.147229 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.147229 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147116 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-multus-conf-dir\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.147229 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-etc-kubernetes\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.147229 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-modprobe-d\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147229 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-systemd\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxk6\" (UniqueName: \"kubernetes.io/projected/fc87c6db-643a-48c0-9ea0-b5610e1abad5-kube-api-access-zcxk6\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-kubernetes\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysctl-conf\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-systemd\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/242131e2-d4b8-4169-87c3-897f36027eab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-sys\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-slash\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-lib-modules\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147479 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147452 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-etc-kubernetes\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.147890 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147509 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-run-systemd\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.147890 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-etc-openvswitch\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.147890 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147717 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-kubernetes\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147890 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-sysctl-conf\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.147890 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.148155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.147942 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-modprobe-d\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.148155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.148045 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-lib-modules\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.148155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.148073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.148155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.148101 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-sys\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.148349 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.148175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-cni-netd\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.148349 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.148223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-host-cni-netd\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.148349 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.148340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a37468ac-06e2-491e-9843-a1a509836df1-etc-systemd\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.149494 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.149470 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:18.149588 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.149498 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:18.149588 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.149513 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:18.149716 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.149590 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:18.649571887 +0000 UTC m=+3.081060538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:18.152809 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.151020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4rj\" (UniqueName: \"kubernetes.io/projected/af335670-24e5-41c3-8eb3-5f81c629018f-kube-api-access-wj4rj\") pod \"node-ca-gcflc\" (UID: \"af335670-24e5-41c3-8eb3-5f81c629018f\") " pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.152938 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.152915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a37468ac-06e2-491e-9843-a1a509836df1-tmp\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.153045 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.153021 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-ovn-node-metrics-cert\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.153112 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.153081 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a37468ac-06e2-491e-9843-a1a509836df1-etc-tuned\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.155823 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.155790 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0791dbf3-6c03-43d9-bd9c-132b99030260-agent-certs\") pod \"konnectivity-agent-548cm\" (UID: \"0791dbf3-6c03-43d9-bd9c-132b99030260\") " pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.157533 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.157366 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gz9j\" (UniqueName: \"kubernetes.io/projected/0ec2738a-cd75-4ef2-9f7f-9adbff19a5db-kube-api-access-8gz9j\") pod \"multus-wm448\" (UID: \"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db\") " pod="openshift-multus/multus-wm448" Jul 31 14:27:18.157634 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.157591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9l9p\" (UniqueName: \"kubernetes.io/projected/a37468ac-06e2-491e-9843-a1a509836df1-kube-api-access-f9l9p\") pod \"tuned-tgt8v\" (UID: \"a37468ac-06e2-491e-9843-a1a509836df1\") " pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.159249 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.157754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4hm\" (UniqueName: \"kubernetes.io/projected/ebaaf157-31c1-44e4-8a4a-55469b5f1ded-kube-api-access-md4hm\") pod \"ovnkube-node-9mttx\" (UID: \"ebaaf157-31c1-44e4-8a4a-55469b5f1ded\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.159249 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.157836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bznfk\" (UniqueName: \"kubernetes.io/projected/242131e2-d4b8-4169-87c3-897f36027eab-kube-api-access-bznfk\") pod \"aws-ebs-csi-driver-node-wt6q8\" (UID: \"242131e2-d4b8-4169-87c3-897f36027eab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.159249 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.159210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9wpb\" (UniqueName: \"kubernetes.io/projected/e8c6b89d-e72d-4297-b0b4-0b4193d654e5-kube-api-access-l9wpb\") pod \"multus-additional-cni-plugins-2lrnq\" (UID: \"e8c6b89d-e72d-4297-b0b4-0b4193d654e5\") " pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.160104 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.159591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxk6\" (UniqueName: \"kubernetes.io/projected/fc87c6db-643a-48c0-9ea0-b5610e1abad5-kube-api-access-zcxk6\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:18.160104 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.159816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/e9ad072d-0dc7-4dfd-a829-05c30d32b6aa-kube-api-access-vkhn5\") pod \"node-resolver-f5ngl\" (UID: \"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa\") " pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.160308 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.160284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml9kk\" (UniqueName: \"kubernetes.io/projected/e38e136e-327d-4353-924f-8417850b3d3d-kube-api-access-ml9kk\") pod \"iptables-alerter-bsqm8\" (UID: \"e38e136e-327d-4353-924f-8417850b3d3d\") " pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.161116 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.160871 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnzwj" Jul 31 14:27:18.170398 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.170374 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnzwj" Jul 31 14:27:18.200946 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.200915 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:27:18.212921 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.212801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"843ba45b6c019ae57a16abd9f1a1bf3c","Type":"ContainerStarted","Data":"aec2815222c2e0b3601c1bda6b0aa63620aa1737f96268f3e409a5bc849a2c8a"} Jul 31 14:27:18.214794 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.214724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" event={"ID":"58387e90a18e6c6e85d87a433f7aa861","Type":"ContainerStarted","Data":"20132940baf2f73e2d4510da22bf1b9015ebb9c420793c3f38bdb3d51be5aa8b"} Jul 31 14:27:18.287796 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.287706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5ngl" Jul 31 14:27:18.294057 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.294032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" Jul 31 14:27:18.305458 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.304958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" Jul 31 14:27:18.306344 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:18.306135 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37468ac_06e2_491e_9843_a1a509836df1.slice/crio-aa122ab46b11d931f5d4cfa7ec36f6e92d6c7c6ec11cdb70698c3674efba4231 WatchSource:0}: Error finding container aa122ab46b11d931f5d4cfa7ec36f6e92d6c7c6ec11cdb70698c3674efba4231: Status 404 returned error can't find the container with id aa122ab46b11d931f5d4cfa7ec36f6e92d6c7c6ec11cdb70698c3674efba4231 Jul 31 14:27:18.309322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.309302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bsqm8" Jul 31 14:27:18.316514 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.316491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:18.316708 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:18.316681 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c6b89d_e72d_4297_b0b4_0b4193d654e5.slice/crio-de2ca4153cc000eb5f64ae0710374db07aab5b4ecfdd660b8c6f6c864a322638 WatchSource:0}: Error finding container de2ca4153cc000eb5f64ae0710374db07aab5b4ecfdd660b8c6f6c864a322638: Status 404 returned error can't find the container with id de2ca4153cc000eb5f64ae0710374db07aab5b4ecfdd660b8c6f6c864a322638 Jul 31 14:27:18.321924 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.321901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:18.328936 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.328758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" Jul 31 14:27:18.335688 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.335645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcflc" Jul 31 14:27:18.337260 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:18.337229 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaaf157_31c1_44e4_8a4a_55469b5f1ded.slice/crio-11b62ac76f7cce5bec3a3d21c5c58db296d32760e5c8264941478c9190f0334c WatchSource:0}: Error finding container 11b62ac76f7cce5bec3a3d21c5c58db296d32760e5c8264941478c9190f0334c: Status 404 returned error can't find the container with id 11b62ac76f7cce5bec3a3d21c5c58db296d32760e5c8264941478c9190f0334c Jul 31 14:27:18.342652 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.342629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wm448" Jul 31 14:27:18.350711 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:18.350685 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf335670_24e5_41c3_8eb3_5f81c629018f.slice/crio-2c18c5152f7b6ade41cc2410a4ef65802698d01081faf316929ae1747d389612 WatchSource:0}: Error finding container 2c18c5152f7b6ade41cc2410a4ef65802698d01081faf316929ae1747d389612: Status 404 returned error can't find the container with id 2c18c5152f7b6ade41cc2410a4ef65802698d01081faf316929ae1747d389612 Jul 31 14:27:18.356540 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:18.356509 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec2738a_cd75_4ef2_9f7f_9adbff19a5db.slice/crio-168424de8d09b1eaa2bd194c374e0e96d28c414252d94dc22a5511b87c1bc984 WatchSource:0}: Error finding container 168424de8d09b1eaa2bd194c374e0e96d28c414252d94dc22a5511b87c1bc984: Status 404 returned error can't find the container with id 168424de8d09b1eaa2bd194c374e0e96d28c414252d94dc22a5511b87c1bc984 Jul 31 14:27:18.512748 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.512715 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:27:18.651818 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.651736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:18.651818 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.651788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:18.651830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.651879 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.651907 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.651921 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.651933 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.651951 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.651984 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:27:19.651969615 +0000 UTC m=+4.083458246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.652009 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:19.651990107 +0000 UTC m=+4.083478753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:18.652045 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:18.652031 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:19.652018072 +0000 UTC m=+4.083506705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:19.176631 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.176567 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:22:18 +0000 UTC" deadline="2028-02-17 11:04:28.320517464 +0000 UTC" Jul 31 14:27:19.176631 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.176628 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13580h37m9.14389747s" Jul 31 14:27:19.208087 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.208050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:19.208290 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.208230 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:19.219778 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.219737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerStarted","Data":"de2ca4153cc000eb5f64ae0710374db07aab5b4ecfdd660b8c6f6c864a322638"} Jul 31 14:27:19.221338 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.221311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5ngl" event={"ID":"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa","Type":"ContainerStarted","Data":"7125ede052f89a2f56563a2622493309754083ad1f4cf13bd50a01bb7d41eba4"} Jul 31 14:27:19.223056 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.223004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcflc" event={"ID":"af335670-24e5-41c3-8eb3-5f81c629018f","Type":"ContainerStarted","Data":"2c18c5152f7b6ade41cc2410a4ef65802698d01081faf316929ae1747d389612"} Jul 31 14:27:19.224566 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.224540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" event={"ID":"242131e2-d4b8-4169-87c3-897f36027eab","Type":"ContainerStarted","Data":"1ece3c76a9ea96f1e5e81b38b2d16838cfc75703ca3ad5ce398ce8906bf91550"} Jul 31 14:27:19.225969 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.225938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"11b62ac76f7cce5bec3a3d21c5c58db296d32760e5c8264941478c9190f0334c"} Jul 31 14:27:19.227978 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.227954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-548cm" event={"ID":"0791dbf3-6c03-43d9-bd9c-132b99030260","Type":"ContainerStarted","Data":"c1efe876316d4e24ddbb5cc579b1e00319e644f9190efe28180d691270471aed"} Jul 31 14:27:19.229776 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.229751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" event={"ID":"a37468ac-06e2-491e-9843-a1a509836df1","Type":"ContainerStarted","Data":"aa122ab46b11d931f5d4cfa7ec36f6e92d6c7c6ec11cdb70698c3674efba4231"} Jul 31 14:27:19.231265 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.231218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wm448" event={"ID":"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db","Type":"ContainerStarted","Data":"168424de8d09b1eaa2bd194c374e0e96d28c414252d94dc22a5511b87c1bc984"} Jul 31 14:27:19.232694 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.232601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bsqm8" event={"ID":"e38e136e-327d-4353-924f-8417850b3d3d","Type":"ContainerStarted","Data":"1543c4e8b81a981342f5f16cf304a4f700a02c3b4929fdb8d73da35666afaa46"} Jul 31 14:27:19.661261 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.661177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:19.661423 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.661267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:19.661423 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:19.661312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:19.661540 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.661461 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:19.661540 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.661481 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:19.661540 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.661494 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:19.661710 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.661556 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:21.661536991 +0000 UTC m=+6.093025626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:19.662036 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.662012 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:19.662126 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.662078 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:21.662059735 +0000 UTC m=+6.093548389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:19.662198 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.662137 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:19.662198 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:19.662171 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:27:21.662159948 +0000 UTC m=+6.093648583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:20.177100 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:20.177059 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:22:18 +0000 UTC" deadline="2028-01-26 15:01:18.003542885 +0000 UTC" Jul 31 14:27:20.177100 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:20.177100 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13056h33m57.826447795s" Jul 31 14:27:20.211998 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:20.211968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:20.212162 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:20.212139 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:20.212563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:20.212542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:20.214782 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:20.214750 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:20.257067 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:20.256748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" event={"ID":"58387e90a18e6c6e85d87a433f7aa861","Type":"ContainerStarted","Data":"0659bb13abb907286b03518bb0d09bb30ff02f036bf98f1a75922675b6225eb7"} Jul 31 14:27:21.208261 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.208145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:21.208727 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.208278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:21.264514 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.264473 2576 generic.go:356] "Generic (PLEG): container finished" podID="843ba45b6c019ae57a16abd9f1a1bf3c" containerID="a498346212c69f15c9287719a596d12b8e2a63184c54ff4388a74817b82779ff" exitCode=0 Jul 31 14:27:21.265368 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.265336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"843ba45b6c019ae57a16abd9f1a1bf3c","Type":"ContainerDied","Data":"a498346212c69f15c9287719a596d12b8e2a63184c54ff4388a74817b82779ff"} Jul 31 14:27:21.283693 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.283632 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" podStartSLOduration=4.283591089 podStartE2EDuration="4.283591089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:20.27556868 +0000 UTC m=+4.707057331" watchObservedRunningTime="2026-07-31 14:27:21.283591089 +0000 UTC m=+5.715079735" Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.678777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.678838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:21.678897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.678988 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679017 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679031 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679029 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:21.679051 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679029 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:21.679555 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679092 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:25.679072927 +0000 UTC m=+10.110561560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:21.679555 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679114 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:25.67910384 +0000 UTC m=+10.110592474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:21.679555 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:21.679130 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:27:25.679121909 +0000 UTC m=+10.110610545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:22.208329 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:22.208203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:22.208841 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:22.208347 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:22.208909 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:22.208864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:22.209007 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:22.208983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:22.271121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:22.270384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"843ba45b6c019ae57a16abd9f1a1bf3c","Type":"ContainerStarted","Data":"7640900da2e41b88b5669e436781fb2f1acdee015d7cdbecc112e9aec827edf8"} Jul 31 14:27:22.285198 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:22.285138 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" podStartSLOduration=5.285118522 podStartE2EDuration="5.285118522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:22.285031756 +0000 UTC m=+6.716520415" watchObservedRunningTime="2026-07-31 14:27:22.285118522 +0000 UTC m=+6.716607176" Jul 31 14:27:23.207736 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:23.207687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:23.207926 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:23.207826 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:24.207645 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:24.207596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:24.208103 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:24.207596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:24.208103 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:24.207757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:24.208103 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:24.207827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:25.207429 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:25.207395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:25.207686 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.207537 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:25.709605 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:25.709554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:25.709759 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:25.709628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:25.709759 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:25.709683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:25.709891 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.709823 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:25.709943 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.709891 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:27:33.709870897 +0000 UTC m=+18.141359540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:25.710199 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.710153 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:25.710294 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.710202 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:25.710294 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.710224 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:25.710294 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.710238 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:25.710294 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.710224 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:33.710205068 +0000 UTC m=+18.141693715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:25.710455 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:25.710297 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:33.710280362 +0000 UTC m=+18.141768997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:26.208233 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:26.208154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:26.208674 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:26.208300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:26.208674 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:26.208336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:26.208674 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:26.208452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:27.207699 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:27.207358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:27.207699 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:27.207481 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:28.212059 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:28.212025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:28.212534 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:28.212150 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:28.212534 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:28.212498 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:28.212667 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:28.212605 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:28.212667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:28.212650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:28.212800 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:28.212765 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:30.207550 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:30.207448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:30.208020 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:30.207448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:30.208020 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:30.207605 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:30.208020 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:30.207648 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:30.208020 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:30.207459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:30.208020 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:30.207739 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:32.207763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:32.207731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:32.207763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:32.207757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:32.208289 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:32.207731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:32.208289 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:32.207857 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:32.208289 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:32.207931 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:32.208289 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:32.207989 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:33.773780 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:33.773749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:33.773780 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:33.773786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:33.773817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.773899 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.773911 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.773929 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.773948 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.773960 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.773949 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:27:49.773935187 +0000 UTC m=+34.205423816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.774006 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:49.773993481 +0000 UTC m=+34.205482113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:33.774219 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:33.774018 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:27:49.77401063 +0000 UTC m=+34.205499260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:34.207982 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:34.207902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:34.208148 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:34.207902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:34.208148 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:34.208026 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:34.208148 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:34.207919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:34.208148 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:34.208115 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:34.208401 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:34.208168 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:36.208342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:36.208312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:36.208793 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:36.208432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:36.208793 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:36.208510 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:36.208793 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:36.208428 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:36.208793 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:36.208538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:36.208793 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:36.208623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:38.207625 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.207430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:38.208112 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.207430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:38.208112 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:38.207743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:38.208112 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.207473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:38.208112 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:38.207784 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:38.208112 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:38.207854 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:38.302443 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.302317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wm448" event={"ID":"0ec2738a-cd75-4ef2-9f7f-9adbff19a5db","Type":"ContainerStarted","Data":"ba478d82e9a775185ae0a6f3466e21356c638cec5c904fe64000f498341fcf0e"} Jul 31 14:27:38.304175 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.304144 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8c6b89d-e72d-4297-b0b4-0b4193d654e5" containerID="87ae91d28d4951c408265e42beb4d08e6998e1f1e5d893e2a4fc5a5805d74dbd" exitCode=0 Jul 31 14:27:38.304281 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.304217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerDied","Data":"87ae91d28d4951c408265e42beb4d08e6998e1f1e5d893e2a4fc5a5805d74dbd"} Jul 31 14:27:38.306260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.306223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5ngl" event={"ID":"e9ad072d-0dc7-4dfd-a829-05c30d32b6aa","Type":"ContainerStarted","Data":"ab58c1a4e6ac6d29341b00fee5603fbd2f91026f6d2a8323df16fa0c087dcba2"} Jul 31 14:27:38.307898 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.307876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcflc" event={"ID":"af335670-24e5-41c3-8eb3-5f81c629018f","Type":"ContainerStarted","Data":"197a4939c17f53d1da49b94b0f1dbc869584442cb21c2979984cf4a8ce0ce6a9"} Jul 31 14:27:38.309216 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.309197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" event={"ID":"242131e2-d4b8-4169-87c3-897f36027eab","Type":"ContainerStarted","Data":"2e154b35538c6d943a0acbe93a3acfd691b874daba4acc3f726461354a8b691b"} Jul 31 14:27:38.310463 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.310444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"d2e1241da1cbe386c6fc02675b1c72b71c3293ec676906d37cac682c0c2384cf"} Jul 31 14:27:38.312011 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.311987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-548cm" event={"ID":"0791dbf3-6c03-43d9-bd9c-132b99030260","Type":"ContainerStarted","Data":"a20c3f8901df65fe1f221beb61e2d4e8f8f968835db693059223c16bc2287a62"} Jul 31 14:27:38.313227 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.313207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" event={"ID":"a37468ac-06e2-491e-9843-a1a509836df1","Type":"ContainerStarted","Data":"3ad7b8a482e7f431ce8d1cb6faea74dd6015f1aed7dc202a28a736995316a709"} Jul 31 14:27:38.320428 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.320393 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wm448" podStartSLOduration=2.7701923969999998 podStartE2EDuration="22.320381867s" totalImagesPullingTime="19.55018947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:38.320295871 +0000 UTC m=+22.751784533" watchObservedRunningTime="2026-07-31 14:27:38.320381867 +0000 UTC m=+22.751870519" Jul 31 14:27:38.363476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.362416 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-548cm" podStartSLOduration=2.847407694 podStartE2EDuration="22.362396386s" totalImagesPullingTime="19.514988692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:38.361469264 +0000 UTC m=+22.792957920" watchObservedRunningTime="2026-07-31 14:27:38.362396386 +0000 UTC m=+22.793885037" Jul 31 14:27:38.376230 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.376188 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gcflc" podStartSLOduration=2.870360595 podStartE2EDuration="22.376172691s" totalImagesPullingTime="19.505812096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:38.375909676 +0000 UTC m=+22.807398326" watchObservedRunningTime="2026-07-31 14:27:38.376172691 +0000 UTC m=+22.807661344" Jul 31 14:27:38.390510 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.390392 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f5ngl" podStartSLOduration=2.835807537 podStartE2EDuration="22.390370558s" totalImagesPullingTime="19.554563021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:38.389878763 +0000 UTC m=+22.821367415" watchObservedRunningTime="2026-07-31 14:27:38.390370558 +0000 UTC m=+22.821859211" Jul 31 14:27:38.994022 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:38.993766 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:39.316676 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.316594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bsqm8" event={"ID":"e38e136e-327d-4353-924f-8417850b3d3d","Type":"ContainerStarted","Data":"36fb620cfbf71a956e5181382499f1d25aef34416ce48db4736fee392f7fe848"} Jul 31 14:27:39.319360 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319342 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:27:39.319671 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319652 2576 generic.go:356] "Generic (PLEG): container finished" podID="ebaaf157-31c1-44e4-8a4a-55469b5f1ded" containerID="5d25a8b3a3ae83707fb4f6ebc677cf73bf9d6cc09178b677e4e172847875db07" exitCode=1 Jul 31 14:27:39.319775 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"82c4d2d803780bc8236a96ad924e5c2c9ad084735797f87bb6aec520772cbe4a"} Jul 31 14:27:39.319847 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319829 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"09ddddcb8bf1ecc48b5f7992c198a2674db3c8564eb4976ff73e55a2d4ce9bf3"} Jul 31 14:27:39.319979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"b528a16310bc1416b91bd787cd5b9af77615f3a9e30d221418b67d2501961a06"} Jul 31 14:27:39.319979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"d0c422ea904ab635c5822c516931efbaecd365354721f5c31d67539b9f82aa65"} Jul 31 14:27:39.319979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.319945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerDied","Data":"5d25a8b3a3ae83707fb4f6ebc677cf73bf9d6cc09178b677e4e172847875db07"} Jul 31 14:27:39.332816 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.332781 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tgt8v" podStartSLOduration=3.778432417 podStartE2EDuration="23.332769269s" totalImagesPullingTime="19.554336852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:38.411734828 +0000 UTC m=+22.843223482" watchObservedRunningTime="2026-07-31 14:27:39.332769269 +0000 UTC m=+23.764257937" Jul 31 14:27:39.332989 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.332967 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bsqm8" podStartSLOduration=3.802791961 podStartE2EDuration="23.33296307s" totalImagesPullingTime="19.530171109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:39.332389814 +0000 UTC m=+23.763878465" watchObservedRunningTime="2026-07-31 14:27:39.33296307 +0000 UTC m=+23.764451721" Jul 31 14:27:39.694829 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:39.694792 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.207234 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T14:27:39.694823477Z","UUID":"332bb360-fb50-4c0b-bf5b-ec76f0809ed9","Handler":null,"Name":"","Endpoint":""} Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.207412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.207433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.207525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:40.207525 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:40.207678 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:40.208431 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:40.208297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:40.209799 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.209776 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 14:27:40.209928 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.209815 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 14:27:40.323751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:40.323719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" event={"ID":"242131e2-d4b8-4169-87c3-897f36027eab","Type":"ContainerStarted","Data":"c02294835b57912b2e73dd2c26f92b14e42ceddbd72d69b80d22fc2ea9e3584e"} Jul 31 14:27:41.327766 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:41.327685 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" event={"ID":"242131e2-d4b8-4169-87c3-897f36027eab","Type":"ContainerStarted","Data":"cc4ff79d20ea0e09aeec4480cea46b57a94bca67be8512fde756d2eb1a6669dd"} Jul 31 14:27:41.330523 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:41.330502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:27:41.330842 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:41.330823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"230b96e1b02d9c1e1ed1d89c254fd92fe8d7eb0a387c58397aab1f56dceeeed6"} Jul 31 14:27:41.353825 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:41.353776 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wt6q8" podStartSLOduration=2.892657551 podStartE2EDuration="25.353762042s" totalImagesPullingTime="22.461104491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:41.353489798 +0000 UTC m=+25.784978450" watchObservedRunningTime="2026-07-31 14:27:41.353762042 +0000 UTC m=+25.785250721" Jul 31 14:27:41.381785 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:41.381754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:41.382317 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:41.382298 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:42.207986 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:42.207953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:42.208169 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:42.207956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:42.208169 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:42.208093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:42.208169 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:42.208138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:42.208306 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:42.208251 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:42.208363 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:42.208341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:42.334510 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:42.334480 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-548cm" Jul 31 14:27:43.342876 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:43.342846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:27:43.343779 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:43.343298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"e8cfc4750a115f821cad15e59da038e2b23a0cf9294b6bf621ae0abd895823bb"} Jul 31 14:27:43.343779 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:43.343761 2576 scope.go:117] "RemoveContainer" containerID="5d25a8b3a3ae83707fb4f6ebc677cf73bf9d6cc09178b677e4e172847875db07" Jul 31 14:27:44.208074 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.207879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:44.208273 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.207888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:44.208273 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:44.208156 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:44.208273 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.207941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:44.208273 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:44.208224 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:44.208497 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:44.208316 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:44.347009 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.346974 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8c6b89d-e72d-4297-b0b4-0b4193d654e5" containerID="996368d5b0a74afd13dde09abe920ae27a91c17f8cef35630a0931b49418424f" exitCode=0 Jul 31 14:27:44.347414 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.347028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerDied","Data":"996368d5b0a74afd13dde09abe920ae27a91c17f8cef35630a0931b49418424f"} Jul 31 14:27:44.350712 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.350693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:27:44.351091 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.351071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" event={"ID":"ebaaf157-31c1-44e4-8a4a-55469b5f1ded","Type":"ContainerStarted","Data":"af36f5542e97f40f6d6546d67b180a1ce2deeb7b8f3298994c3c5eb6ae960a9f"} Jul 31 14:27:44.351261 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.351248 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:44.351359 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.351343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:44.351430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.351413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:44.366964 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.366940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:44.367242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.367071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:27:44.414314 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:44.414262 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" podStartSLOduration=8.640530666 podStartE2EDuration="28.414245265s" totalImagesPullingTime="19.773714599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:44.413904681 +0000 UTC m=+28.845393333" watchObservedRunningTime="2026-07-31 14:27:44.414245265 +0000 UTC m=+28.845733918" Jul 31 14:27:45.326125 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:45.325890 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-znd7x"] Jul 31 14:27:45.326125 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:45.326078 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:45.326348 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:45.326192 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:45.329754 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:45.329529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q8pk6"] Jul 31 14:27:45.329754 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:45.329674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:45.329961 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:45.329785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:45.330285 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:45.330259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ch4lf"] Jul 31 14:27:45.330395 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:45.330355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:45.330454 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:45.330440 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:46.357179 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:46.357144 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8c6b89d-e72d-4297-b0b4-0b4193d654e5" containerID="68285e830f4c5808b3daa0da3d1eed71033dd6e66184f9803a31fc7d71424698" exitCode=0 Jul 31 14:27:46.357666 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:46.357237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerDied","Data":"68285e830f4c5808b3daa0da3d1eed71033dd6e66184f9803a31fc7d71424698"} Jul 31 14:27:47.207748 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:47.207702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:47.207862 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:47.207806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:47.207940 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:47.207922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:47.207984 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:47.207935 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:47.208102 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:47.208077 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:47.208192 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:47.208171 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:48.364450 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:48.364196 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8c6b89d-e72d-4297-b0b4-0b4193d654e5" containerID="d9745d819be584edffaf529997ba4032aa3e7e56dece996016734c5dde4512c6" exitCode=0 Jul 31 14:27:48.364851 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:48.364278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerDied","Data":"d9745d819be584edffaf529997ba4032aa3e7e56dece996016734c5dde4512c6"} Jul 31 14:27:49.208137 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:49.208103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:49.208305 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:49.208103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:49.208305 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.208235 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:49.208305 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.208268 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:49.208305 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:49.208103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:49.208472 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.208427 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:49.789611 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:49.789555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:49.789682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:49.789720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789720 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789796 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret podName:ceff3d74-d284-4ac1-9b95-2ff4b32a865b nodeName:}" failed. No retries permitted until 2026-07-31 14:28:21.789774197 +0000 UTC m=+66.221262833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret") pod "global-pull-secret-syncer-q8pk6" (UID: "ceff3d74-d284-4ac1-9b95-2ff4b32a865b") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789829 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789848 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789851 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789859 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmkcl for pod openshift-network-diagnostics/network-check-target-ch4lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789900 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:21.789886287 +0000 UTC m=+66.221374916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:27:49.790050 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:49.789914 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl podName:237ca516-0ec7-4fdc-af3e-65d5aca218d8 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:21.789907693 +0000 UTC m=+66.221396323 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmkcl" (UniqueName: "kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl") pod "network-check-target-ch4lf" (UID: "237ca516-0ec7-4fdc-af3e-65d5aca218d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:27:51.207297 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.207264 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:51.207863 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.207264 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:51.207863 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:51.207378 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q8pk6" podUID="ceff3d74-d284-4ac1-9b95-2ff4b32a865b" Jul 31 14:27:51.207863 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.207272 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:51.207863 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:51.207442 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-znd7x" podUID="fc87c6db-643a-48c0-9ea0-b5610e1abad5" Jul 31 14:27:51.207863 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:51.207493 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch4lf" podUID="237ca516-0ec7-4fdc-af3e-65d5aca218d8" Jul 31 14:27:51.861483 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.861456 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeReady" Jul 31 14:27:51.861657 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.861619 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 14:27:51.896887 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.896809 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65f849d975-6jb65"] Jul 31 14:27:51.900361 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.900333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:51.902531 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.902504 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 14:27:51.902683 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.902560 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 14:27:51.902683 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.902608 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zn9xr\"" Jul 31 14:27:51.902985 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.902949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 14:27:51.907693 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.907671 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 14:27:51.908844 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.908823 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fxz7p"] Jul 31 14:27:51.912614 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.912598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:51.914624 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.914609 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6xb2k\"" Jul 31 14:27:51.915059 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.915046 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 14:27:51.916956 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.916941 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 14:27:51.918619 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.918600 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65f849d975-6jb65"] Jul 31 14:27:51.919451 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.919431 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-76gkn"] Jul 31 14:27:51.923309 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.923291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:51.925309 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.925291 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 14:27:51.925452 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.925337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 14:27:51.925452 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.925337 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 14:27:51.925902 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.925748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r9r2w\"" Jul 31 14:27:51.926612 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.926567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fxz7p"] Jul 31 14:27:51.933070 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:51.933050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76gkn"] Jul 31 14:27:52.006459 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e9204d-0f8f-474e-9fb5-913515e77c7c-ca-trust-extracted\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006459 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed80a450-40c5-48a3-adf1-08bc7e79f66d-cert\") pod \"ingress-canary-76gkn\" (UID: \"ed80a450-40c5-48a3-adf1-08bc7e79f66d\") " pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.006647 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74wrs\" (UniqueName: \"kubernetes.io/projected/ed80a450-40c5-48a3-adf1-08bc7e79f66d-kube-api-access-74wrs\") pod \"ingress-canary-76gkn\" (UID: \"ed80a450-40c5-48a3-adf1-08bc7e79f66d\") " pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.006647 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.006725 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-bound-sa-token\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006725 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xtz\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-kube-api-access-s9xtz\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006725 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-installation-pull-secrets\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006725 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgpsf\" (UniqueName: \"kubernetes.io/projected/d80c8832-047f-4d51-b327-cfc865467fab-kube-api-access-fgpsf\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.006841 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006841 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-trusted-ca\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006841 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-image-registry-private-configuration\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.006930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c8832-047f-4d51-b327-cfc865467fab-config-volume\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.006930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d80c8832-047f-4d51-b327-cfc865467fab-tmp-dir\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.006930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.006912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-certificates\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.107839 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.107797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-bound-sa-token\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.107990 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.107845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xtz\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-kube-api-access-s9xtz\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.108060 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-installation-pull-secrets\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.108060 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgpsf\" (UniqueName: \"kubernetes.io/projected/d80c8832-047f-4d51-b327-cfc865467fab-kube-api-access-fgpsf\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.108156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.108156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-trusted-ca\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.108156 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-image-registry-private-configuration\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.108267 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c8832-047f-4d51-b327-cfc865467fab-config-volume\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.108267 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.108180 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:27:52.108267 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.108197 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:27:52.108267 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.108256 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:27:52.608232058 +0000 UTC m=+37.039720710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:27:52.108444 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d80c8832-047f-4d51-b327-cfc865467fab-tmp-dir\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.108444 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d80c8832-047f-4d51-b327-cfc865467fab-tmp-dir\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.109306 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-certificates\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.109306 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.108997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e9204d-0f8f-474e-9fb5-913515e77c7c-ca-trust-extracted\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.109306 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.109039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed80a450-40c5-48a3-adf1-08bc7e79f66d-cert\") pod \"ingress-canary-76gkn\" (UID: \"ed80a450-40c5-48a3-adf1-08bc7e79f66d\") " pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.109306 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.109075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74wrs\" (UniqueName: \"kubernetes.io/projected/ed80a450-40c5-48a3-adf1-08bc7e79f66d-kube-api-access-74wrs\") pod \"ingress-canary-76gkn\" (UID: \"ed80a450-40c5-48a3-adf1-08bc7e79f66d\") " pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.109306 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.109205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.109629 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.109359 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:27:52.109629 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.109425 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:27:52.609408257 +0000 UTC m=+37.040896910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:27:52.109629 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.109479 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d80c8832-047f-4d51-b327-cfc865467fab-config-volume\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.110262 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.109857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-certificates\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.110262 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.109953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-trusted-ca\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.110262 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.110069 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e9204d-0f8f-474e-9fb5-913515e77c7c-ca-trust-extracted\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.114493 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.114465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-image-registry-private-configuration\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.114643 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.114478 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed80a450-40c5-48a3-adf1-08bc7e79f66d-cert\") pod \"ingress-canary-76gkn\" (UID: \"ed80a450-40c5-48a3-adf1-08bc7e79f66d\") " pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.115188 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.115164 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-installation-pull-secrets\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.119316 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.119129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgpsf\" (UniqueName: \"kubernetes.io/projected/d80c8832-047f-4d51-b327-cfc865467fab-kube-api-access-fgpsf\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.119704 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.119671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-bound-sa-token\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.120132 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.120110 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xtz\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-kube-api-access-s9xtz\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.120218 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.120174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74wrs\" (UniqueName: \"kubernetes.io/projected/ed80a450-40c5-48a3-adf1-08bc7e79f66d-kube-api-access-74wrs\") pod \"ingress-canary-76gkn\" (UID: \"ed80a450-40c5-48a3-adf1-08bc7e79f66d\") " pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.231782 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.231670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76gkn" Jul 31 14:27:52.612796 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.612679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:52.612796 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:52.612766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:52.613001 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.612856 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:27:52.613001 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.612921 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:27:52.613001 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.612935 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:27:53.612913951 +0000 UTC m=+38.044402580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:27:52.613001 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.612937 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:27:52.613001 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:52.612974 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:27:53.612964025 +0000 UTC m=+38.044452660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:27:53.208176 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.208138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:27:53.208356 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.208259 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:27:53.208356 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.208290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:27:53.211412 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.211388 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:27:53.211530 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.211428 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkghr\"" Jul 31 14:27:53.211530 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.211488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:27:53.211677 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.211388 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:27:53.211677 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.211603 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tnlz\"" Jul 31 14:27:53.211777 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.211706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:27:53.621516 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.621375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:53.621920 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.621553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:53.621920 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:53.621705 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:27:53.621920 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:53.621721 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:27:53.621920 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:53.621790 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:27:55.621764634 +0000 UTC m=+40.053253286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:27:53.622278 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:53.622253 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:27:53.622388 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:53.622315 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:27:55.622298516 +0000 UTC m=+40.053787152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:27:53.694243 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:53.693923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76gkn"] Jul 31 14:27:53.697759 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:27:53.697731 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded80a450_40c5_48a3_adf1_08bc7e79f66d.slice/crio-e7d62fe79917e73764aa51a7d96132b8b7bd76c8e286b7153331627fee4de6e9 WatchSource:0}: Error finding container e7d62fe79917e73764aa51a7d96132b8b7bd76c8e286b7153331627fee4de6e9: Status 404 returned error can't find the container with id e7d62fe79917e73764aa51a7d96132b8b7bd76c8e286b7153331627fee4de6e9 Jul 31 14:27:54.380064 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:54.380034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76gkn" event={"ID":"ed80a450-40c5-48a3-adf1-08bc7e79f66d","Type":"ContainerStarted","Data":"e7d62fe79917e73764aa51a7d96132b8b7bd76c8e286b7153331627fee4de6e9"} Jul 31 14:27:54.383078 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:54.383046 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8c6b89d-e72d-4297-b0b4-0b4193d654e5" containerID="2a299089c17d656891114037137e221a4b9d34212df12f566578db308a517eb2" exitCode=0 Jul 31 14:27:54.383223 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:54.383113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerDied","Data":"2a299089c17d656891114037137e221a4b9d34212df12f566578db308a517eb2"} Jul 31 14:27:55.389210 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:55.389174 2576 generic.go:356] "Generic (PLEG): container finished" podID="e8c6b89d-e72d-4297-b0b4-0b4193d654e5" containerID="002b6943d2c44d8b5c4234f21987f36a5aef7332193c0905fd7b5b95fdf0c952" exitCode=0 Jul 31 14:27:55.389677 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:55.389247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerDied","Data":"002b6943d2c44d8b5c4234f21987f36a5aef7332193c0905fd7b5b95fdf0c952"} Jul 31 14:27:55.465609 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:55.465559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:55.564057 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:55.564015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:55.638514 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:55.638480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:55.638699 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:55.638536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:55.638699 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:55.638655 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:27:55.638699 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:55.638691 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:27:55.638849 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:55.638711 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:27:55.638849 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:55.638733 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:27:59.638712471 +0000 UTC m=+44.070201102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:27:55.638849 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:55.638774 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:27:59.638754552 +0000 UTC m=+44.070243206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:27:56.395230 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:56.395082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" event={"ID":"e8c6b89d-e72d-4297-b0b4-0b4193d654e5","Type":"ContainerStarted","Data":"3786ad27873d1e0efdd30b3682d23c5ded1974f90e2b0f48856f569319349ed7"} Jul 31 14:27:56.422204 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:56.422154 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2lrnq" podStartSLOduration=8.468194447 podStartE2EDuration="40.422139332s" totalImagesPullingTime="31.953944885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:56.42151061 +0000 UTC m=+40.852999275" watchObservedRunningTime="2026-07-31 14:27:56.422139332 +0000 UTC m=+40.853627984" Jul 31 14:27:56.544790 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:56.544757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:56.643943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:56.643909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:57.398948 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:57.398906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76gkn" event={"ID":"ed80a450-40c5-48a3-adf1-08bc7e79f66d","Type":"ContainerStarted","Data":"3ac515ef420ac16c6f7f843ce9d59e135bf72afc599c1444629f551a320c5a63"} Jul 31 14:27:57.416737 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:57.416690 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-76gkn" podStartSLOduration=3.6612278639999998 podStartE2EDuration="6.416675198s" totalImagesPullingTime="2.755447334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:27:57.416229015 +0000 UTC m=+41.847717667" watchObservedRunningTime="2026-07-31 14:27:57.416675198 +0000 UTC m=+41.848163868" Jul 31 14:27:59.543628 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:59.543565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:59.644294 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:59.644257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:59.669351 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:59.669327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:27:59.669421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:59.669374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:27:59.669487 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:59.669478 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:27:59.669533 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:59.669489 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:27:59.669533 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:59.669487 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:27:59.669627 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:59.669540 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:28:07.669526627 +0000 UTC m=+52.101015262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:27:59.669627 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:27:59.669551 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:28:07.669546054 +0000 UTC m=+52.101034684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:27:59.744413 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:59.744381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:27:59.801802 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:27:59.801726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:01.615028 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:01.614996 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:01.693427 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:01.693391 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:01.866045 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:01.865963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:01.980932 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:01.980902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:07.729469 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:07.729437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:28:07.729864 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:07.729485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:28:07.729864 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:07.729607 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:28:07.729864 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:07.729674 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:28:23.72965839 +0000 UTC m=+68.161147019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:28:07.729864 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:07.729616 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:28:07.729864 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:07.729709 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:28:07.729864 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:07.729751 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:28:23.729739569 +0000 UTC m=+68.161228198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:28:16.370791 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:16.370764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mttx" Jul 31 14:28:16.524565 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:16.524529 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:16.576655 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:16.576622 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:18.010421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.010387 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:18.032757 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.032729 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh"] Jul 31 14:28:18.035051 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.035035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.036976 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.036957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:28:18.037177 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.037163 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 31 14:28:18.037560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.037544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 31 14:28:18.037634 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.037589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wx8wd\"" Jul 31 14:28:18.043965 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.043942 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh"] Jul 31 14:28:18.079942 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.079915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:18.107317 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.107287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.107420 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.107345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdxz\" (UniqueName: \"kubernetes.io/projected/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-kube-api-access-gfdxz\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.208133 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.208094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdxz\" (UniqueName: \"kubernetes.io/projected/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-kube-api-access-gfdxz\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.208255 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.208219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.208377 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:18.208354 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:28:18.208452 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:18.208441 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls podName:2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:18.708421084 +0000 UTC m=+63.139909720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fwlzh" (UID: "2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10") : secret "samples-operator-tls" not found Jul 31 14:28:18.217663 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.217638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdxz\" (UniqueName: \"kubernetes.io/projected/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-kube-api-access-gfdxz\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.712398 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:18.712353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:18.712607 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:18.712510 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:28:18.712670 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:18.712611 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls podName:2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:19.712573727 +0000 UTC m=+64.144062357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fwlzh" (UID: "2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10") : secret "samples-operator-tls" not found Jul 31 14:28:19.720879 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:19.720832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:19.721279 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:19.720956 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:28:19.721279 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:19.721020 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls podName:2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:21.721005346 +0000 UTC m=+66.152493976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fwlzh" (UID: "2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10") : secret "samples-operator-tls" not found Jul 31 14:28:21.736095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.736046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:21.736476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:21.736220 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:28:21.736476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:21.736295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls podName:2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:25.73627705 +0000 UTC m=+70.167765701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fwlzh" (UID: "2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10") : secret "samples-operator-tls" not found Jul 31 14:28:21.837090 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.837050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:28:21.837276 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.837108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:28:21.837276 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.837156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:28:21.839735 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.839716 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:28:21.840000 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.839986 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:28:21.840052 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.840030 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:28:21.847702 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:21.847674 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 14:28:21.847786 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:21.847742 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs podName:fc87c6db-643a-48c0-9ea0-b5610e1abad5 nodeName:}" failed. No retries permitted until 2026-07-31 14:29:25.8477247 +0000 UTC m=+130.279213329 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs") pod "network-metrics-daemon-znd7x" (UID: "fc87c6db-643a-48c0-9ea0-b5610e1abad5") : secret "metrics-daemon-secret" not found Jul 31 14:28:21.849862 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.849839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ceff3d74-d284-4ac1-9b95-2ff4b32a865b-original-pull-secret\") pod \"global-pull-secret-syncer-q8pk6\" (UID: \"ceff3d74-d284-4ac1-9b95-2ff4b32a865b\") " pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:28:21.851668 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.851648 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:28:21.860815 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:21.860788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmkcl\" (UniqueName: \"kubernetes.io/projected/237ca516-0ec7-4fdc-af3e-65d5aca218d8-kube-api-access-kmkcl\") pod \"network-check-target-ch4lf\" (UID: \"237ca516-0ec7-4fdc-af3e-65d5aca218d8\") " pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:28:22.023322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.023293 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkghr\"" Jul 31 14:28:22.029105 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.029087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q8pk6" Jul 31 14:28:22.031979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.031961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:28:22.175309 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.175272 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ch4lf"] Jul 31 14:28:22.178780 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:22.178753 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237ca516_0ec7_4fdc_af3e_65d5aca218d8.slice/crio-5dfd00b085483ff19d97364343f08820739e3bfe618db51f89f7982f100e5fa0 WatchSource:0}: Error finding container 5dfd00b085483ff19d97364343f08820739e3bfe618db51f89f7982f100e5fa0: Status 404 returned error can't find the container with id 5dfd00b085483ff19d97364343f08820739e3bfe618db51f89f7982f100e5fa0 Jul 31 14:28:22.188810 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.188787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q8pk6"] Jul 31 14:28:22.193948 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:22.193926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceff3d74_d284_4ac1_9b95_2ff4b32a865b.slice/crio-3e1d014045c3920e50c1c6b48499e70dfdf0de67cd118324810e996375c905e1 WatchSource:0}: Error finding container 3e1d014045c3920e50c1c6b48499e70dfdf0de67cd118324810e996375c905e1: Status 404 returned error can't find the container with id 3e1d014045c3920e50c1c6b48499e70dfdf0de67cd118324810e996375c905e1 Jul 31 14:28:22.456297 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.456195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ch4lf" event={"ID":"237ca516-0ec7-4fdc-af3e-65d5aca218d8","Type":"ContainerStarted","Data":"5dfd00b085483ff19d97364343f08820739e3bfe618db51f89f7982f100e5fa0"} Jul 31 14:28:22.457205 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.457183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q8pk6" event={"ID":"ceff3d74-d284-4ac1-9b95-2ff4b32a865b","Type":"ContainerStarted","Data":"3e1d014045c3920e50c1c6b48499e70dfdf0de67cd118324810e996375c905e1"} Jul 31 14:28:22.743484 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.743401 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cgj5h"] Jul 31 14:28:22.745382 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.745357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.747377 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.747352 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 14:28:22.747377 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.747359 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xj6w4\"" Jul 31 14:28:22.747525 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.747475 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 14:28:22.747797 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.747780 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 14:28:22.747988 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.747975 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 14:28:22.751966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.751946 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:22.761242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.761218 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cgj5h"] Jul 31 14:28:22.837487 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.837454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:22.844623 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.844589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56cb39d3-3f85-477b-a8e9-137308ba922e-crio-socket\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.844781 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.844655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56cb39d3-3f85-477b-a8e9-137308ba922e-data-volume\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.844781 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.844694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.844781 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.844756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.844940 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.844786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thl6t\" (UniqueName: \"kubernetes.io/projected/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-api-access-thl6t\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946171 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946346 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946346 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl6t\" (UniqueName: \"kubernetes.io/projected/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-api-access-thl6t\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946346 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:22.946289 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:28:22.946505 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:22.946365 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:23.446343375 +0000 UTC m=+67.877832005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : secret "insights-runtime-extractor-tls" not found Jul 31 14:28:22.946505 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:22.946372 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:28:22.946505 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:22.946452 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:23.446434534 +0000 UTC m=+67.877923195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : configmap "kube-rbac-proxy" not found Jul 31 14:28:22.946505 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56cb39d3-3f85-477b-a8e9-137308ba922e-crio-socket\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946732 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56cb39d3-3f85-477b-a8e9-137308ba922e-data-volume\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946732 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56cb39d3-3f85-477b-a8e9-137308ba922e-crio-socket\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.946918 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.946899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56cb39d3-3f85-477b-a8e9-137308ba922e-data-volume\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:22.956206 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:22.956175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thl6t\" (UniqueName: \"kubernetes.io/projected/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-api-access-thl6t\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:23.452053 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.452011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:23.452249 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.452105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:23.452249 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.452178 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:28:23.452249 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.452205 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:28:23.452414 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.452270 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:24.452248901 +0000 UTC m=+68.883737553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : secret "insights-runtime-extractor-tls" not found Jul 31 14:28:23.452414 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.452293 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:24.452283318 +0000 UTC m=+68.883771948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : configmap "kube-rbac-proxy" not found Jul 31 14:28:23.755008 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.754969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:28:23.755476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.755034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:28:23.755476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.755140 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:28:23.755476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.755219 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls podName:d80c8832-047f-4d51-b327-cfc865467fab nodeName:}" failed. No retries permitted until 2026-07-31 14:28:55.755201054 +0000 UTC m=+100.186689706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls") pod "dns-default-fxz7p" (UID: "d80c8832-047f-4d51-b327-cfc865467fab") : secret "dns-default-metrics-tls" not found Jul 31 14:28:23.755476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.755143 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:28:23.755476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.755273 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65f849d975-6jb65: secret "image-registry-tls" not found Jul 31 14:28:23.755476 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:23.755318 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls podName:b1e9204d-0f8f-474e-9fb5-913515e77c7c nodeName:}" failed. No retries permitted until 2026-07-31 14:28:55.755304757 +0000 UTC m=+100.186793405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls") pod "image-registry-65f849d975-6jb65" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c") : secret "image-registry-tls" not found Jul 31 14:28:23.831618 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.831559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:23.858138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.858104 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6"] Jul 31 14:28:23.877351 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.877318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6"] Jul 31 14:28:23.877517 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.877454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" Jul 31 14:28:23.880458 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.880398 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 31 14:28:23.880570 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.880460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wsrrh\"" Jul 31 14:28:23.880570 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.880400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 31 14:28:23.920818 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.920782 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:23.956390 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:23.956325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcnm\" (UniqueName: \"kubernetes.io/projected/5114df71-aa87-4f23-b900-5250e110847c-kube-api-access-fkcnm\") pod \"migrator-68bc745d87-7z2c6\" (UID: \"5114df71-aa87-4f23-b900-5250e110847c\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" Jul 31 14:28:24.020294 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.020214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:24.057292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.057258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcnm\" (UniqueName: \"kubernetes.io/projected/5114df71-aa87-4f23-b900-5250e110847c-kube-api-access-fkcnm\") pod \"migrator-68bc745d87-7z2c6\" (UID: \"5114df71-aa87-4f23-b900-5250e110847c\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" Jul 31 14:28:24.065910 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.065875 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcnm\" (UniqueName: \"kubernetes.io/projected/5114df71-aa87-4f23-b900-5250e110847c-kube-api-access-fkcnm\") pod \"migrator-68bc745d87-7z2c6\" (UID: \"5114df71-aa87-4f23-b900-5250e110847c\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" Jul 31 14:28:24.189245 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.189142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" Jul 31 14:28:24.316661 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.316537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:24.416299 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.416264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:24.460804 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.460767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:24.460987 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.460895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:24.460987 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:24.460901 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:28:24.460987 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:24.460969 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:26.460950438 +0000 UTC m=+70.892439085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : configmap "kube-rbac-proxy" not found Jul 31 14:28:24.461143 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:24.460998 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:28:24.461143 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:24.461032 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:26.461022371 +0000 UTC m=+70.892511001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : secret "insights-runtime-extractor-tls" not found Jul 31 14:28:24.591150 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.591066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:24.660202 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.660138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5ngl_e9ad072d-0dc7-4dfd-a829-05c30d32b6aa/dns-node-resolver/0.log" Jul 31 14:28:24.693136 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:24.693103 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:25.459587 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:25.459557 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcflc_af335670-24e5-41c3-8eb3-5f81c629018f/node-ca/0.log" Jul 31 14:28:25.771013 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:25.770974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:25.771213 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:25.771147 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:28:25.771282 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:25.771221 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls podName:2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10 nodeName:}" failed. No retries permitted until 2026-07-31 14:28:33.771204962 +0000 UTC m=+78.202693592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fwlzh" (UID: "2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10") : secret "samples-operator-tls" not found Jul 31 14:28:26.259752 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:26.259703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76gkn_ed80a450-40c5-48a3-adf1-08bc7e79f66d/serve-healthcheck-canary/0.log" Jul 31 14:28:26.267773 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:26.267718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:26.346308 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:26.346275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:26.475632 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:26.475596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:26.476097 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:26.475674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:26.476097 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:26.475696 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:28:26.476097 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:26.475761 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:30.475739635 +0000 UTC m=+74.907228288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : secret "insights-runtime-extractor-tls" not found Jul 31 14:28:26.476097 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:26.475777 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:28:26.476097 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:26.475813 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:30.475802225 +0000 UTC m=+74.907290855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : configmap "kube-rbac-proxy" not found Jul 31 14:28:26.639586 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:26.639548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6"] Jul 31 14:28:26.643205 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:26.643180 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5114df71_aa87_4f23_b900_5250e110847c.slice/crio-7b2b411d63558ef92c5e63c124ed439790cf8bd0152afea7074a7a390b3d893e WatchSource:0}: Error finding container 7b2b411d63558ef92c5e63c124ed439790cf8bd0152afea7074a7a390b3d893e: Status 404 returned error can't find the container with id 7b2b411d63558ef92c5e63c124ed439790cf8bd0152afea7074a7a390b3d893e Jul 31 14:28:27.126632 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.126597 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:27.465237 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.465152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:27.471837 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.471808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ch4lf" event={"ID":"237ca516-0ec7-4fdc-af3e-65d5aca218d8","Type":"ContainerStarted","Data":"89ad88e4d0bd985049e4c73016b24c8a4c48a93c0176793e53bcc40110509536"} Jul 31 14:28:27.472002 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.471913 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:28:27.473474 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.473452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q8pk6" event={"ID":"ceff3d74-d284-4ac1-9b95-2ff4b32a865b","Type":"ContainerStarted","Data":"c1a636153814266a357dbc6db4b48043df205d572dd8602709a0adc2977e819f"} Jul 31 14:28:27.474472 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.474453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" event={"ID":"5114df71-aa87-4f23-b900-5250e110847c","Type":"ContainerStarted","Data":"7b2b411d63558ef92c5e63c124ed439790cf8bd0152afea7074a7a390b3d893e"} Jul 31 14:28:27.499247 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.499199 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ch4lf" podStartSLOduration=67.158125421 podStartE2EDuration="1m11.499183025s" totalImagesPullingTime="4.341057604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:27.49719871 +0000 UTC m=+71.928687364" watchObservedRunningTime="2026-07-31 14:28:27.499183025 +0000 UTC m=+71.930671654" Jul 31 14:28:27.519514 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.519458 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q8pk6" podStartSLOduration=67.183913576 podStartE2EDuration="1m11.519438003s" totalImagesPullingTime="4.335524427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:27.517637931 +0000 UTC m=+71.949126583" watchObservedRunningTime="2026-07-31 14:28:27.519438003 +0000 UTC m=+71.950926709" Jul 31 14:28:27.570356 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.570321 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:27.731907 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.731835 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:27.831494 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.831468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:27.931521 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:27.931490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:28.155633 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:28.155557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:28.479220 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:28.479132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" event={"ID":"5114df71-aa87-4f23-b900-5250e110847c","Type":"ContainerStarted","Data":"e0ea21f6f2604eac223f258b6f25f0cc09c27ee60085e315f2cd3ad1b241e106"} Jul 31 14:28:28.479220 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:28.479184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" event={"ID":"5114df71-aa87-4f23-b900-5250e110847c","Type":"ContainerStarted","Data":"6407ba53453a458666bc6af8634cc785cf3290227b4d789867cbe29f321c31f4"} Jul 31 14:28:28.499877 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:28.499834 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7z2c6" podStartSLOduration=4.399240346 podStartE2EDuration="5.499818851s" totalImagesPullingTime="1.100578505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:28.499686411 +0000 UTC m=+72.931175064" watchObservedRunningTime="2026-07-31 14:28:28.499818851 +0000 UTC m=+72.931307503" Jul 31 14:28:28.929975 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:28.929942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:29.525749 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:29.525720 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:29.726528 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:29.726496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:29.828442 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:29.828382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:30.136376 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:30.136298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:30.335693 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:30.335662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:30.511484 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:30.511454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:30.511687 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:30.511533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:30.511687 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:30.511606 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:28:30.511687 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:30.511649 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:28:30.511856 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:30.511697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:38.511675031 +0000 UTC m=+82.943163675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : configmap "kube-rbac-proxy" not found Jul 31 14:28:30.511856 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:28:30.511717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls podName:56cb39d3-3f85-477b-a8e9-137308ba922e nodeName:}" failed. No retries permitted until 2026-07-31 14:28:38.511706897 +0000 UTC m=+82.943195527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgj5h" (UID: "56cb39d3-3f85-477b-a8e9-137308ba922e") : secret "insights-runtime-extractor-tls" not found Jul 31 14:28:30.735941 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:30.735909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:30.805381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:30.805311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:31.108648 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:31.108563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:31.243332 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:31.243301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:31.344485 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:31.344451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:31.526613 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:31.526572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:32.141553 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:32.141519 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:32.229789 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:32.229760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:32.726535 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:32.726502 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:32.933849 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:32.933806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:33.333706 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:33.333672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:33.533175 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:33.533145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:33.835992 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:33.835959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:33.838307 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:33.838287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fwlzh\" (UID: \"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:33.944016 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:33.943980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" Jul 31 14:28:34.066400 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:34.066368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh"] Jul 31 14:28:34.139395 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:34.139365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:34.447375 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:34.447294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:34.498447 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:34.498417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" event={"ID":"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10","Type":"ContainerStarted","Data":"f79f5a6249489cbb7cfe2c0a9f7e4e4546efb5985b608739c8c805e95729a440"} Jul 31 14:28:34.793450 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:34.793401 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:34.941147 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:34.941117 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:35.140023 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:35.139945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:35.326617 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:35.326567 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:35.872113 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:35.872082 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:36.328147 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:36.328115 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:36.507050 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:36.507011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" event={"ID":"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10","Type":"ContainerStarted","Data":"1f3194cd9900ff2552623c54e798519cc26ee3efcecea2849e7499dd5319eaf7"} Jul 31 14:28:36.507254 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:36.507068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" event={"ID":"2bd3a9aa-6b6a-45ab-85bc-c121ffdb9d10","Type":"ContainerStarted","Data":"4122892149e218d6d358f97c498ce280be75a73dd0369ef3d776ce52ef8073a4"} Jul 31 14:28:36.524318 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:36.524267 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fwlzh" podStartSLOduration=16.931448124 podStartE2EDuration="18.524252735s" totalImagesPullingTime="1.592804611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:36.524078151 +0000 UTC m=+80.955566804" watchObservedRunningTime="2026-07-31 14:28:36.524252735 +0000 UTC m=+80.955741421" Jul 31 14:28:36.731784 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:36.731698 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:36.941523 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:36.941494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:37.147222 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:37.147188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:37.543184 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:37.543156 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:37.938911 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:37.938833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:38.133955 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.133921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:38.573260 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.573220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:38.573430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.573313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:38.573773 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.573752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56cb39d3-3f85-477b-a8e9-137308ba922e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:38.575539 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.575523 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56cb39d3-3f85-477b-a8e9-137308ba922e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgj5h\" (UID: \"56cb39d3-3f85-477b-a8e9-137308ba922e\") " pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:38.655456 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.655408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cgj5h" Jul 31 14:28:38.784458 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:38.784429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cgj5h"] Jul 31 14:28:38.787528 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:38.787506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cb39d3_3f85_477b_a8e9_137308ba922e.slice/crio-617530c1d399aec12e97287bb6a75a4551de0da0bed80c6406094422316e7aaa WatchSource:0}: Error finding container 617530c1d399aec12e97287bb6a75a4551de0da0bed80c6406094422316e7aaa: Status 404 returned error can't find the container with id 617530c1d399aec12e97287bb6a75a4551de0da0bed80c6406094422316e7aaa Jul 31 14:28:39.130095 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:39.130018 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:39.521116 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:39.521090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgj5h" event={"ID":"56cb39d3-3f85-477b-a8e9-137308ba922e","Type":"ContainerStarted","Data":"9006f895a8fc9843c06132a67098372053a7df7f93043939bc8ae0dd1e317e5e"} Jul 31 14:28:39.521388 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:39.521169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgj5h" event={"ID":"56cb39d3-3f85-477b-a8e9-137308ba922e","Type":"ContainerStarted","Data":"617530c1d399aec12e97287bb6a75a4551de0da0bed80c6406094422316e7aaa"} Jul 31 14:28:40.526818 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:40.526784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgj5h" event={"ID":"56cb39d3-3f85-477b-a8e9-137308ba922e","Type":"ContainerStarted","Data":"74b0c317c0026b76d50fe05864ffe708f8041a8688717226eee05d5ec63f594e"} Jul 31 14:28:41.531880 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:41.531838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgj5h" event={"ID":"56cb39d3-3f85-477b-a8e9-137308ba922e","Type":"ContainerStarted","Data":"12fea9772f8228693419fe9cea3d03d4020c364692a53439a0a7d3120f36bba5"} Jul 31 14:28:41.551235 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:41.551190 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cgj5h" podStartSLOduration=17.699536999 podStartE2EDuration="19.551175664s" totalImagesPullingTime="1.851638665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:28:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:41.550233755 +0000 UTC m=+85.981722420" watchObservedRunningTime="2026-07-31 14:28:41.551175664 +0000 UTC m=+85.982664315" Jul 31 14:28:44.546676 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:44.546645 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:44.614277 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:44.614245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:47.275979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:47.275937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:47.424381 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:47.424348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:49.005942 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:49.005907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:49.073902 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:49.073876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:52.148474 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.148437 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:52.244883 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.244849 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:52.315809 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.315768 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777"] Jul 31 14:28:52.319896 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.319873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:52.322048 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.322026 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fkdnm\"" Jul 31 14:28:52.322171 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.322066 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 31 14:28:52.326802 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.326771 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777"] Jul 31 14:28:52.332818 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.332799 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:52.404154 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.404071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:52.476504 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.476458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/219e520a-3b03-4cb6-9754-8ac10cd668b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-qn777\" (UID: \"219e520a-3b03-4cb6-9754-8ac10cd668b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:52.577328 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.577294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/219e520a-3b03-4cb6-9754-8ac10cd668b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-qn777\" (UID: \"219e520a-3b03-4cb6-9754-8ac10cd668b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:52.579666 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.579644 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/219e520a-3b03-4cb6-9754-8ac10cd668b1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-qn777\" (UID: \"219e520a-3b03-4cb6-9754-8ac10cd668b1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:52.628625 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.628572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:52.750129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:52.750095 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777"] Jul 31 14:28:52.754773 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:52.754745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219e520a_3b03_4cb6_9754_8ac10cd668b1.slice/crio-edf743b6375c65fbc8bdb4e322371f6c1ac36d8bc21d9cb6f216d7c0d700c22a WatchSource:0}: Error finding container edf743b6375c65fbc8bdb4e322371f6c1ac36d8bc21d9cb6f216d7c0d700c22a: Status 404 returned error can't find the container with id edf743b6375c65fbc8bdb4e322371f6c1ac36d8bc21d9cb6f216d7c0d700c22a Jul 31 14:28:53.569834 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:53.569793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" event={"ID":"219e520a-3b03-4cb6-9754-8ac10cd668b1","Type":"ContainerStarted","Data":"edf743b6375c65fbc8bdb4e322371f6c1ac36d8bc21d9cb6f216d7c0d700c22a"} Jul 31 14:28:54.574325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:54.574291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" event={"ID":"219e520a-3b03-4cb6-9754-8ac10cd668b1","Type":"ContainerStarted","Data":"5d57259fc8beb431c6073261e3ce0e8aaca60657af37b813a2fe238b1448dff0"} Jul 31 14:28:54.574702 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:54.574488 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:54.579107 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:54.579087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" Jul 31 14:28:54.592091 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:54.592046 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-qn777" podStartSLOduration=1.380674872 podStartE2EDuration="2.592034237s" totalImagesPullingTime="1.211359365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:54.592031137 +0000 UTC m=+99.023519790" watchObservedRunningTime="2026-07-31 14:28:54.592034237 +0000 UTC m=+99.023522890" Jul 31 14:28:55.354236 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.354203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:55.445492 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.445462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:55.579921 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.579891 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:55.800993 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.800946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:28:55.801175 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.801052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:28:55.803768 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.803718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80c8832-047f-4d51-b327-cfc865467fab-metrics-tls\") pod \"dns-default-fxz7p\" (UID: \"d80c8832-047f-4d51-b327-cfc865467fab\") " pod="openshift-dns/dns-default-fxz7p" Jul 31 14:28:55.803886 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.803776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"image-registry-65f849d975-6jb65\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:28:55.812924 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.812909 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zn9xr\"" Jul 31 14:28:55.821587 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.821555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:28:55.823964 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.823948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6xb2k\"" Jul 31 14:28:55.832636 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.832615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fxz7p" Jul 31 14:28:55.960692 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.960647 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65f849d975-6jb65"] Jul 31 14:28:55.964956 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:55.964929 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e9204d_0f8f_474e_9fb5_913515e77c7c.slice/crio-07893b4a64e2bc8836ad27247eda94e11ebb38853877aab5642008237f0a6d9a WatchSource:0}: Error finding container 07893b4a64e2bc8836ad27247eda94e11ebb38853877aab5642008237f0a6d9a: Status 404 returned error can't find the container with id 07893b4a64e2bc8836ad27247eda94e11ebb38853877aab5642008237f0a6d9a Jul 31 14:28:55.978439 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:55.978414 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fxz7p"] Jul 31 14:28:55.981477 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:28:55.981446 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80c8832_047f_4d51_b327_cfc865467fab.slice/crio-689aff066663f341729d277ee63cd00faf895a864b7338ee78431cc6a3eab992 WatchSource:0}: Error finding container 689aff066663f341729d277ee63cd00faf895a864b7338ee78431cc6a3eab992: Status 404 returned error can't find the container with id 689aff066663f341729d277ee63cd00faf895a864b7338ee78431cc6a3eab992 Jul 31 14:28:56.581496 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:56.581454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxz7p" event={"ID":"d80c8832-047f-4d51-b327-cfc865467fab","Type":"ContainerStarted","Data":"689aff066663f341729d277ee63cd00faf895a864b7338ee78431cc6a3eab992"} Jul 31 14:28:56.583177 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:56.583150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f849d975-6jb65" event={"ID":"b1e9204d-0f8f-474e-9fb5-913515e77c7c","Type":"ContainerStarted","Data":"adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832"} Jul 31 14:28:56.583315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:56.583202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f849d975-6jb65" event={"ID":"b1e9204d-0f8f-474e-9fb5-913515e77c7c","Type":"ContainerStarted","Data":"07893b4a64e2bc8836ad27247eda94e11ebb38853877aab5642008237f0a6d9a"} Jul 31 14:28:57.586711 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:57.586675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:28:57.647830 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:57.647791 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:58.481510 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:58.481462 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ch4lf" Jul 31 14:28:58.499193 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:58.499141 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65f849d975-6jb65" podStartSLOduration=102.499126013 podStartE2EDuration="1m42.499126013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:56.603608391 +0000 UTC m=+101.035097037" watchObservedRunningTime="2026-07-31 14:28:58.499126013 +0000 UTC m=+102.930614665" Jul 31 14:28:58.591679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:58.591642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxz7p" event={"ID":"d80c8832-047f-4d51-b327-cfc865467fab","Type":"ContainerStarted","Data":"bc9e086d07959062b0bfd6ce2a9435c0c2d068d7d8260066d0bb1e45128c7d4a"} Jul 31 14:28:58.592275 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:58.591786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fxz7p" Jul 31 14:28:58.592275 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:58.591833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxz7p" event={"ID":"d80c8832-047f-4d51-b327-cfc865467fab","Type":"ContainerStarted","Data":"56a388397bff318bd6568a18b1eec97e414c40a1e9dc82d8a9c638e56c4ccdc9"} Jul 31 14:28:58.608973 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:58.608890 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fxz7p" podStartSLOduration=65.503724587 podStartE2EDuration="1m7.608874276s" totalImagesPullingTime="2.105149689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:28:58.607814661 +0000 UTC m=+103.039303330" watchObservedRunningTime="2026-07-31 14:28:58.608874276 +0000 UTC m=+103.040362970" Jul 31 14:28:59.505905 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.505873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:59.741314 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.741282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:59.795723 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.795643 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2fjp"] Jul 31 14:28:59.813181 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.813160 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs"] Jul 31 14:28:59.813283 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.813262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.815645 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.815610 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-98s8b\"" Jul 31 14:28:59.815845 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.815817 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 14:28:59.816048 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.815864 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 14:28:59.816130 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.816088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 14:28:59.816250 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.816228 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 14:28:59.816321 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.815897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 14:28:59.816539 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.816523 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 14:28:59.839382 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.839358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs"] Jul 31 14:28:59.839486 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.839455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.842276 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.842259 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6xwcc\"" Jul 31 14:28:59.842505 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.842488 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 31 14:28:59.842555 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.842543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 31 14:28:59.842686 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.842591 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 31 14:28:59.867072 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.867044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:28:59.932935 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.932899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.933101 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.932935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-textfile\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933101 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.932983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-sys\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933101 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef7b812-e779-44d0-b06b-fcee33821a52-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.933101 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzzm\" (UniqueName: \"kubernetes.io/projected/fef7b812-e779-44d0-b06b-fcee33821a52-kube-api-access-pqzzm\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.933101 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-metrics-client-ca\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933334 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fef7b812-e779-44d0-b06b-fcee33821a52-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.933334 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933334 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.933334 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-wtmp\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933334 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-root\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933334 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933539 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-tls\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933539 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvts8\" (UniqueName: \"kubernetes.io/projected/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-kube-api-access-qvts8\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:28:59.933539 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.933396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:28:59.955237 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:28:59.955211 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:00.034609 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-wtmp\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034609 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-root\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-root\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-tls\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvts8\" (UniqueName: \"kubernetes.io/projected/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-kube-api-access-qvts8\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034725 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-wtmp\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.034788 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-textfile\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-sys\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef7b812-e779-44d0-b06b-fcee33821a52-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.034986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzzm\" (UniqueName: \"kubernetes.io/projected/fef7b812-e779-44d0-b06b-fcee33821a52-kube-api-access-pqzzm\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035039 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-sys\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-metrics-client-ca\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fef7b812-e779-44d0-b06b-fcee33821a52-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035138 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035609 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035609 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035234 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-textfile\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035713 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035713 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035648 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fef7b812-e779-44d0-b06b-fcee33821a52-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.035895 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.035997 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.035943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef7b812-e779-44d0-b06b-fcee33821a52-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.036189 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.036163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-metrics-client-ca\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.037318 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.037290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-tls\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.037427 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.037401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.037624 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.037602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.037992 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.037971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef7b812-e779-44d0-b06b-fcee33821a52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.042318 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.042298 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvts8\" (UniqueName: \"kubernetes.io/projected/b5ba8c40-8253-40c4-8cd6-3ed964b580b9-kube-api-access-qvts8\") pod \"node-exporter-z2fjp\" (UID: \"b5ba8c40-8253-40c4-8cd6-3ed964b580b9\") " pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.042719 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.042700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzzm\" (UniqueName: \"kubernetes.io/projected/fef7b812-e779-44d0-b06b-fcee33821a52-kube-api-access-pqzzm\") pod \"kube-state-metrics-6bd9664c4-5khgs\" (UID: \"fef7b812-e779-44d0-b06b-fcee33821a52\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.123812 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.123733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2fjp" Jul 31 14:29:00.147258 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.147233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" Jul 31 14:29:00.154162 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:29:00.154135 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ba8c40_8253_40c4_8cd6_3ed964b580b9.slice/crio-fa8b64d46f9ec994072e90b10ee6a1e081d8e6d2cb735072a043011903fb2388 WatchSource:0}: Error finding container fa8b64d46f9ec994072e90b10ee6a1e081d8e6d2cb735072a043011903fb2388: Status 404 returned error can't find the container with id fa8b64d46f9ec994072e90b10ee6a1e081d8e6d2cb735072a043011903fb2388 Jul 31 14:29:00.186963 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.186934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:00.283132 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.283101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:00.290880 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.290857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs"] Jul 31 14:29:00.293891 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:29:00.293871 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef7b812_e779_44d0_b06b_fcee33821a52.slice/crio-b01a17e75f11766b11e8a2ce76c957b14beb1c425c6d43d1464c063d076d3c43 WatchSource:0}: Error finding container b01a17e75f11766b11e8a2ce76c957b14beb1c425c6d43d1464c063d076d3c43: Status 404 returned error can't find the container with id b01a17e75f11766b11e8a2ce76c957b14beb1c425c6d43d1464c063d076d3c43 Jul 31 14:29:00.385087 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.385003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:00.600869 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.600828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" event={"ID":"fef7b812-e779-44d0-b06b-fcee33821a52","Type":"ContainerStarted","Data":"b01a17e75f11766b11e8a2ce76c957b14beb1c425c6d43d1464c063d076d3c43"} Jul 31 14:29:00.601899 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.601871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fjp" event={"ID":"b5ba8c40-8253-40c4-8cd6-3ed964b580b9","Type":"ContainerStarted","Data":"fa8b64d46f9ec994072e90b10ee6a1e081d8e6d2cb735072a043011903fb2388"} Jul 31 14:29:00.753477 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.753443 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:00.856725 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.856692 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:00.866586 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.866556 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:29:00.869536 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.869519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:00.874321 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 14:29:00.874430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 14:29:00.874430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 14:29:00.874430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 14:29:00.874769 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874750 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hkwg9\"" Jul 31 14:29:00.874769 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 14:29:00.874901 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874833 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 14:29:00.874901 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.874867 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 14:29:00.875363 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.875315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 14:29:00.882897 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.882880 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 14:29:00.898040 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:00.898019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:29:01.042698 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-web-config\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042698 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtckr\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-kube-api-access-mtckr\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042698 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.042930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-config-volume\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.043209 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.043209 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.042984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.043209 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.043019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.043209 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.043060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-config-out\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.143930 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.143889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.143944 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.143977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-config-out\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-web-config\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtckr\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-kube-api-access-mtckr\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144319 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144319 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144319 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144319 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144319 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-config-volume\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.144319 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.144248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.145770 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.145740 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.145900 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.145766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.146032 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.146007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.147071 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.146996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-web-config\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.147874 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.147851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-config-out\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.148553 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.148292 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.148553 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.148310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.148707 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.148593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.148949 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.148927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.149062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.149041 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.149386 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.149366 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.149918 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.149900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-config-volume\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.153561 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.153543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtckr\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-kube-api-access-mtckr\") pod \"alertmanager-main-0\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.166701 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.166679 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:01.179663 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.179640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:29:01.339047 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:01.338963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:29:01.604777 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:29:01.604713 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba18153_1b98_438f_9264_88b19ab6fa86.slice/crio-d9881409ddc417910e80d3bf9e7add21f789af6a0ddb0421649712cec375e4b1 WatchSource:0}: Error finding container d9881409ddc417910e80d3bf9e7add21f789af6a0ddb0421649712cec375e4b1: Status 404 returned error can't find the container with id d9881409ddc417910e80d3bf9e7add21f789af6a0ddb0421649712cec375e4b1 Jul 31 14:29:02.611012 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.610976 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ba8c40-8253-40c4-8cd6-3ed964b580b9" containerID="4576bcff3d9e65efbab5f80194d3a5e56f0b6509e40bb4c8282dce9dfcde38ea" exitCode=0 Jul 31 14:29:02.611464 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.611078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fjp" event={"ID":"b5ba8c40-8253-40c4-8cd6-3ed964b580b9","Type":"ContainerDied","Data":"4576bcff3d9e65efbab5f80194d3a5e56f0b6509e40bb4c8282dce9dfcde38ea"} Jul 31 14:29:02.612477 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.612446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"d9881409ddc417910e80d3bf9e7add21f789af6a0ddb0421649712cec375e4b1"} Jul 31 14:29:02.614782 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.614756 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" event={"ID":"fef7b812-e779-44d0-b06b-fcee33821a52","Type":"ContainerStarted","Data":"95d6c11150962de70adc3488ff473842b866aa4beec34d5a76984d95abd958a7"} Jul 31 14:29:02.614898 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.614856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" event={"ID":"fef7b812-e779-44d0-b06b-fcee33821a52","Type":"ContainerStarted","Data":"5a21b58054e1ede7c256d6991f000d995723e8c44944c93e1a2e3fd2a3cd7afc"} Jul 31 14:29:02.614898 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.614891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" event={"ID":"fef7b812-e779-44d0-b06b-fcee33821a52","Type":"ContainerStarted","Data":"5be7708658768324e9d4253b670801ea9e30074aa691944a236309f73406fc5d"} Jul 31 14:29:02.652454 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.652390 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5khgs" podStartSLOduration=2.093982431 podStartE2EDuration="3.652371951s" totalImagesPullingTime="1.55838952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:29:02.651784564 +0000 UTC m=+107.083273217" watchObservedRunningTime="2026-07-31 14:29:02.652371951 +0000 UTC m=+107.083860603" Jul 31 14:29:02.713438 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.713398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:02.796314 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:02.796288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:03.153386 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.153303 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:03.235350 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.235316 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:03.621248 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.621213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fjp" event={"ID":"b5ba8c40-8253-40c4-8cd6-3ed964b580b9","Type":"ContainerStarted","Data":"df85bf53200c50abd8df7d44d429cedf312d491aff6b688554e41f10ca5b7b4b"} Jul 31 14:29:03.621716 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.621266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fjp" event={"ID":"b5ba8c40-8253-40c4-8cd6-3ed964b580b9","Type":"ContainerStarted","Data":"3361d1e9e69b6e3892b1d717cd3bcbcfb9eff746cb79098b9b53847293bcf447"} Jul 31 14:29:03.622561 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.622539 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3" exitCode=0 Jul 31 14:29:03.622673 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.622607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3"} Jul 31 14:29:03.649354 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:03.649301 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2fjp" podStartSLOduration=2.867935358 podStartE2EDuration="4.649285908s" totalImagesPullingTime="1.699826289s" totalInitContainerRuntime="81.524261ms" isStatefulPod=true podCreationTimestamp="2026-07-31 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:29:03.648633613 +0000 UTC m=+108.080122266" watchObservedRunningTime="2026-07-31 14:29:03.649285908 +0000 UTC m=+108.080774559" Jul 31 14:29:05.120222 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:05.120185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:05.212059 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:05.212028 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:05.272813 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:05.272742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:05.462193 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:05.462118 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:06.030814 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.030786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:06.036117 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.036037 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:29:06.042131 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.042112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.046966 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.046948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 14:29:06.047197 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047173 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 14:29:06.047325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047227 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 14:29:06.047325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 14:29:06.047325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047295 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 14:29:06.047325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gmgz2\"" Jul 31 14:29:06.047613 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 14:29:06.047613 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047430 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 14:29:06.047613 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1p5nic7f3ukhp\"" Jul 31 14:29:06.047840 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047661 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 14:29:06.047840 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 14:29:06.047840 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 14:29:06.048039 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047924 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 14:29:06.048039 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 14:29:06.048039 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.047981 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 14:29:06.050643 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.050621 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 14:29:06.055424 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.055404 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 14:29:06.062352 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.062326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:29:06.190979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.190945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.190993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191312 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvmjr\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-kube-api-access-rvmjr\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.191721 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.192086 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.191731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292565 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292565 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.292763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvmjr\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-kube-api-access-rvmjr\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.292981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293472 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.293265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.293913 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.293678 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.294030 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.294003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.294099 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.294049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.294099 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.294080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.294528 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.294455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.295999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.294685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.295999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.295101 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.295999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.295401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.296365 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.296210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.296530 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.296506 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.296738 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.296564 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.297074 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.297053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.297598 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.297560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.298107 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.298018 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.298480 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.298420 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.298563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.298494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.298929 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.298880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.299024 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.298937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.299112 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.299094 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.299653 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.299621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.301066 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.300914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvmjr\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-kube-api-access-rvmjr\") pod \"prometheus-k8s-0\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.354609 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.354568 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:06.494641 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.494504 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:29:06.498087 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:29:06.498063 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34014f2c_36ca_4d6c_a038_6d9f1cc221b3.slice/crio-dcaac3f4ff68cb802036eb8e9f7cc6ba6785cd8a960930f499c324a510d45be4 WatchSource:0}: Error finding container dcaac3f4ff68cb802036eb8e9f7cc6ba6785cd8a960930f499c324a510d45be4: Status 404 returned error can't find the container with id dcaac3f4ff68cb802036eb8e9f7cc6ba6785cd8a960930f499c324a510d45be4 Jul 31 14:29:06.636128 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.636091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda"} Jul 31 14:29:06.636282 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.636179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65"} Jul 31 14:29:06.636282 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.636224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8"} Jul 31 14:29:06.636282 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.636262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1"} Jul 31 14:29:06.636415 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.636299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5"} Jul 31 14:29:06.637564 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.637531 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" exitCode=0 Jul 31 14:29:06.637687 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.637617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} Jul 31 14:29:06.637687 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:06.637669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"dcaac3f4ff68cb802036eb8e9f7cc6ba6785cd8a960930f499c324a510d45be4"} Jul 31 14:29:07.645967 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:07.645926 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerStarted","Data":"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed"} Jul 31 14:29:07.692373 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:07.689335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.20313687 podStartE2EDuration="7.689314406s" totalImagesPullingTime="4.470075104s" totalInitContainerRuntime="16.102432ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:29:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:29:07.687217911 +0000 UTC m=+112.118706562" watchObservedRunningTime="2026-07-31 14:29:07.689314406 +0000 UTC m=+112.120803059" Jul 31 14:29:08.599184 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:08.599143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fxz7p" Jul 31 14:29:10.670600 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:10.670488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} Jul 31 14:29:10.671018 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:10.670625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} Jul 31 14:29:12.384386 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:12.384355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:12.483757 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:12.483721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:12.654719 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:12.654644 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:12.880805 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:12.880772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.009922 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.009891 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.223718 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.223637 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.322853 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.322812 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.442314 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.442286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.618373 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.618340 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.683943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.683907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} Jul 31 14:29:13.684104 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.683975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} Jul 31 14:29:13.684104 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.684014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} Jul 31 14:29:13.684104 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.684044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerStarted","Data":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} Jul 31 14:29:13.705419 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.705394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:13.734275 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:13.734215 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.5536899499999999 podStartE2EDuration="7.734194708s" totalImagesPullingTime="6.161113141s" totalInitContainerRuntime="19.391617ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:29:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:29:13.731957428 +0000 UTC m=+118.163446080" watchObservedRunningTime="2026-07-31 14:29:13.734194708 +0000 UTC m=+118.165683361" Jul 31 14:29:14.046175 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.046141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:14.221995 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.221958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:14.380216 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.380134 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:14.552809 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.552774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:14.630423 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.630344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:14.867695 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.867661 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:14.964797 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:14.964723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:15.825676 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:15.825642 2576 patch_prober.go:28] interesting pod/image-registry-65f849d975-6jb65 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 14:29:15.826022 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:15.825695 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65f849d975-6jb65" podUID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 14:29:16.354957 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:16.354927 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:29:17.783667 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:17.783635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:17.849742 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:17.849701 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:18.595674 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:18.595643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:29:18.775436 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:18.775404 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65f849d975-6jb65"] Jul 31 14:29:18.781087 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:18.781050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:18.878604 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:18.878500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:18.957311 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:18.957277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:19.112305 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:19.112257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:19.182647 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:19.182528 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:19.707648 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:19.707614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:19.784346 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:19.784312 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:22.437501 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:22.437464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:22.551786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:22.551749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:22.661926 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:22.661892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:24.142988 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:24.142951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:24.322732 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:24.322693 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:25.883017 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:25.882981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:29:25.885240 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:25.885213 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc87c6db-643a-48c0-9ea0-b5610e1abad5-metrics-certs\") pod \"network-metrics-daemon-znd7x\" (UID: \"fc87c6db-643a-48c0-9ea0-b5610e1abad5\") " pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:29:25.937561 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:25.937532 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tnlz\"" Jul 31 14:29:25.945492 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:25.945472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-znd7x" Jul 31 14:29:26.085767 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:26.085739 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-znd7x"] Jul 31 14:29:26.089019 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:29:26.088994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc87c6db_643a_48c0_9ea0_b5610e1abad5.slice/crio-6365a11f8b88bcee845f8ba92476f3f7c3dd56ef1a24e1f513840b3d5abd1f91 WatchSource:0}: Error finding container 6365a11f8b88bcee845f8ba92476f3f7c3dd56ef1a24e1f513840b3d5abd1f91: Status 404 returned error can't find the container with id 6365a11f8b88bcee845f8ba92476f3f7c3dd56ef1a24e1f513840b3d5abd1f91 Jul 31 14:29:26.735204 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:26.735164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-znd7x" event={"ID":"fc87c6db-643a-48c0-9ea0-b5610e1abad5","Type":"ContainerStarted","Data":"6365a11f8b88bcee845f8ba92476f3f7c3dd56ef1a24e1f513840b3d5abd1f91"} Jul 31 14:29:26.796959 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:26.796919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:26.892599 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:26.892532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:26.989710 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:26.989635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:28.425883 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.425685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:28.533250 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.533214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:28.746149 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.746052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-znd7x" event={"ID":"fc87c6db-643a-48c0-9ea0-b5610e1abad5","Type":"ContainerStarted","Data":"8906fa6df609583c4ce9e3522985216f90ba14d5a598c2aa4b91964fe8c728ec"} Jul 31 14:29:28.746149 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.746109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-znd7x" event={"ID":"fc87c6db-643a-48c0-9ea0-b5610e1abad5","Type":"ContainerStarted","Data":"9818081668a5980bf9dc6f2b9b42261219d6a5057a99f84d60c58fc4f0a9c043"} Jul 31 14:29:28.767017 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.766960 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-znd7x" podStartSLOduration=131.207600366 podStartE2EDuration="2m12.766940846s" totalImagesPullingTime="1.55934048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:29:28.765648339 +0000 UTC m=+133.197136992" watchObservedRunningTime="2026-07-31 14:29:28.766940846 +0000 UTC m=+133.198429498" Jul 31 14:29:28.877425 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.877391 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:28.978434 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:28.978399 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:29.591715 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:29.591682 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:29.701185 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:29.701148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:30.496094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:30.496053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:30.576857 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:30.576819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:35.051207 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:35.051172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:35.152091 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:35.152053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:36.248422 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:36.248393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:36.353166 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:36.353136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:37.087817 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:37.087784 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:37.858908 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:37.858864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:38.281650 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:38.281617 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:38.381002 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:38.380967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:42.786958 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:42.786925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:43.433961 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:43.433924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:43.794547 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:43.794502 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65f849d975-6jb65" podUID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" containerName="registry" containerID="cri-o://adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832" gracePeriod=30 Jul 31 14:29:44.040687 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.040665 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:29:44.135460 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135381 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-certificates\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135460 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135421 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e9204d-0f8f-474e-9fb5-913515e77c7c-ca-trust-extracted\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135460 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-bound-sa-token\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135506 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-trusted-ca\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135548 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-image-registry-private-configuration\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135592 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-installation-pull-secrets\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135630 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xtz\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-kube-api-access-s9xtz\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135763 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135669 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") pod \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\" (UID: \"b1e9204d-0f8f-474e-9fb5-913515e77c7c\") " Jul 31 14:29:44.135999 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.135889 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:29:44.136158 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.136105 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:29:44.138052 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.138032 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:29:44.138302 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.138239 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:29:44.138302 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.138250 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:29:44.138444 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.138378 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-kube-api-access-s9xtz" (OuterVolumeSpecName: "kube-api-access-s9xtz") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "kube-api-access-s9xtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:29:44.138444 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.138391 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:29:44.144174 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.144149 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e9204d-0f8f-474e-9fb5-913515e77c7c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b1e9204d-0f8f-474e-9fb5-913515e77c7c" (UID: "b1e9204d-0f8f-474e-9fb5-913515e77c7c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:29:44.236331 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236308 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1e9204d-0f8f-474e-9fb5-913515e77c7c-ca-trust-extracted\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236331 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236331 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-bound-sa-token\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236482 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236340 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-trusted-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236482 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236349 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-image-registry-private-configuration\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236482 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236358 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1e9204d-0f8f-474e-9fb5-913515e77c7c-installation-pull-secrets\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236482 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236368 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xtz\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-kube-api-access-s9xtz\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236482 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236377 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-tls\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.236482 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.236386 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1e9204d-0f8f-474e-9fb5-913515e77c7c-registry-certificates\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:29:44.554173 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.554135 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:44.655545 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.655514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:29:44.811046 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.810960 2576 generic.go:356] "Generic (PLEG): container finished" podID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" containerID="adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832" exitCode=0 Jul 31 14:29:44.811046 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.811003 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65f849d975-6jb65" Jul 31 14:29:44.811563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.811043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f849d975-6jb65" event={"ID":"b1e9204d-0f8f-474e-9fb5-913515e77c7c","Type":"ContainerDied","Data":"adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832"} Jul 31 14:29:44.811563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.811098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65f849d975-6jb65" event={"ID":"b1e9204d-0f8f-474e-9fb5-913515e77c7c","Type":"ContainerDied","Data":"07893b4a64e2bc8836ad27247eda94e11ebb38853877aab5642008237f0a6d9a"} Jul 31 14:29:44.811563 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.811139 2576 scope.go:117] "RemoveContainer" containerID="adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832" Jul 31 14:29:44.825524 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.825508 2576 scope.go:117] "RemoveContainer" containerID="adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832" Jul 31 14:29:44.825819 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:29:44.825797 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832\": container with ID starting with adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832 not found: ID does not exist" containerID="adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832" Jul 31 14:29:44.825909 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.825826 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832"} err="failed to get container status \"adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832\": rpc error: code = NotFound desc = could not find container \"adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832\": container with ID starting with adc933ae02988d00c0416c1a4b5e6443d18b2783f4c8114aa68e83b5ad72d832 not found: ID does not exist" Jul 31 14:29:44.832003 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.829454 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65f849d975-6jb65"] Jul 31 14:29:44.836193 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:44.836171 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65f849d975-6jb65"] Jul 31 14:29:46.212275 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:29:46.212231 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" path="/var/lib/kubelet/pods/b1e9204d-0f8f-474e-9fb5-913515e77c7c/volumes" Jul 31 14:30:01.692117 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:01.692081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:06.355058 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:06.355018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:06.375409 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:06.375381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:06.916119 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:06.916091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:15.944227 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:15.944129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:16.044028 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:16.043998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:20.223830 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.223797 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:30:20.224273 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.224130 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="alertmanager" containerID="cri-o://55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5" gracePeriod=120 Jul 31 14:30:20.224273 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.224160 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-metric" containerID="cri-o://1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda" gracePeriod=120 Jul 31 14:30:20.224273 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.224178 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy" containerID="cri-o://b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65" gracePeriod=120 Jul 31 14:30:20.224273 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.224191 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="prom-label-proxy" containerID="cri-o://9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed" gracePeriod=120 Jul 31 14:30:20.224509 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.224134 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-web" containerID="cri-o://57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8" gracePeriod=120 Jul 31 14:30:20.224509 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.224191 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="config-reloader" containerID="cri-o://b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1" gracePeriod=120 Jul 31 14:30:20.950506 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950473 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed" exitCode=0 Jul 31 14:30:20.950506 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950499 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65" exitCode=0 Jul 31 14:30:20.950506 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950505 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1" exitCode=0 Jul 31 14:30:20.950506 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950512 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5" exitCode=0 Jul 31 14:30:20.950844 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed"} Jul 31 14:30:20.950844 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65"} Jul 31 14:30:20.950844 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1"} Jul 31 14:30:20.950844 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:20.950727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5"} Jul 31 14:30:21.461694 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.461672 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:21.559034 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.558942 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-web\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559034 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559000 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-config-out\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559034 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-config-volume\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559038 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559058 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-metrics-client-ca\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-trusted-ca-bundle\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559204 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-web-config\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559273 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559342 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559311 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-tls-assets\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559682 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559371 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-main-tls\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559682 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559404 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-cluster-tls-config\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559682 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559431 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-main-db\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559682 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtckr\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-kube-api-access-mtckr\") pod \"3ba18153-1b98-438f-9264-88b19ab6fa86\" (UID: \"3ba18153-1b98-438f-9264-88b19ab6fa86\") " Jul 31 14:30:21.559682 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559474 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:21.559682 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559528 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:21.559981 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559746 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-metrics-client-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.559981 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.559764 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.560372 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.560332 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:30:21.562198 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.562161 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.562325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.562294 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-config-out" (OuterVolumeSpecName: "config-out") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:30:21.562325 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.562305 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.562687 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.562665 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:30:21.567877 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.567817 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-config-volume" (OuterVolumeSpecName: "config-volume") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.567877 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.567821 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-kube-api-access-mtckr" (OuterVolumeSpecName: "kube-api-access-mtckr") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "kube-api-access-mtckr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:30:21.568039 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.567881 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.568039 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.567994 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.569692 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.569670 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.575683 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.575658 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-web-config" (OuterVolumeSpecName: "web-config") pod "3ba18153-1b98-438f-9264-88b19ab6fa86" (UID: "3ba18153-1b98-438f-9264-88b19ab6fa86"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:21.660990 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.660953 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.660990 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.660982 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-tls-assets\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.660990 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.660992 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-main-tls\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.660990 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661001 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-cluster-tls-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661009 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-alertmanager-main-db\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661019 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtckr\" (UniqueName: \"kubernetes.io/projected/3ba18153-1b98-438f-9264-88b19ab6fa86-kube-api-access-mtckr\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661027 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661036 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ba18153-1b98-438f-9264-88b19ab6fa86-config-out\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661044 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-config-volume\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661052 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.661238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.661060 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ba18153-1b98-438f-9264-88b19ab6fa86-web-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:21.957292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957204 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda" exitCode=0 Jul 31 14:30:21.957292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957230 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerID="57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8" exitCode=0 Jul 31 14:30:21.957292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda"} Jul 31 14:30:21.957292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957281 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:21.957549 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957321 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8"} Jul 31 14:30:21.957549 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3ba18153-1b98-438f-9264-88b19ab6fa86","Type":"ContainerDied","Data":"d9881409ddc417910e80d3bf9e7add21f789af6a0ddb0421649712cec375e4b1"} Jul 31 14:30:21.957549 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.957375 2576 scope.go:117] "RemoveContainer" containerID="9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed" Jul 31 14:30:21.967242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.967223 2576 scope.go:117] "RemoveContainer" containerID="1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda" Jul 31 14:30:21.973979 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.973964 2576 scope.go:117] "RemoveContainer" containerID="b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65" Jul 31 14:30:21.981001 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.980984 2576 scope.go:117] "RemoveContainer" containerID="57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8" Jul 31 14:30:21.983513 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.983492 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:30:21.988116 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.988080 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:30:21.989509 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.989487 2576 scope.go:117] "RemoveContainer" containerID="b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1" Jul 31 14:30:21.996516 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:21.996493 2576 scope.go:117] "RemoveContainer" containerID="55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5" Jul 31 14:30:22.003069 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.003050 2576 scope.go:117] "RemoveContainer" containerID="07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3" Jul 31 14:30:22.010259 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.010239 2576 scope.go:117] "RemoveContainer" containerID="9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed" Jul 31 14:30:22.010617 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.010590 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed\": container with ID starting with 9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed not found: ID does not exist" containerID="9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed" Jul 31 14:30:22.010684 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.010629 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed"} err="failed to get container status \"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed\": rpc error: code = NotFound desc = could not find container \"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed\": container with ID starting with 9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed not found: ID does not exist" Jul 31 14:30:22.010684 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.010655 2576 scope.go:117] "RemoveContainer" containerID="1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda" Jul 31 14:30:22.010915 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.010895 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda\": container with ID starting with 1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda not found: ID does not exist" containerID="1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda" Jul 31 14:30:22.010959 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.010929 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda"} err="failed to get container status \"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda\": rpc error: code = NotFound desc = could not find container \"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda\": container with ID starting with 1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda not found: ID does not exist" Jul 31 14:30:22.010959 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.010946 2576 scope.go:117] "RemoveContainer" containerID="b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65" Jul 31 14:30:22.011214 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.011194 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65\": container with ID starting with b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65 not found: ID does not exist" containerID="b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65" Jul 31 14:30:22.011279 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.011224 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65"} err="failed to get container status \"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65\": rpc error: code = NotFound desc = could not find container \"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65\": container with ID starting with b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65 not found: ID does not exist" Jul 31 14:30:22.011279 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.011247 2576 scope.go:117] "RemoveContainer" containerID="57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8" Jul 31 14:30:22.011503 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.011486 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8\": container with ID starting with 57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8 not found: ID does not exist" containerID="57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8" Jul 31 14:30:22.011550 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.011507 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8"} err="failed to get container status \"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8\": rpc error: code = NotFound desc = could not find container \"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8\": container with ID starting with 57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8 not found: ID does not exist" Jul 31 14:30:22.011550 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.011521 2576 scope.go:117] "RemoveContainer" containerID="b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1" Jul 31 14:30:22.011759 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.011744 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1\": container with ID starting with b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1 not found: ID does not exist" containerID="b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1" Jul 31 14:30:22.011802 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.011764 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1"} err="failed to get container status \"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1\": rpc error: code = NotFound desc = could not find container \"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1\": container with ID starting with b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1 not found: ID does not exist" Jul 31 14:30:22.011802 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.011778 2576 scope.go:117] "RemoveContainer" containerID="55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5" Jul 31 14:30:22.011998 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.011982 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5\": container with ID starting with 55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5 not found: ID does not exist" containerID="55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5" Jul 31 14:30:22.012056 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012005 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5"} err="failed to get container status \"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5\": rpc error: code = NotFound desc = could not find container \"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5\": container with ID starting with 55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5 not found: ID does not exist" Jul 31 14:30:22.012056 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012024 2576 scope.go:117] "RemoveContainer" containerID="07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3" Jul 31 14:30:22.012230 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:22.012214 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3\": container with ID starting with 07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3 not found: ID does not exist" containerID="07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3" Jul 31 14:30:22.012267 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012235 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3"} err="failed to get container status \"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3\": rpc error: code = NotFound desc = could not find container \"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3\": container with ID starting with 07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3 not found: ID does not exist" Jul 31 14:30:22.012267 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012247 2576 scope.go:117] "RemoveContainer" containerID="9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed" Jul 31 14:30:22.012438 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012420 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed"} err="failed to get container status \"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed\": rpc error: code = NotFound desc = could not find container \"9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed\": container with ID starting with 9e927ac7b5ecb0e836546b2137554e59fda3d3fc39f5614cf207e169fbf0a4ed not found: ID does not exist" Jul 31 14:30:22.012502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012439 2576 scope.go:117] "RemoveContainer" containerID="1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda" Jul 31 14:30:22.012685 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012669 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda"} err="failed to get container status \"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda\": rpc error: code = NotFound desc = could not find container \"1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda\": container with ID starting with 1d8e28965a7724cade0bd949228a66f70192506d8314f6ab8d881742405a8cda not found: ID does not exist" Jul 31 14:30:22.012732 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012685 2576 scope.go:117] "RemoveContainer" containerID="b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65" Jul 31 14:30:22.012899 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012879 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65"} err="failed to get container status \"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65\": rpc error: code = NotFound desc = could not find container \"b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65\": container with ID starting with b4f77caaddcc521517248d27448bf763c46944e5479a6ad2a34033652c765c65 not found: ID does not exist" Jul 31 14:30:22.012971 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.012900 2576 scope.go:117] "RemoveContainer" containerID="57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8" Jul 31 14:30:22.013097 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013081 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8"} err="failed to get container status \"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8\": rpc error: code = NotFound desc = could not find container \"57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8\": container with ID starting with 57f4111640a9c58a411650c395fe30e80e53941e9f1d3cecc6ca2b3d20d47ff8 not found: ID does not exist" Jul 31 14:30:22.013167 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013098 2576 scope.go:117] "RemoveContainer" containerID="b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1" Jul 31 14:30:22.013331 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013315 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1"} err="failed to get container status \"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1\": rpc error: code = NotFound desc = could not find container \"b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1\": container with ID starting with b65975020068d255d5e014bb6b5fb5102ce76428af1ea785f5dad9bbdc7989b1 not found: ID does not exist" Jul 31 14:30:22.013379 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013333 2576 scope.go:117] "RemoveContainer" containerID="55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5" Jul 31 14:30:22.013536 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013519 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5"} err="failed to get container status \"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5\": rpc error: code = NotFound desc = could not find container \"55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5\": container with ID starting with 55224146795a3756110b7d9e0d67070984d045d3ea20e9a2af5d6db4df9fc8a5 not found: ID does not exist" Jul 31 14:30:22.013675 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013537 2576 scope.go:117] "RemoveContainer" containerID="07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3" Jul 31 14:30:22.013787 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.013771 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3"} err="failed to get container status \"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3\": rpc error: code = NotFound desc = could not find container \"07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3\": container with ID starting with 07a5d5397163249a58f81aafaca9065bae55bcfb136286cc59388d8785e770b3 not found: ID does not exist" Jul 31 14:30:22.019206 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019169 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:30:22.019450 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019439 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" containerName="registry" Jul 31 14:30:22.019489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019451 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" containerName="registry" Jul 31 14:30:22.019489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019463 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="alertmanager" Jul 31 14:30:22.019489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019468 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="alertmanager" Jul 31 14:30:22.019489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019476 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="config-reloader" Jul 31 14:30:22.019489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019482 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="config-reloader" Jul 31 14:30:22.019489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019488 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-metric" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019493 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-metric" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019501 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="init-config-reloader" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019506 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="init-config-reloader" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019515 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-web" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019520 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-web" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019530 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019536 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy" Jul 31 14:30:22.019679 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019541 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="prom-label-proxy" Jul 31 14:30:22.019994 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.019682 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="prom-label-proxy" Jul 31 14:30:22.024567 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024546 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy" Jul 31 14:30:22.024567 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024567 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-web" Jul 31 14:30:22.024567 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024591 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="kube-rbac-proxy-metric" Jul 31 14:30:22.024743 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024602 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e9204d-0f8f-474e-9fb5-913515e77c7c" containerName="registry" Jul 31 14:30:22.024743 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024609 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="alertmanager" Jul 31 14:30:22.024743 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024615 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="prom-label-proxy" Jul 31 14:30:22.024743 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.024622 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" containerName="config-reloader" Jul 31 14:30:22.029636 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.029622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.032049 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 14:30:22.032049 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032024 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 14:30:22.032233 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 14:30:22.032304 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032290 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hkwg9\"" Jul 31 14:30:22.032358 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032332 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 14:30:22.032547 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032533 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 14:30:22.032636 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032596 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 14:30:22.032767 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 14:30:22.032851 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.032806 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 14:30:22.038508 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.038487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:30:22.038754 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.038735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 14:30:22.165002 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.164965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdb6fa0-e957-4604-8b80-e3ef245c2897-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165002 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cdb6fa0-e957-4604-8b80-e3ef245c2897-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2nm2\" (UniqueName: \"kubernetes.io/projected/8cdb6fa0-e957-4604-8b80-e3ef245c2897-kube-api-access-v2nm2\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165242 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cdb6fa0-e957-4604-8b80-e3ef245c2897-config-out\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdb6fa0-e957-4604-8b80-e3ef245c2897-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-web-config\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.165476 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.165441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cdb6fa0-e957-4604-8b80-e3ef245c2897-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.212686 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.212573 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ba18153-1b98-438f-9264-88b19ab6fa86" path="/var/lib/kubelet/pods/3ba18153-1b98-438f-9264-88b19ab6fa86/volumes" Jul 31 14:30:22.266054 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdb6fa0-e957-4604-8b80-e3ef245c2897-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266054 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cdb6fa0-e957-4604-8b80-e3ef245c2897-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2nm2\" (UniqueName: \"kubernetes.io/projected/8cdb6fa0-e957-4604-8b80-e3ef245c2897-kube-api-access-v2nm2\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266292 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266526 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cdb6fa0-e957-4604-8b80-e3ef245c2897-config-out\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266526 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266526 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdb6fa0-e957-4604-8b80-e3ef245c2897-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266526 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266744 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-web-config\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266744 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cdb6fa0-e957-4604-8b80-e3ef245c2897-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.266920 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.266900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cdb6fa0-e957-4604-8b80-e3ef245c2897-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.267343 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.267314 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdb6fa0-e957-4604-8b80-e3ef245c2897-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269304 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269304 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269216 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cdb6fa0-e957-4604-8b80-e3ef245c2897-config-out\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269304 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269280 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269515 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cdb6fa0-e957-4604-8b80-e3ef245c2897-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269515 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269629 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269677 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269864 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.269898 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.269887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdb6fa0-e957-4604-8b80-e3ef245c2897-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.270957 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.270939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cdb6fa0-e957-4604-8b80-e3ef245c2897-web-config\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.273959 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.273943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2nm2\" (UniqueName: \"kubernetes.io/projected/8cdb6fa0-e957-4604-8b80-e3ef245c2897-kube-api-access-v2nm2\") pod \"alertmanager-main-0\" (UID: \"8cdb6fa0-e957-4604-8b80-e3ef245c2897\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.340267 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.340220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:30:22.482807 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.482639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:30:22.485485 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:30:22.485456 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdb6fa0_e957_4604_8b80_e3ef245c2897.slice/crio-9126d2a432ba6232a4aabfff7fe5c48f3f87a299ba5ba13308fbe6fb85087cd9 WatchSource:0}: Error finding container 9126d2a432ba6232a4aabfff7fe5c48f3f87a299ba5ba13308fbe6fb85087cd9: Status 404 returned error can't find the container with id 9126d2a432ba6232a4aabfff7fe5c48f3f87a299ba5ba13308fbe6fb85087cd9 Jul 31 14:30:22.963491 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.963449 2576 generic.go:356] "Generic (PLEG): container finished" podID="8cdb6fa0-e957-4604-8b80-e3ef245c2897" containerID="39d7345ddbd92eb7c3632242f628d5ba74cd460b400f1b4f2afce192e0ef858f" exitCode=0 Jul 31 14:30:22.963706 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.963529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerDied","Data":"39d7345ddbd92eb7c3632242f628d5ba74cd460b400f1b4f2afce192e0ef858f"} Jul 31 14:30:22.963706 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:22.963634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"9126d2a432ba6232a4aabfff7fe5c48f3f87a299ba5ba13308fbe6fb85087cd9"} Jul 31 14:30:23.970518 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:23.970481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"23cec293cff4b3680bb65253883d5419785b21a065f0d81661e6e7fb0b5940c5"} Jul 31 14:30:23.970972 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:23.970595 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"ec6e6d198c5271760d4ddd92e39fa8cc573e979d316224d1b0c2b85ed1f6cf77"} Jul 31 14:30:23.970972 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:23.970630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"310c28ee384e607412ff6f9abe0e5f5a423a541d2117802338846a3ae6acf180"} Jul 31 14:30:23.970972 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:23.970656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"8eefed811e75e4351e2017061ee8e818587dea4d7b3cfcb964d60b7d74766018"} Jul 31 14:30:23.970972 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:23.970680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"323d2106fb687ecc144154cc20e2eb8c7ef15fc53976e376232bdcd7c9272861"} Jul 31 14:30:23.970972 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:23.970711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cdb6fa0-e957-4604-8b80-e3ef245c2897","Type":"ContainerStarted","Data":"c0c32bdf7607a747b699323702b242865d76db4d395e5a5e6652748676a7df69"} Jul 31 14:30:24.014173 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.014115 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.998946577 podStartE2EDuration="3.014097847s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.15127ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:30:24.012159078 +0000 UTC m=+188.443647730" watchObservedRunningTime="2026-07-31 14:30:24.014097847 +0000 UTC m=+188.445586498" Jul 31 14:30:24.608750 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.608714 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:30:24.609070 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.609039 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="prometheus" containerID="cri-o://16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" gracePeriod=600 Jul 31 14:30:24.609145 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.609060 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="thanos-sidecar" containerID="cri-o://7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" gracePeriod=600 Jul 31 14:30:24.609145 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.609098 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="config-reloader" containerID="cri-o://3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" gracePeriod=600 Jul 31 14:30:24.609145 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.609123 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-web" containerID="cri-o://fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" gracePeriod=600 Jul 31 14:30:24.609429 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.609041 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy" containerID="cri-o://7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" gracePeriod=600 Jul 31 14:30:24.609429 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.609072 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" gracePeriod=600 Jul 31 14:30:24.845386 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.845361 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979231 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" exitCode=0 Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979259 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" exitCode=0 Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979265 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" exitCode=0 Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979271 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" exitCode=0 Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979277 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" exitCode=0 Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979281 2576 generic.go:356] "Generic (PLEG): container finished" podID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" exitCode=0 Jul 31 14:30:24.979315 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979306 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979463 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} Jul 31 14:30:24.979912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.979542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34014f2c-36ca-4d6c-a038-6d9f1cc221b3","Type":"ContainerDied","Data":"dcaac3f4ff68cb802036eb8e9f7cc6ba6785cd8a960930f499c324a510d45be4"} Jul 31 14:30:24.986848 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.986831 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:24.989900 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.989881 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-trusted-ca-bundle\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990001 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.989911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-thanos-prometheus-http-client-file\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990001 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.989935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-serving-certs-ca-bundle\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990001 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.989966 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config-out\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990129 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-db\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990185 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990133 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-tls-assets\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990185 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990160 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-grpc-tls\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990285 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990192 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-1\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990285 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990218 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-tls\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990285 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990246 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-2\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990299 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-web-config\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990339 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-kube-rbac-proxy\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990369 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990379 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.990430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990402 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-kubelet-serving-ca-bundle\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990430 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990408 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990430 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990471 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-0\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990534 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvmjr\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-kube-api-access-rvmjr\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990561 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-metrics-client-ca\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990623 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-metrics-client-certs\") pod \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\" (UID: \"34014f2c-36ca-4d6c-a038-6d9f1cc221b3\") " Jul 31 14:30:24.990741 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990676 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.991054 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990852 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:24.991054 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990870 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:24.991054 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990885 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:24.991054 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.990949 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.991411 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.991353 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:30:24.993338 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.991967 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.993338 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.993302 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.993831 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.993802 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.994210 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994182 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.994450 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994425 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:30:24.994806 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994636 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.994806 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994701 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.994806 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994724 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:30:24.995062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994808 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config-out" (OuterVolumeSpecName: "config-out") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:30:24.995062 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.994827 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.995294 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.995263 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.995441 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.995415 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-kube-api-access-rvmjr" (OuterVolumeSpecName: "kube-api-access-rvmjr") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "kube-api-access-rvmjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:30:24.995615 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.995568 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config" (OuterVolumeSpecName: "config") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.995936 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.995916 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:24.996379 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:24.996363 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.004555 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.004527 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.007167 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.007122 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-web-config" (OuterVolumeSpecName: "web-config") pod "34014f2c-36ca-4d6c-a038-6d9f1cc221b3" (UID: "34014f2c-36ca-4d6c-a038-6d9f1cc221b3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:30:25.011175 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.011157 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.018197 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.018181 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.025337 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.025318 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.031820 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.031801 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.032092 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.032074 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.032143 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032103 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} err="failed to get container status \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" Jul 31 14:30:25.032143 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032125 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.032361 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.032341 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.032432 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032364 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} err="failed to get container status \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" Jul 31 14:30:25.032432 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032380 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.032679 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.032663 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.032749 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032686 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} err="failed to get container status \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" Jul 31 14:30:25.032749 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032705 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.032936 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.032920 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.032969 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032940 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} err="failed to get container status \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" Jul 31 14:30:25.032969 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.032953 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.033154 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.033141 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.033190 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033157 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} err="failed to get container status \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" Jul 31 14:30:25.033190 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033168 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.033368 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.033353 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.033403 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033372 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} err="failed to get container status \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" Jul 31 14:30:25.033403 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033390 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.033659 ip-10-0-138-146 kubenswrapper[2576]: E0731 14:30:25.033642 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.033699 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033663 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} err="failed to get container status \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" Jul 31 14:30:25.033699 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033678 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.033900 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033878 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} err="failed to get container status \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" Jul 31 14:30:25.033900 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.033899 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.034130 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034112 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} err="failed to get container status \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" Jul 31 14:30:25.034174 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034131 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.034357 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034340 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} err="failed to get container status \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" Jul 31 14:30:25.034357 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034357 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.034564 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034547 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} err="failed to get container status \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" Jul 31 14:30:25.034642 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034565 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.034804 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034785 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} err="failed to get container status \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" Jul 31 14:30:25.034855 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034804 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.035005 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.034990 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} err="failed to get container status \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" Jul 31 14:30:25.035053 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035005 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.035223 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035204 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} err="failed to get container status \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" Jul 31 14:30:25.035275 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035224 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.035425 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035408 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} err="failed to get container status \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" Jul 31 14:30:25.035466 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035425 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.035638 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035621 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} err="failed to get container status \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" Jul 31 14:30:25.035693 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035638 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.035856 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035840 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} err="failed to get container status \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" Jul 31 14:30:25.035902 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.035857 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.036060 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036045 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} err="failed to get container status \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" Jul 31 14:30:25.036100 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036061 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.036248 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036233 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} err="failed to get container status \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" Jul 31 14:30:25.036294 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036247 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.036420 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036405 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} err="failed to get container status \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" Jul 31 14:30:25.036457 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036420 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.036610 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036595 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} err="failed to get container status \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" Jul 31 14:30:25.036651 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036610 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.036804 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036787 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} err="failed to get container status \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" Jul 31 14:30:25.036852 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036805 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.036987 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036961 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} err="failed to get container status \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" Jul 31 14:30:25.036987 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.036978 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.037187 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037172 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} err="failed to get container status \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" Jul 31 14:30:25.037187 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037186 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.037383 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037367 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} err="failed to get container status \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" Jul 31 14:30:25.037426 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037383 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.037599 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037568 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} err="failed to get container status \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" Jul 31 14:30:25.037644 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037599 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.037801 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037783 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} err="failed to get container status \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" Jul 31 14:30:25.037801 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037801 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.037998 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037982 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} err="failed to get container status \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" Jul 31 14:30:25.038041 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.037998 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.038171 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038156 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} err="failed to get container status \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" Jul 31 14:30:25.038208 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038170 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.038355 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038340 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} err="failed to get container status \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" Jul 31 14:30:25.038392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038355 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.038539 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038524 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} err="failed to get container status \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" Jul 31 14:30:25.038605 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038539 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.038787 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038773 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} err="failed to get container status \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" Jul 31 14:30:25.038825 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038787 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.038968 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038952 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} err="failed to get container status \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" Jul 31 14:30:25.039012 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.038967 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.039153 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} err="failed to get container status \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" Jul 31 14:30:25.039200 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039154 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.039363 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039343 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} err="failed to get container status \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" Jul 31 14:30:25.039406 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039365 2576 scope.go:117] "RemoveContainer" containerID="a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc" Jul 31 14:30:25.039541 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039526 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc"} err="failed to get container status \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": rpc error: code = NotFound desc = could not find container \"a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc\": container with ID starting with a7fe0b17803cbe6dba828d6bd730627dede7b69fbff4c73da7fc116d06dbb0bc not found: ID does not exist" Jul 31 14:30:25.039599 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039540 2576 scope.go:117] "RemoveContainer" containerID="7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099" Jul 31 14:30:25.039754 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039733 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099"} err="failed to get container status \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": rpc error: code = NotFound desc = could not find container \"7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099\": container with ID starting with 7c5b8961cf9d9c51b007f1bee2448b5198e7ec0fcf603b9e5897fd1a6806d099 not found: ID does not exist" Jul 31 14:30:25.039754 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039753 2576 scope.go:117] "RemoveContainer" containerID="fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede" Jul 31 14:30:25.039908 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039891 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede"} err="failed to get container status \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": rpc error: code = NotFound desc = could not find container \"fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede\": container with ID starting with fff770ab126c28ed631d0a62ef0b18392224fa49631f56a871b66bc0f5c5bede not found: ID does not exist" Jul 31 14:30:25.039908 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.039907 2576 scope.go:117] "RemoveContainer" containerID="7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41" Jul 31 14:30:25.040109 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040093 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41"} err="failed to get container status \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": rpc error: code = NotFound desc = could not find container \"7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41\": container with ID starting with 7f331d32bd5175477b6fdd6bcc5d4f3ba03e30ae0da104d185eea16186d77c41 not found: ID does not exist" Jul 31 14:30:25.040155 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040109 2576 scope.go:117] "RemoveContainer" containerID="3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a" Jul 31 14:30:25.040303 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040288 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a"} err="failed to get container status \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": rpc error: code = NotFound desc = could not find container \"3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a\": container with ID starting with 3db2ce81e0e009bac96ad0e5d367461b14014289f9eb84b3cdcf3dc6ada1bd1a not found: ID does not exist" Jul 31 14:30:25.040338 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040303 2576 scope.go:117] "RemoveContainer" containerID="16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2" Jul 31 14:30:25.040477 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040462 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2"} err="failed to get container status \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": rpc error: code = NotFound desc = could not find container \"16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2\": container with ID starting with 16f9524f9f166f1a9076638c65efeacc14117371b1b68651a45fa3d348703cb2 not found: ID does not exist" Jul 31 14:30:25.040516 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040479 2576 scope.go:117] "RemoveContainer" containerID="58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0" Jul 31 14:30:25.040674 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.040659 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0"} err="failed to get container status \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": rpc error: code = NotFound desc = could not find container \"58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0\": container with ID starting with 58318b46da4e545e62997ca6499a447a0a1a2ed5998d26114f405bf14303a6d0 not found: ID does not exist" Jul 31 14:30:25.092722 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092692 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092722 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092719 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092733 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092744 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092770 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvmjr\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-kube-api-access-rvmjr\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092804 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-configmap-metrics-client-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092825 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-metrics-client-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092843 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092859 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-config-out\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092873 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-db\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092886 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-tls-assets\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092897 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-grpc-tls\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092905 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092914 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.092912 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092923 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-web-config\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.093283 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092931 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-kube-rbac-proxy\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.093283 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.092941 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34014f2c-36ca-4d6c-a038-6d9f1cc221b3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\"" Jul 31 14:30:25.305742 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.305715 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:30:25.315148 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.315115 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:30:25.353016 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.352984 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:30:25.353274 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353262 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="config-reloader" Jul 31 14:30:25.353327 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353276 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="config-reloader" Jul 31 14:30:25.353327 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353287 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-thanos" Jul 31 14:30:25.353327 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353293 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-thanos" Jul 31 14:30:25.353327 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353302 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="prometheus" Jul 31 14:30:25.353327 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353311 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="prometheus" Jul 31 14:30:25.353327 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-web" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353331 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-web" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353338 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353343 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353351 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="init-config-reloader" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="init-config-reloader" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353365 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="thanos-sidecar" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353370 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="thanos-sidecar" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353422 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="config-reloader" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353430 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="thanos-sidecar" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353435 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353440 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-thanos" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353445 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="kube-rbac-proxy-web" Jul 31 14:30:25.353502 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.353453 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" containerName="prometheus" Jul 31 14:30:25.358856 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.358834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.361030 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.361009 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 14:30:25.362715 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.362691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 14:30:25.363146 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.363116 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 14:30:25.363146 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.363140 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 14:30:25.363146 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.363119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 14:30:25.363379 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.363235 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gmgz2\"" Jul 31 14:30:25.363445 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.363436 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 14:30:25.363685 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.363656 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 14:30:25.364159 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.364142 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1p5nic7f3ukhp\"" Jul 31 14:30:25.364341 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.364203 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 14:30:25.364341 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.364209 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 14:30:25.364341 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.364229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 14:30:25.365689 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.365598 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 14:30:25.365805 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.365696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 14:30:25.365805 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.365799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 14:30:25.368412 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.368395 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 14:30:25.374711 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.374690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 14:30:25.381422 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.381398 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:30:25.495135 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-config\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495500 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxkbc\" (UniqueName: \"kubernetes.io/projected/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-kube-api-access-gxkbc\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.495786 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.495693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596490 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596490 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-config\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596490 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596490 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxkbc\" (UniqueName: \"kubernetes.io/projected/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-kube-api-access-gxkbc\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.596827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597421 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.596970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597749 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.597681 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.597804 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.597770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.599392 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.599358 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600366 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.599645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600366 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.599703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600366 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.599795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-config\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600366 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.599949 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600366 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.600264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600366 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.600350 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.600757 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.600501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.601461 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.600933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.601461 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.601255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.601461 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.601418 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.601693 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.601598 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.602068 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.602038 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.602204 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.602186 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.602323 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.602304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.602735 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.602718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.610253 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.610234 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxkbc\" (UniqueName: \"kubernetes.io/projected/9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9-kube-api-access-gxkbc\") pod \"prometheus-k8s-0\" (UID: \"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.668428 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.668376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:25.810934 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.810898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:30:25.815976 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:30:25.815947 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc240e1_4b1b_49ea_b5fa_b9f9c117d2f9.slice/crio-898ec4a46d5aea8539454bcf378485d716d8e51bf088d109ab8cd29fb733c6a0 WatchSource:0}: Error finding container 898ec4a46d5aea8539454bcf378485d716d8e51bf088d109ab8cd29fb733c6a0: Status 404 returned error can't find the container with id 898ec4a46d5aea8539454bcf378485d716d8e51bf088d109ab8cd29fb733c6a0 Jul 31 14:30:25.985907 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.985868 2576 generic.go:356] "Generic (PLEG): container finished" podID="9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9" containerID="33613b856876db39946e86cbc89456742fa4a9a6e5a740a276e7709fa0301447" exitCode=0 Jul 31 14:30:25.986289 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.985932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerDied","Data":"33613b856876db39946e86cbc89456742fa4a9a6e5a740a276e7709fa0301447"} Jul 31 14:30:25.986289 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:25.985998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"898ec4a46d5aea8539454bcf378485d716d8e51bf088d109ab8cd29fb733c6a0"} Jul 31 14:30:26.215382 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.215342 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34014f2c-36ca-4d6c-a038-6d9f1cc221b3" path="/var/lib/kubelet/pods/34014f2c-36ca-4d6c-a038-6d9f1cc221b3/volumes" Jul 31 14:30:26.992815 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.992773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"cc5eb905186fdea84256f0a9dc2d9b089bb81cb4f23f401a82962e3b5c83e4b7"} Jul 31 14:30:26.993244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.992886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"11bf8e0c36baa1859eca806e217c0422301e0c9df5d31b0a1a573ab1d44a2b15"} Jul 31 14:30:26.993244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.992930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"95d3acb56376d6f501f422587e7628f214d81021d5a7f732ed85beeebc17b6a3"} Jul 31 14:30:26.993244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.992976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"37c537280433a6f7222e2b8d8250bacbd437b4be122ab50f16a638504f941aaa"} Jul 31 14:30:26.993244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.993015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"1af81d778a468034f060c0655097ce728f91ce1c6551e8f6540991c99232f6cd"} Jul 31 14:30:26.993244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:26.993053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9","Type":"ContainerStarted","Data":"1b29459fa72ce75b5a321fd65545c1a533218d8cc1149666197d49a85277f18c"} Jul 31 14:30:27.027827 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:27.027763 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.003781959 podStartE2EDuration="2.027742496s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.960537ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:30:27.025657683 +0000 UTC m=+191.457146335" watchObservedRunningTime="2026-07-31 14:30:27.027742496 +0000 UTC m=+191.459231149" Jul 31 14:30:27.943808 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:27.943770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:28.043356 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:28.043323 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:30.669395 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:30.669342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:30:31.676705 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:31.676674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:32.248002 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:32.247968 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:44.551921 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:44.551864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:44.652445 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:44.652404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:30:59.619900 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:30:59.619862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:12.475486 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:12.475448 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:12.576713 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:12.576673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:12.655733 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:12.655698 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:13.364408 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:13.364368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:13.468410 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:13.468375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:16.982995 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:16.982963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:17.714942 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:17.714909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:23.497851 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:23.497816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:23.599311 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:23.599276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:23.671157 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:23.671123 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:25.669503 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:25.669458 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:31:25.684770 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:25.684743 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:31:26.237617 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:26.237565 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:31:32.890252 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:32.890218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:48.881599 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:48.881492 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:31:49.498269 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:31:49.498238 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:32:16.126295 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:16.126265 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:32:16.131941 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:16.131916 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 14:32:16.149851 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:16.149827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:32:18.363562 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:18.363527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:32:18.935304 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:18.935261 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:32:43.958707 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:43.958672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:32:44.522798 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:44.522769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:32:50.595061 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:50.595020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:32:51.813353 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:32:51.813317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:34:21.564462 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:34:21.564424 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:34:22.137882 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:34:22.137852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:34:32.461229 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:34:32.461192 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:34:32.565529 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:34:32.565496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:35:05.282856 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:35:05.282820 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:35:05.866593 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:35:05.866539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:25.174426 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:25.174346 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:25.711480 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:25.711444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:30.033364 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:30.033329 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:30.596147 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:30.596109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:45.397754 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:45.397714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:51.116115 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:51.116073 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:36:51.178691 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:36:51.178660 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:37:07.677422 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:07.677385 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:37:07.792848 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:07.792813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:37:16.150627 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:16.150600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:37:16.169469 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:16.169446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:37:17.374624 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:17.374587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:37:38.100375 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:38.100337 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:37:38.196281 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:37:38.196204 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:38:16.986142 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:16.986107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:38:17.288780 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.288747 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc"] Jul 31 14:38:17.292122 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.292102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.299632 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.299599 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 31 14:38:17.300021 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.299995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 31 14:38:17.300158 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.300072 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 31 14:38:17.300158 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.300149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 31 14:38:17.300305 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.300150 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 31 14:38:17.300305 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.300227 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 31 14:38:17.300305 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.300263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 31 14:38:17.320751 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.320722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc"] Jul 31 14:38:17.382623 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.382589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.382623 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.382626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-ca\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.382841 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.382650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.382841 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.382712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-hub\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.382841 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.382819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/556a30ae-129d-4813-8d13-6e58f862fb66-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.382975 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.382856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmmn\" (UniqueName: \"kubernetes.io/projected/556a30ae-129d-4813-8d13-6e58f862fb66-kube-api-access-xxmmn\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.484244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.484199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-hub\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.484244 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.484248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/556a30ae-129d-4813-8d13-6e58f862fb66-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.484485 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.484269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmmn\" (UniqueName: \"kubernetes.io/projected/556a30ae-129d-4813-8d13-6e58f862fb66-kube-api-access-xxmmn\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.484485 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.484307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.484485 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.484325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-ca\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.484485 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.484343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.485075 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.485047 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/556a30ae-129d-4813-8d13-6e58f862fb66-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.486871 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.486842 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-hub\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.487009 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.486847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.487009 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.486926 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-ca\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.487009 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.486992 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556a30ae-129d-4813-8d13-6e58f862fb66-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.492901 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.492881 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmmn\" (UniqueName: \"kubernetes.io/projected/556a30ae-129d-4813-8d13-6e58f862fb66-kube-api-access-xxmmn\") pod \"cluster-proxy-proxy-agent-7465b9f59f-h6cvc\" (UID: \"556a30ae-129d-4813-8d13-6e58f862fb66\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.610560 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.610479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" Jul 31 14:38:17.743435 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.743401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc"] Jul 31 14:38:17.747270 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:38:17.747243 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod556a30ae_129d_4813_8d13_6e58f862fb66.slice/crio-7961956d6448e4f73a45744bbd5e33dd420c7192fdfe980272964698078660b8 WatchSource:0}: Error finding container 7961956d6448e4f73a45744bbd5e33dd420c7192fdfe980272964698078660b8: Status 404 returned error can't find the container with id 7961956d6448e4f73a45744bbd5e33dd420c7192fdfe980272964698078660b8 Jul 31 14:38:17.749215 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:17.749191 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:38:18.638043 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:18.637977 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:38:18.704762 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:18.704719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" event={"ID":"556a30ae-129d-4813-8d13-6e58f862fb66","Type":"ContainerStarted","Data":"7961956d6448e4f73a45744bbd5e33dd420c7192fdfe980272964698078660b8"} Jul 31 14:38:21.720567 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:21.720529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" event={"ID":"556a30ae-129d-4813-8d13-6e58f862fb66","Type":"ContainerStarted","Data":"0b46388696db483ae0853864a01f02f74a7ed82c313f7b57fca91990175e534b"} Jul 31 14:38:21.720942 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:21.720599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" event={"ID":"556a30ae-129d-4813-8d13-6e58f862fb66","Type":"ContainerStarted","Data":"dc7d7ab800b62a52c4adc5bb24ca01565cdd2d80c5eadb619ae6e5d1546bf902"} Jul 31 14:38:21.720942 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:21.720617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" event={"ID":"556a30ae-129d-4813-8d13-6e58f862fb66","Type":"ContainerStarted","Data":"7883f1ba9eb0e7cf853c735bf4145feb093df256f3844ee9c8ac6f51c30f80d1"} Jul 31 14:38:21.741983 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:21.741934 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7465b9f59f-h6cvc" podStartSLOduration=1.39080451 podStartE2EDuration="4.741918507s" totalImagesPullingTime="3.351113997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:38:21.741198196 +0000 UTC m=+666.172686848" watchObservedRunningTime="2026-07-31 14:38:21.741918507 +0000 UTC m=+666.173407157" Jul 31 14:38:39.974588 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:39.974551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:38:40.046487 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:38:40.046453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:42:16.176184 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:16.176108 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:42:16.191037 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:16.191012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:42:20.064271 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:20.064236 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:42:20.152661 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:20.152632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" limit=1024 Jul 31 14:42:24.105803 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:24.105766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q8pk6_ceff3d74-d284-4ac1-9b95-2ff4b32a865b/global-pull-secret-syncer/0.log" Jul 31 14:42:24.167122 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:24.167089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-548cm_0791dbf3-6c03-43d9-bd9c-132b99030260/konnectivity-agent/0.log" Jul 31 14:42:24.305753 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:24.305724 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-146.ec2.internal_58387e90a18e6c6e85d87a433f7aa861/haproxy/0.log" Jul 31 14:42:27.991654 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:27.991548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/alertmanager/0.log" Jul 31 14:42:28.020071 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.020046 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/config-reloader/0.log" Jul 31 14:42:28.050296 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.050268 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/kube-rbac-proxy-web/0.log" Jul 31 14:42:28.078104 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.078072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/kube-rbac-proxy/0.log" Jul 31 14:42:28.107597 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.107556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/kube-rbac-proxy-metric/0.log" Jul 31 14:42:28.137175 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.137151 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/prom-label-proxy/0.log" Jul 31 14:42:28.167895 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.167873 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cdb6fa0-e957-4604-8b80-e3ef245c2897/init-config-reloader/0.log" Jul 31 14:42:28.246658 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.246563 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-5khgs_fef7b812-e779-44d0-b06b-fcee33821a52/kube-state-metrics/0.log" Jul 31 14:42:28.274933 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.274904 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-5khgs_fef7b812-e779-44d0-b06b-fcee33821a52/kube-rbac-proxy-main/0.log" Jul 31 14:42:28.302642 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.302615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-5khgs_fef7b812-e779-44d0-b06b-fcee33821a52/kube-rbac-proxy-self/0.log" Jul 31 14:42:28.601913 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.601878 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2fjp_b5ba8c40-8253-40c4-8cd6-3ed964b580b9/node-exporter/0.log" Jul 31 14:42:28.630787 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.630751 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2fjp_b5ba8c40-8253-40c4-8cd6-3ed964b580b9/kube-rbac-proxy/0.log" Jul 31 14:42:28.657555 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.657524 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2fjp_b5ba8c40-8253-40c4-8cd6-3ed964b580b9/init-textfile/0.log" Jul 31 14:42:28.795106 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.795075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/prometheus/0.log" Jul 31 14:42:28.822503 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.822481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/config-reloader/0.log" Jul 31 14:42:28.850773 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.850734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/thanos-sidecar/0.log" Jul 31 14:42:28.877743 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.877672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/kube-rbac-proxy-web/0.log" Jul 31 14:42:28.902335 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.902313 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/kube-rbac-proxy/0.log" Jul 31 14:42:28.927646 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.927621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/kube-rbac-proxy-thanos/0.log" Jul 31 14:42:28.952805 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:28.952777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc240e1-4b1b-49ea-b5fa-b9f9c117d2f9/init-config-reloader/0.log" Jul 31 14:42:29.038724 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:29.038699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-qn777_219e520a-3b03-4cb6-9754-8ac10cd668b1/prometheus-operator-admission-webhook/0.log" Jul 31 14:42:31.341802 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.341767 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz"] Jul 31 14:42:31.344976 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.344958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.346993 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.346966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cchsp\"/\"default-dockercfg-cpg46\"" Jul 31 14:42:31.347681 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.347621 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cchsp\"/\"kube-root-ca.crt\"" Jul 31 14:42:31.347792 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.347685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cchsp\"/\"openshift-service-ca.crt\"" Jul 31 14:42:31.358015 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.357990 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz"] Jul 31 14:42:31.419280 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.419239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-podres\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.419280 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.419279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-lib-modules\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.419493 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.419312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-proc\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.419493 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.419396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-sys\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.419493 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.419436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8rdt\" (UniqueName: \"kubernetes.io/projected/74e42eea-dc40-48d4-946f-863462355c7a-kube-api-access-p8rdt\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.520871 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.520832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-sys\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.520871 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.520874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8rdt\" (UniqueName: \"kubernetes.io/projected/74e42eea-dc40-48d4-946f-863462355c7a-kube-api-access-p8rdt\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.520920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-podres\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.520936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-lib-modules\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.520966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-proc\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.520969 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-sys\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.521047 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-proc\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521094 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.521061 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-podres\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.521295 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.521107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74e42eea-dc40-48d4-946f-863462355c7a-lib-modules\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.531131 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.531097 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8rdt\" (UniqueName: \"kubernetes.io/projected/74e42eea-dc40-48d4-946f-863462355c7a-kube-api-access-p8rdt\") pod \"perf-node-gather-daemonset-6z5rz\" (UID: \"74e42eea-dc40-48d4-946f-863462355c7a\") " pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.654779 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.654688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:31.787529 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:31.787495 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz"] Jul 31 14:42:31.791617 ip-10-0-138-146 kubenswrapper[2576]: W0731 14:42:31.791590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod74e42eea_dc40_48d4_946f_863462355c7a.slice/crio-cf1c53b6e3bc46a57388f2c7e1f90a54b48552da5ea94dcff0ffbd21a65e959d WatchSource:0}: Error finding container cf1c53b6e3bc46a57388f2c7e1f90a54b48552da5ea94dcff0ffbd21a65e959d: Status 404 returned error can't find the container with id cf1c53b6e3bc46a57388f2c7e1f90a54b48552da5ea94dcff0ffbd21a65e959d Jul 31 14:42:32.652591 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.652553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" event={"ID":"74e42eea-dc40-48d4-946f-863462355c7a","Type":"ContainerStarted","Data":"2ccc7ef965747a1e3ca22e5017e1270d9a0f251af922657cdbe2dea3338690e9"} Jul 31 14:42:32.653084 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.652615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" event={"ID":"74e42eea-dc40-48d4-946f-863462355c7a","Type":"ContainerStarted","Data":"cf1c53b6e3bc46a57388f2c7e1f90a54b48552da5ea94dcff0ffbd21a65e959d"} Jul 31 14:42:32.653084 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.652685 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:32.673050 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.673003 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" podStartSLOduration=1.6729862199999999 podStartE2EDuration="1.67298622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:42:32.672106132 +0000 UTC m=+917.103594785" watchObservedRunningTime="2026-07-31 14:42:32.67298622 +0000 UTC m=+917.104474872" Jul 31 14:42:32.764627 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.764598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxz7p_d80c8832-047f-4d51-b327-cfc865467fab/dns/0.log" Jul 31 14:42:32.787593 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.787558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxz7p_d80c8832-047f-4d51-b327-cfc865467fab/kube-rbac-proxy/0.log" Jul 31 14:42:32.979728 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:32.979645 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5ngl_e9ad072d-0dc7-4dfd-a829-05c30d32b6aa/dns-node-resolver/0.log" Jul 31 14:42:33.413238 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:33.413209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcflc_af335670-24e5-41c3-8eb3-5f81c629018f/node-ca/0.log" Jul 31 14:42:34.597353 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:34.597307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76gkn_ed80a450-40c5-48a3-adf1-08bc7e79f66d/serve-healthcheck-canary/0.log" Jul 31 14:42:35.146121 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:35.146092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgj5h_56cb39d3-3f85-477b-a8e9-137308ba922e/kube-rbac-proxy/0.log" Jul 31 14:42:35.173329 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:35.173303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgj5h_56cb39d3-3f85-477b-a8e9-137308ba922e/exporter/0.log" Jul 31 14:42:35.199010 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:35.198968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgj5h_56cb39d3-3f85-477b-a8e9-137308ba922e/extractor/0.log" Jul 31 14:42:38.665416 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:38.665386 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cchsp/perf-node-gather-daemonset-6z5rz" Jul 31 14:42:39.427070 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:39.427035 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-7z2c6_5114df71-aa87-4f23-b900-5250e110847c/migrator/0.log" Jul 31 14:42:39.451555 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:39.451530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-7z2c6_5114df71-aa87-4f23-b900-5250e110847c/graceful-termination/0.log" Jul 31 14:42:40.930943 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:40.930918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/kube-multus-additional-cni-plugins/0.log" Jul 31 14:42:40.958345 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:40.958317 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/egress-router-binary-copy/0.log" Jul 31 14:42:40.985014 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:40.984983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/cni-plugins/0.log" Jul 31 14:42:41.011145 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.011115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/bond-cni-plugin/0.log" Jul 31 14:42:41.051789 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.051703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/routeoverride-cni/0.log" Jul 31 14:42:41.088432 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.088403 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/whereabouts-cni-bincopy/0.log" Jul 31 14:42:41.128105 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.128076 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lrnq_e8c6b89d-e72d-4297-b0b4-0b4193d654e5/whereabouts-cni/0.log" Jul 31 14:42:41.638322 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.638248 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wm448_0ec2738a-cd75-4ef2-9f7f-9adbff19a5db/kube-multus/0.log" Jul 31 14:42:41.810897 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.810872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-znd7x_fc87c6db-643a-48c0-9ea0-b5610e1abad5/network-metrics-daemon/0.log" Jul 31 14:42:41.834847 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:41.834817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-znd7x_fc87c6db-643a-48c0-9ea0-b5610e1abad5/kube-rbac-proxy/0.log" Jul 31 14:42:42.949933 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:42.949906 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-controller/0.log" Jul 31 14:42:42.973483 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:42.973446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/0.log" Jul 31 14:42:42.973647 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:42.973461 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovn-acl-logging/1.log" Jul 31 14:42:43.022809 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:43.022780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/kube-rbac-proxy-node/0.log" Jul 31 14:42:43.088707 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:43.088675 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/kube-rbac-proxy-ovn-metrics/0.log" Jul 31 14:42:43.123374 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:43.123332 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/northd/0.log" Jul 31 14:42:43.157873 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:43.157840 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/nbdb/0.log" Jul 31 14:42:43.182192 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:43.182165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/sbdb/0.log" Jul 31 14:42:43.237633 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:43.237535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mttx_ebaaf157-31c1-44e4-8a4a-55469b5f1ded/ovnkube-controller/0.log" Jul 31 14:42:44.555528 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:44.555495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ch4lf_237ca516-0ec7-4fdc-af3e-65d5aca218d8/network-check-target-container/0.log" Jul 31 14:42:45.503586 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:45.503545 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bsqm8_e38e136e-327d-4353-924f-8417850b3d3d/iptables-alerter/0.log" Jul 31 14:42:46.157489 ip-10-0-138-146 kubenswrapper[2576]: I0731 14:42:46.157456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tgt8v_a37468ac-06e2-491e-9843-a1a509836df1/tuned/0.log"